-- Logs begin at Fri 2022-05-13 14:14:20 UTC, end at Fri 2022-05-13 16:02:09 UTC. -- May 13 14:48:19.193654 dv-cinder-832130-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 13 14:48:19.205156 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 13 14:48:19.208071 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 13 14:48:19 2022] *** May 13 14:48:19.208240 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 14:48:19.208341 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 14:48:19.208429 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: nodename: dv-cinder-832130-2-iscsi May 13 14:48:19.208514 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: machine: x86_64 May 13 14:48:19.208601 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: clock source: unix May 13 14:48:19.208718 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: pcre jit disabled May 13 14:48:19.208813 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: detected number of CPU cores: 4 May 13 14:48:19.208918 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: current working directory: / May 13 14:48:19.209008 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: detected binary path: /usr/bin/uwsgi-core May 13 14:48:19.209100 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: your processes number limit is 47680 May 13 14:48:19.209186 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: your memory page size is 4096 bytes May 13 14:48:19.209271 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: detected max file descriptor number: 2048 May 13 14:48:19.209364 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: lock engine: pthread robust mutexes May 13 14:48:19.209612 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: thunder lock: enabled May 13 14:48:19.209899 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 13 14:48:19.210068 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 13 14:48:19.257572 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: Python main interpreter initialized at 0x561de65a39c0 May 13 14:48:19.257572 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: python threads support enabled May 13 14:48:19.257572 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: your server socket listen backlog is limited to 100 connections May 13 14:48:19.257572 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: your mercy for graceful operations on workers is 90 seconds May 13 14:48:19.258155 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: mapped 403077 bytes (393 KB) for 2 cores May 13 14:48:19.258155 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: *** Operational MODE: preforking *** May 13 14:48:19.263500 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: *** uWSGI is running in multiple interpreter mode *** May 13 14:48:19.263500 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: spawned uWSGI master process (pid: 79901) May 13 14:48:19.263500 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: spawned uWSGI worker 1 (pid: 79915, cores: 1) May 13 14:48:19.263500 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: spawned uWSGI worker 2 (pid: 79916, cores: 1) May 13 14:48:19.263500 dv-cinder-832130-2-iscsi devstack@keystone.service[79901]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 14:48:19.258564 dv-cinder-832130-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 13 14:48:26.291602 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 14:48:26.291602 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: from cryptography.utils import int_from_bytes May 13 14:48:26.292868 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 14:48:26.292868 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: from cryptography.utils import int_from_bytes May 13 14:48:26.343478 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 14:48:26.343755 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 14:48:26.343899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] command line args: [] {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 14:48:26.344241 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 14:48:26.344241 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ================================================================================ {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 14:48:26.344485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] admin_token = **** {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.344734 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] config_dir = [] {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.344887 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.345213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] config_source = [] {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.345213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] debug = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.345457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.347156 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.347395 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.347706 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.347870 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.348168 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] list_limit = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.348334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] log_config_append = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.348457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.348587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] log_dir = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.348705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] log_file = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.349049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.349524 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.349524 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.350187 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.350187 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.350187 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.351242 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.351242 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.351242 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.351242 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.352612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.352612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.352612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.352612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.352612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.354160 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.73/identity {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.354160 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] publish_errors = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.354160 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.354160 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.354160 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.354160 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.354160 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.355765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] standard_threads = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.355765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.355765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.355765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.355765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] use_journal = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.355765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] use_json = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.355765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] use_stderr = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.355765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] use_syslog = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.357421 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:26.357421 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.357421 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.357421 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.357421 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.357421 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.357421 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.357421 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.359038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.359038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.359038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.359038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.359038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.359038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.360353 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.360353 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.360353 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.360353 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.360353 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.361369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.361369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.361369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.361369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.361369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.362360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.362360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.362360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.363015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.363015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.363015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.363884 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.363884 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.363884 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.363884 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.364692 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.364692 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.364692 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.365412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.365412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.365412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.366009 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.366009 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.366009 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.366586 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.366586 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.366586 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.367188 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.367188 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.367592 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.367592 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.368006 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.368006 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.368409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.368619 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.368831 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.369043 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.369253 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.369459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.369681 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.369940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.370242 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.370450 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.370892 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.371116 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.371447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.371447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.371882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.371882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.372287 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.372513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.372725 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.373020 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.373302 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.373524 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.373731 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.373940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.374176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.374395 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.374635 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.374915 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.375131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.375351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.375562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.375786 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.376011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.376215 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.376508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.376821 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.377033 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.377236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.377451 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.377666 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.377894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.378104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.378315 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.378528 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.378749 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.379001 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.379222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.379445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.379654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.379874 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.380093 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.380348 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.380594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.380806 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] auth.external = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.381022 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.381347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.381564 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.381781 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] auth.password = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.382002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] auth.token = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.382205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.382418 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.382640 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.383024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.383238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.383444 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.383647 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.383855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] credential.caching = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.384104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.384323 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.384525 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.384737 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.384955 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.385162 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.385394 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.386207 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.386429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.386679 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.386986 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.387232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.387495 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.387736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.387991 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.388233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] federation.caching = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.388446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.389095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.389337 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.389557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.389768 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.389988 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.390197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.390408 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.390718 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.391065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.391268 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.391692 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] identity.caching = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.392733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.393043 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.393397 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.393397 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.394176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.394176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.394176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.395289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.395289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.395289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.395289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.395289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.396798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.396798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.396798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.396798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.396798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.396798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.398555 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.398555 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.398555 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.398555 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.398555 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.398555 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.398555 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.398555 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.400528 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.400528 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.400528 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.400528 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.400528 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.400528 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.400528 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.400528 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.400528 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.402901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.402901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.402901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.402901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.402901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.402901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.402901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.402901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.404508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.404508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.404508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.404508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.404508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.404508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.404508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.405937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.user = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.405937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.405937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.405937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.405937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.405937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.407213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.407213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.407213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.407213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.407213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.407213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.408401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.408401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.408401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.408401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.408401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.409401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.409401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.409401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.409401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.409401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.410413 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.410413 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.410413 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.410413 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.411224 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.411224 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.411224 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.411844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.411844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.411844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.412507 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.412507 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.412507 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.413145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.413145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.413145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] resource.caching = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.413770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.413770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.413770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.414374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.414374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.414799 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.414799 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.415313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.415313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.415313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] role.caching = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.415948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] role.driver = sql {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.415948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.416396 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.416396 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.416838 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.416838 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.417284 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.417284 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.417717 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.417717 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.418176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.418176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.418603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.418852 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.419097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.419323 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.419557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.419780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.420036 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.420274 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.420497 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.420722 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.420974 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.421215 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.421486 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.421728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.421933 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.422154 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.422364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.422591 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.422925 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.423155 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.423376 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.423616 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.423841 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] token.caching = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.424066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.424292 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.424536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.424758 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.425008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.425232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.425455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.425735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.425735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.426159 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.426159 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.426596 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.426844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.427103 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.427103 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.427740 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.427740 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.428195 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] database.connection = **** {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.428195 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.428652 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.428652 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.429095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.429095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.429523 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.429523 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.429974 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.429974 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.430394 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.430394 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.430955 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.430955 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.431532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.431532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.431532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.432140 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.432140 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:26.432140 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 14:48:26.465997 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.466439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.466439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.475947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.506504 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.506999 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.575175 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.636422 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.636868 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.708702 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.709141 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.709141 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.709627 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.709627 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.710114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.734505 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.734955 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.734955 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.735420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.735420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.735872 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.735872 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.748632 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.764888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.765325 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.765613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.765853 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.766290 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.766570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.766990 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:26.785594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.786024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 13 14:48:26.786401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.786727 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 13 14:48:26.787156 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.787542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.787946 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.788326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.799925 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.800363 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.800742 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.801155 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.810624 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:26.814252 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:26.814676 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.815114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.815640 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.816069 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.816453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.816846 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.817252 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.817644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.818307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.818698 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.852779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.854495 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:26.854785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.860193 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:26.860590 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.860829 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.868312 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:26.868693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.873955 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:26.874265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.874550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.874845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.875128 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.875404 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.875672 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.875934 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.895602 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.896053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.900599 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:26.904443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.904721 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.910404 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:26.914164 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:26.920553 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.920553 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.920553 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.920553 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.920553 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.920553 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.939606 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:26.940050 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.940298 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.940543 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.950325 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.952413 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.952865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.956390 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:26.956651 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.957083 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.957255 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.957541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.971918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:26.972352 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.972516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.972842 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.973111 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.973345 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.973613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:26.992875 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:26.996960 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.000562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.002308 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.004069 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.004381 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.004642 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.013025 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.014768 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.018195 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.018561 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.018793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.019101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.028915 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.028915 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.029538 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.037847 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.037847 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.038492 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.038492 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.038492 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.039379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.039379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.039379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.041090 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.041090 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.041090 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.041090 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.041090 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.041090 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.081361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x561de65a39c0 pid: 79915 (default app) May 13 14:48:27.085081 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad964dd6-988a-4d9e-96d3-b8211e18e8d6 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:27.085428 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad964dd6-988a-4d9e-96d3-b8211e18e8d6 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:27.085662 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad964dd6-988a-4d9e-96d3-b8211e18e8d6 None None] PATH_INFO: `/v3` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:27.090715 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1/1] 10.222.0.73 () {50 vars in 791 bytes} [Fri May 13 14:48:27 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:48:27.155558 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 14:48:27.155558 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: from cryptography.utils import int_from_bytes May 13 14:48:27.156165 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 14:48:27.156165 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: from cryptography.utils import int_from_bytes May 13 14:48:27.206591 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 14:48:27.206800 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 14:48:27.207011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] command line args: [] {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 14:48:27.207308 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 14:48:27.207488 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ================================================================================ {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 14:48:27.207750 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] admin_token = **** {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.208002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] config_dir = [] {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.208192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.208622 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] config_source = [] {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.208815 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] debug = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.209037 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.209283 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.209461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.209720 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.209970 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.210209 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] list_limit = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.210394 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] log_config_append = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.210643 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.210845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] log_dir = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.211031 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] log_file = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.211716 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.211716 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.211976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.213575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.213575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.213575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.213575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.213575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.213575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.213575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.214891 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.214891 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.214891 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.214891 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.214891 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.215352 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.73/identity {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.215583 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] publish_errors = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.215686 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.216996 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.216996 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.216996 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.216996 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.216996 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] standard_threads = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.216996 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.217732 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.217732 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.217732 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] use_journal = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.217732 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] use_json = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.218102 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] use_stderr = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.218102 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] use_syslog = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.218288 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:48:27.218952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.218952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.219184 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.219312 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.219665 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.219797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.220022 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.220268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.220522 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.220773 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.221030 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.221267 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.221520 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.221761 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.222014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.222267 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.222508 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.222769 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.223057 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.223312 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.223603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.223833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.224392 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.224392 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.225192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.225192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.225192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.225792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.225792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.225792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.226120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.226236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.227596 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.227596 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.227596 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.227596 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.227596 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.227596 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.228181 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.228181 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.228522 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.228522 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.228720 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.228929 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.229147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.231151 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.231151 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.231151 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.231151 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.231669 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.231669 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.231669 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.231986 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.232138 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.232363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.232604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.232846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.233098 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.233399 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.233589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.233835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.234072 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.234308 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.234804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.244476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.244476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.244476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.244476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.244476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.244476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.244476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.244476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.244476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.246344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.246344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.246344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.246344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.246344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.246344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.246344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.246344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.246344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.257249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.257249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.257249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.257249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.257249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.257249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.257249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.257249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.257249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.259128 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.259128 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.259128 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.259128 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.259128 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.259128 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.259128 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.259128 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.259128 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.259896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.259896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.259896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.259896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.259896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] auth.external = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.259896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.259896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.259896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.259896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] auth.password = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.260770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] auth.token = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.260770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.260770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.260770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.260770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.260770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.260770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.260770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.260770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] credential.caching = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.261564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.261564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.261564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.261564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.261564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.261564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.261564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.261564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.261564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.268694 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.268694 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.268694 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.268694 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.268694 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.268694 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.268694 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] federation.caching = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.268694 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.268694 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.269460 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.269460 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.269460 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.269460 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.269460 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.269460 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.269460 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.269460 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.269460 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.270285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] identity.caching = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.270285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.270285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.270285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.270285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.270285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.270285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.270285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.270285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.271230 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.271230 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.271230 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.271230 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.271230 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.271230 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.271230 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.271230 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.271230 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.279730 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.279730 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.279730 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.279730 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.279730 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.279730 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.279730 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.279730 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.279730 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.280636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.280636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.280636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.280636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.280636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.280636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.280636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.280636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.280636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.281525 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.281525 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.281525 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.281525 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.281525 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.281525 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.281525 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.281525 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.281525 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.282468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.282468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.282468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.282468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.282468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.282468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.282468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.user = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.282468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.282468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.283332 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.283332 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.283332 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.283332 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.283332 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.283332 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.283332 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.283332 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.283332 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.284357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.284357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.284357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.284357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.284357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.284357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.284357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.284357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.284357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.285297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.285297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.285297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.285297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.285297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.285297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.285297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.295061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.295061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.295061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.295061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.295061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.295061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.295061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.295061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.295061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.296059 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] resource.caching = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.296059 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.296059 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.296059 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.296059 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.296059 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.296059 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.296059 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.296059 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.296982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.296982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] role.caching = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.296982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] role.driver = sql {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.296982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.296982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.302859 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.302859 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.302859 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.302859 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.302859 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.302859 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.303654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.303654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.303654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.304018 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.304133 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.305015 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.305015 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.305015 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.305368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.306855 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.306855 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.306855 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.306855 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.306855 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.306855 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.308126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.308126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.308126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.308441 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.308553 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.314865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.314865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.314865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.314865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.314865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.314865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] token.caching = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.314865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.314865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.314865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.315969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.315969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.315969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.315969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.315969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.315969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.315969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.315969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.315969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.316902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.316902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.316902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.316902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.316902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.316902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] database.connection = **** {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.316902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.316902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.316902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.317847 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.317847 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.317847 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.317847 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.317847 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.317847 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.317847 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.317847 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.317847 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.319105 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.319105 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.319105 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.319105 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.319105 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.319549 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:48:27.322860 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79916) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 14:48:27.347785 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.348071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.348372 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.358350 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.378602 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.379096 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.421567 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.461292 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.461503 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.508266 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.508648 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.508765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.508939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.509220 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.509551 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.527745 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.528106 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.528259 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.528375 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.528727 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.528863 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.528986 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.538586 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.541888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.542096 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.542353 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.542521 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.542738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.542964 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.543250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79916) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 14:48:27.554389 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.554856 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 13 14:48:27.555124 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.555340 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 13 14:48:27.555574 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.555799 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.556021 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.556243 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.568530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.568904 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.569118 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.569328 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.578564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79916) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.582159 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79916) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.582532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.582882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.583185 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.583484 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.583755 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.584119 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.584411 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.584684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.584971 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.585241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.614217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.615971 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79916) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.616269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.622477 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79916) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.623018 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.623258 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.630695 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79916) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.631141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.636481 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79916) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.636896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.637154 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.637385 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.637613 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.637840 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.638116 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.638404 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.662569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.663010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.668444 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79916) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.672331 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.672708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.678083 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79916) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.682160 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79916) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.686121 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.686481 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.686712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.687002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.687378 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.687598 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.707733 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79916) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.708101 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.708309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.708569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.717246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.719043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.719349 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.722406 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79916) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.722690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.723046 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.723333 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.723752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.738375 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79916) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.738668 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.738985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.739267 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.739577 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.739867 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.740145 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.761554 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79916) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.765047 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79916) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.768448 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.770076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.771771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79916) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.772055 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.772339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.780577 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.782260 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79916) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.785578 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.785871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.786154 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.786429 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.796213 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79916) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.796529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.796812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.804867 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79916) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 14:48:27.805272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.805577 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.805850 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.806121 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.806417 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.806689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.806983 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.807264 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.807578 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.807849 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.808118 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.808510 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.808776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79916) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 14:48:27.849670 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x561de65a39c0 pid: 79916 (default app) May 13 14:48:36.197033 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745a0b2-3698-4f4d-9890-14598bc132f8 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:36.197543 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745a0b2-3698-4f4d-9890-14598bc132f8 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:36.197869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745a0b2-3698-4f4d-9890-14598bc132f8 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:36.200442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 2/2] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:48:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:48:36.209306 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81563f2c-dee0-405d-81f9-2d89186c5940 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:36.210061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81563f2c-dee0-405d-81f9-2d89186c5940 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:36.210061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81563f2c-dee0-405d-81f9-2d89186c5940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:36.247686 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG oslo_db.sqlalchemy.engines [None req-81563f2c-dee0-405d-81f9-2d89186c5940 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79916) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 14:48:36.459952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG passlib.handlers.bcrypt [None req-81563f2c-dee0-405d-81f9-2d89186c5940 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79916) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 13 14:48:36.460281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG passlib.handlers.bcrypt [None req-81563f2c-dee0-405d-81f9-2d89186c5940 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79916) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 13 14:48:36.521096 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-81563f2c-dee0-405d-81f9-2d89186c5940 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:48:36.523105 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-81563f2c-dee0-405d-81f9-2d89186c5940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:48:36.679482 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1/3] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:48:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 13 14:48:36.848611 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745a0b2-3698-4f4d-9890-14598bc132f8 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:36.886242 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG oslo_db.sqlalchemy.engines [None req-8745a0b2-3698-4f4d-9890-14598bc132f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 14:48:37.152799 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745a0b2-3698-4f4d-9890-14598bc132f8 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:37.160836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6319d5-6c3f-4233-9fa9-4ed884fcbbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:37.162009 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6319d5-6c3f-4233-9fa9-4ed884fcbbac admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:37.162496 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6319d5-6c3f-4233-9fa9-4ed884fcbbac admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:37.163253 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6319d5-6c3f-4233-9fa9-4ed884fcbbac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:37.179144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6319d5-6c3f-4233-9fa9-4ed884fcbbac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:37.287804 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3d6319d5-6c3f-4233-9fa9-4ed884fcbbac admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 13 14:48:37.288490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6319d5-6c3f-4233-9fa9-4ed884fcbbac admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:37.307056 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 3/4] 10.222.0.73 () {58 vars in 1324 bytes} [Fri May 13 14:48:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 13 14:48:37.317747 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81563f2c-dee0-405d-81f9-2d89186c5940 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:37.344846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81563f2c-dee0-405d-81f9-2d89186c5940 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:37.352699 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2772c-38fb-4070-b9bd-414785e9bc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:37.354901 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2772c-38fb-4070-b9bd-414785e9bc2f admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:37.355440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2772c-38fb-4070-b9bd-414785e9bc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:37.355959 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2772c-38fb-4070-b9bd-414785e9bc2f admin admin] PATH_INFO: `/v3/projects/3f1a37e489724b9ca1990a3febe2d22a` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:37.359619 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2772c-38fb-4070-b9bd-414785e9bc2f admin admin] RBAC: Authorizing `identity:get_project(project_id=3f1a37e489724b9ca1990a3febe2d22a)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:37.469437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0fc2772c-38fb-4070-b9bd-414785e9bc2f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 13 14:48:37.469960 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2772c-38fb-4070-b9bd-414785e9bc2f admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:37.479455 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 2/5] 10.222.0.73 () {56 vars in 1207 bytes} [Fri May 13 14:48:37 2022] GET /identity/v3/projects/3f1a37e489724b9ca1990a3febe2d22a => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:48:40.206859 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bbc59-6023-4884-8afa-b8042f3b8f75 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:40.207420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bbc59-6023-4884-8afa-b8042f3b8f75 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:40.207761 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bbc59-6023-4884-8afa-b8042f3b8f75 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:40.216640 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 4/6] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:48:40 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:48:40.225282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b1957-092b-4140-a877-0fe307c7883e None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:40.226065 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b1957-092b-4140-a877-0fe307c7883e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:40.226349 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b1957-092b-4140-a877-0fe307c7883e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:40.247847 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-5e0b1957-092b-4140-a877-0fe307c7883e None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:48:40.249570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-5e0b1957-092b-4140-a877-0fe307c7883e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:48:40.258396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 3/7] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:48:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 13 14:48:40.282509 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bbc59-6023-4884-8afa-b8042f3b8f75 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:40.296960 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bbc59-6023-4884-8afa-b8042f3b8f75 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:40.302121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df464d8d-93e5-421e-83ea-bf0b44b2886b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:40.302998 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df464d8d-93e5-421e-83ea-bf0b44b2886b admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:40.303384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df464d8d-93e5-421e-83ea-bf0b44b2886b admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:40.303773 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df464d8d-93e5-421e-83ea-bf0b44b2886b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:40.313943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df464d8d-93e5-421e-83ea-bf0b44b2886b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:40.316075 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df464d8d-93e5-421e-83ea-bf0b44b2886b admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:40.327239 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 5/8] 10.222.0.73 () {58 vars in 1324 bytes} [Fri May 13 14:48:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 13 14:48:40.333649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b1957-092b-4140-a877-0fe307c7883e None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:40.343702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b1957-092b-4140-a877-0fe307c7883e None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:40.348868 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2e12d-3138-4c18-8cd3-ae44be3514cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:40.349816 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2e12d-3138-4c18-8cd3-ae44be3514cd admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:40.350182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2e12d-3138-4c18-8cd3-ae44be3514cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:40.350566 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2e12d-3138-4c18-8cd3-ae44be3514cd admin admin] PATH_INFO: `/v3/users/f5d162836f3c43f6919175fd34ffcf36` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:40.352390 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2e12d-3138-4c18-8cd3-ae44be3514cd admin admin] RBAC: Authorizing `identity:get_user(user_id=f5d162836f3c43f6919175fd34ffcf36)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:40.354393 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2e12d-3138-4c18-8cd3-ae44be3514cd admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:40.356266 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 4/9] 10.222.0.73 () {56 vars in 1198 bytes} [Fri May 13 14:48:40 2022] GET /identity/v3/users/f5d162836f3c43f6919175fd34ffcf36 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:48:42.848562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c309df9-503e-4e59-9a05-adb8f63c9a6e None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:42.849113 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c309df9-503e-4e59-9a05-adb8f63c9a6e None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:42.849540 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c309df9-503e-4e59-9a05-adb8f63c9a6e None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:42.852196 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 6/10] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:48:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:48:42.858634 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9827ca-46cd-4f02-835c-db19d829a946 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:42.859499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9827ca-46cd-4f02-835c-db19d829a946 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:42.859499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9827ca-46cd-4f02-835c-db19d829a946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:42.878339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-2d9827ca-46cd-4f02-835c-db19d829a946 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:48:42.879746 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-2d9827ca-46cd-4f02-835c-db19d829a946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:48:43.006576 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 5/11] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:48:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:48:43.030142 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c309df9-503e-4e59-9a05-adb8f63c9a6e None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:43.136883 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0c94c-b0f4-4d90-9ab8-15531b950413 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:43.137089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0c94c-b0f4-4d90-9ab8-15531b950413 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:43.137353 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0c94c-b0f4-4d90-9ab8-15531b950413 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:43.138769 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 6/12] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:48:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:48:43.144776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e20fe-426a-4ba2-b4fe-74af5cfa783a None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:43.145069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e20fe-426a-4ba2-b4fe-74af5cfa783a None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:43.145351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e20fe-426a-4ba2-b4fe-74af5cfa783a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:43.164377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-621e20fe-426a-4ba2-b4fe-74af5cfa783a None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:48:43.165630 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-621e20fe-426a-4ba2-b4fe-74af5cfa783a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:48:43.240689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 7/13] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:48:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:48:43.265558 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e20fe-426a-4ba2-b4fe-74af5cfa783a None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:43.281372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c309df9-503e-4e59-9a05-adb8f63c9a6e None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:43.333115 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd74a4-a36a-4f28-8f46-626104e55a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:43.334087 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd74a4-a36a-4f28-8f46-626104e55a43 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:43.334512 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd74a4-a36a-4f28-8f46-626104e55a43 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:43.334969 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd74a4-a36a-4f28-8f46-626104e55a43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:43.377793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e20fe-426a-4ba2-b4fe-74af5cfa783a None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:43.414669 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9293f91-d230-4b28-9ec7-3f77a0be0171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:43.415427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9293f91-d230-4b28-9ec7-3f77a0be0171 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:43.415723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9293f91-d230-4b28-9ec7-3f77a0be0171 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:43.415991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9293f91-d230-4b28-9ec7-3f77a0be0171 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:43.429215 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9293f91-d230-4b28-9ec7-3f77a0be0171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:48:43.437949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd74a4-a36a-4f28-8f46-626104e55a43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:43.439636 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd74a4-a36a-4f28-8f46-626104e55a43 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:43.446058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-d9293f91-d230-4b28-9ec7-3f77a0be0171 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:48:43.446058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:48:43.446058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:48:43.446058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:48:43.446058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:48:43.446058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:48:43.446058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:48:43.446058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:48:43.446058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:48:43.446058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:48:43.446058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:48:43.446058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:48:43.446058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:48:43.446058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:48:43.446058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:48:43.446058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:48:43.447271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:48:43.447271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:48:43.447271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:48:43.447271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:48:43.447271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:48:43.447271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:48:43.447271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:48:43.447271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:48:43.447271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:48:43.447271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:48:43.447271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:48:43.447271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:48:43.447271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:48:43.447271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:48:43.447271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:48:43.447271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:48:43.448978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:48:43.448978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:48:43.448978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:48:43.448978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:48:43.448978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:48:43.448978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:48:43.448978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:48:43.448978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:48:43.448978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:48:43.448978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:48:43.448978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:48:43.448978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:48:43.448978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 8/14] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:48:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:48:43.454346 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9293f91-d230-4b28-9ec7-3f77a0be0171 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:43.561251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 7/15] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:48:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:48:43.567499 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd74a4-a36a-4f28-8f46-626104e55a43 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:43.601483 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9293f91-d230-4b28-9ec7-3f77a0be0171 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:43.636831 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f645448-a54a-439c-950a-68eec2c43f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:43.637515 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f645448-a54a-439c-950a-68eec2c43f07 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:43.637789 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f645448-a54a-439c-950a-68eec2c43f07 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:43.638116 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f645448-a54a-439c-950a-68eec2c43f07 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:43.639015 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f645448-a54a-439c-950a-68eec2c43f07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:48:43.639333 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f645448-a54a-439c-950a-68eec2c43f07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:43.640779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f645448-a54a-439c-950a-68eec2c43f07 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:43.653728 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 9/16] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:48:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:48:43.659727 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f645448-a54a-439c-950a-68eec2c43f07 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:43.733946 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd74a4-a36a-4f28-8f46-626104e55a43 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:43.770183 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f860c9-8ca2-45b0-b320-5793dc5e6596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:43.771021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f860c9-8ca2-45b0-b320-5793dc5e6596 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:43.771299 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f860c9-8ca2-45b0-b320-5793dc5e6596 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:43.771571 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f860c9-8ca2-45b0-b320-5793dc5e6596 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:43.792120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f860c9-8ca2-45b0-b320-5793dc5e6596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:43.793606 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f860c9-8ca2-45b0-b320-5793dc5e6596 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:43.805563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f645448-a54a-439c-950a-68eec2c43f07 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:43.814785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-c4f860c9-8ca2-45b0-b320-5793dc5e6596 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:48:43.814785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:48:43.814785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:48:43.814785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:48:43.814785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:48:43.814785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:48:43.814785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:48:43.814785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:48:43.814785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:48:43.814785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:48:43.814785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:48:43.814785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:48:43.814785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:48:43.814785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:48:43.814785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:48:43.815779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:48:43.815779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:48:43.815779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:48:43.815779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:48:43.815779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:48:43.815779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:48:43.815779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:48:43.815779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:48:43.815779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:48:43.815779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:48:43.815779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:48:43.815779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:48:43.815779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:48:43.815779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:48:43.815779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:48:43.815779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:48:43.815779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:48:43.816869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:48:43.816869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:48:43.816869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:48:43.816869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:48:43.816869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 8/17] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:48:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:48:43.823280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f860c9-8ca2-45b0-b320-5793dc5e6596 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:43.866066 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf112c48-ce9f-446e-8fc7-c87f08b2d463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:43.867576 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf112c48-ce9f-446e-8fc7-c87f08b2d463 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:43.868092 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf112c48-ce9f-446e-8fc7-c87f08b2d463 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:43.868594 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf112c48-ce9f-446e-8fc7-c87f08b2d463 None admin] PATH_INFO: `/v3/users/f5d162836f3c43f6919175fd34ffcf36` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:43.870974 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf112c48-ce9f-446e-8fc7-c87f08b2d463 None admin] RBAC: Authorizing `identity:get_user(user_id=f5d162836f3c43f6919175fd34ffcf36)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:43.873723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf112c48-ce9f-446e-8fc7-c87f08b2d463 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:43.877140 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 10/18] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:48:43 2022] GET /identity/v3/users/f5d162836f3c43f6919175fd34ffcf36 => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:48:43.886549 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf112c48-ce9f-446e-8fc7-c87f08b2d463 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:43.952386 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f860c9-8ca2-45b0-b320-5793dc5e6596 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:44.042497 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf112c48-ce9f-446e-8fc7-c87f08b2d463 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:44.099488 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59c7fd-f422-4001-a549-10f8d98dcbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:44.100685 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59c7fd-f422-4001-a549-10f8d98dcbc2 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:44.101110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59c7fd-f422-4001-a549-10f8d98dcbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:44.101522 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59c7fd-f422-4001-a549-10f8d98dcbc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:44.103448 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59c7fd-f422-4001-a549-10f8d98dcbc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:44.105946 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59c7fd-f422-4001-a549-10f8d98dcbc2 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:44.108721 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 11/19] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:48:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:48:44.115569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59c7fd-f422-4001-a549-10f8d98dcbc2 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:44.147990 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e071fd7-55a3-473f-a9a7-1116c1b52928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:44.148688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e071fd7-55a3-473f-a9a7-1116c1b52928 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:44.148962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e071fd7-55a3-473f-a9a7-1116c1b52928 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:44.149236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e071fd7-55a3-473f-a9a7-1116c1b52928 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:44.149967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e071fd7-55a3-473f-a9a7-1116c1b52928 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:48:44.150270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e071fd7-55a3-473f-a9a7-1116c1b52928 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:44.151811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e071fd7-55a3-473f-a9a7-1116c1b52928 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:44.170281 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 9/20] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:48:44.254303 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59c7fd-f422-4001-a549-10f8d98dcbc2 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:44.296705 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea4ab0-30b6-4a70-bfb3-a6f12538e870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:44.297429 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea4ab0-30b6-4a70-bfb3-a6f12538e870 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:44.297804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea4ab0-30b6-4a70-bfb3-a6f12538e870 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:44.298191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea4ab0-30b6-4a70-bfb3-a6f12538e870 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:44.299293 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea4ab0-30b6-4a70-bfb3-a6f12538e870 None admin] RBAC: Adding query filter params (role.id=b6fbf976763d4795afbfb53a09ec6f6c, scope.domain.id=default, user.id=f5d162836f3c43f6919175fd34ffcf36) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:48:44.299704 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea4ab0-30b6-4a70-bfb3-a6f12538e870 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:44.301364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea4ab0-30b6-4a70-bfb3-a6f12538e870 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:44.310473 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 12/21] 10.222.0.73 () {56 vars in 1322 bytes} [Fri May 13 14:48:44 2022] GET /identity/v3/role_assignments?user.id=f5d162836f3c43f6919175fd34ffcf36&scope.domain.id=default&role.id=b6fbf976763d4795afbfb53a09ec6f6c => generated 233 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:48:47.397180 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073273d-22ce-46d7-8639-8c0fe2b1a946 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:47.397940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073273d-22ce-46d7-8639-8c0fe2b1a946 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:47.398172 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073273d-22ce-46d7-8639-8c0fe2b1a946 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:47.401730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 10/22] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:48:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:48:47.412590 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794e29b-f4b8-4605-b9a5-0a7d3910688a None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:47.414079 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794e29b-f4b8-4605-b9a5-0a7d3910688a None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:47.414914 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794e29b-f4b8-4605-b9a5-0a7d3910688a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:47.460965 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-4794e29b-f4b8-4605-b9a5-0a7d3910688a None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:48:47.463508 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-4794e29b-f4b8-4605-b9a5-0a7d3910688a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:48:47.609945 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 13/23] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:48:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:48:47.655340 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073273d-22ce-46d7-8639-8c0fe2b1a946 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:47.798684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073273d-22ce-46d7-8639-8c0fe2b1a946 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:47.849508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc844e2-940d-44fe-b0b9-12b4f4c01937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:47.850638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc844e2-940d-44fe-b0b9-12b4f4c01937 None admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:47.851160 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc844e2-940d-44fe-b0b9-12b4f4c01937 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:47.851640 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc844e2-940d-44fe-b0b9-12b4f4c01937 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:47.852638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc844e2-940d-44fe-b0b9-12b4f4c01937 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:47.854953 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc844e2-940d-44fe-b0b9-12b4f4c01937 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:48.028871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce81841-2285-42f1-9154-92962cc60ce7 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:48.029950 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce81841-2285-42f1-9154-92962cc60ce7 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:48.030768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce81841-2285-42f1-9154-92962cc60ce7 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:48.033110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 14/24] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:48:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:48:48.059266 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a085144-5775-4d24-96fd-ac0114816ac6 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:48.059898 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a085144-5775-4d24-96fd-ac0114816ac6 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:48.060394 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a085144-5775-4d24-96fd-ac0114816ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:48.072383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 11/25] 10.222.0.73 () {60 vars in 1131 bytes} [Fri May 13 14:48:47 2022] POST /identity/v3/roles => generated 225 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:48:48.096206 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-7a085144-5775-4d24-96fd-ac0114816ac6 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:48:48.097851 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-7a085144-5775-4d24-96fd-ac0114816ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:48:48.223359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 15/26] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:48:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:48:48.233275 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e77dc0-453c-4bfc-8e63-3f7f550ef291 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:48.233959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e77dc0-453c-4bfc-8e63-3f7f550ef291 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:48.234444 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e77dc0-453c-4bfc-8e63-3f7f550ef291 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:48.236568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 12/27] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:48:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:48:48.242923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5101a60-d640-4024-a628-8c5d100c5e0a None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:48.243245 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5101a60-d640-4024-a628-8c5d100c5e0a None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:48.243486 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5101a60-d640-4024-a628-8c5d100c5e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:48.300302 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e77dc0-453c-4bfc-8e63-3f7f550ef291 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:48.433383 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-a5101a60-d640-4024-a628-8c5d100c5e0a None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:48:48.434627 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-a5101a60-d640-4024-a628-8c5d100c5e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:48:48.534052 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e77dc0-453c-4bfc-8e63-3f7f550ef291 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:48.555603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 16/28] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:48:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:48:48.557985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b9e5a-c6ce-4cb4-a349-586477b3da98 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:48.558511 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b9e5a-c6ce-4cb4-a349-586477b3da98 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:48.559090 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b9e5a-c6ce-4cb4-a349-586477b3da98 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:48.561125 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 17/29] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:48:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:48:48.570850 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e33326-df65-4a2e-87d8-1f980f39eff1 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:48.571473 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e33326-df65-4a2e-87d8-1f980f39eff1 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:48.571950 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e33326-df65-4a2e-87d8-1f980f39eff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:48.593952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-61e33326-df65-4a2e-87d8-1f980f39eff1 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:48:48.595767 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-61e33326-df65-4a2e-87d8-1f980f39eff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:48:48.604865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369c0f4-03cd-4c0b-8ab1-002634c70514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:48.606304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369c0f4-03cd-4c0b-8ab1-002634c70514 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:48.606442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369c0f4-03cd-4c0b-8ab1-002634c70514 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:48.606711 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369c0f4-03cd-4c0b-8ab1-002634c70514 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:48.643469 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369c0f4-03cd-4c0b-8ab1-002634c70514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:48:48.652612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-5369c0f4-03cd-4c0b-8ab1-002634c70514 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:48:48.652612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:48:48.652612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:48:48.652612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:48:48.652612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:48:48.652612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:48:48.652612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:48:48.652612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:48:48.652612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:48:48.652612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:48:48.652612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:48:48.652612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:48:48.652612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:48:48.652612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:48:48.652612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:48:48.652612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:48:48.654313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:48:48.654313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:48:48.654313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:48:48.654313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:48:48.654313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:48:48.654313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:48:48.654313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:48:48.654313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:48:48.654313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:48:48.654313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:48:48.654313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:48:48.654313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:48:48.654313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:48:48.654313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:48:48.654313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:48:48.654313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:48:48.655846 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:48:48.655846 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:48:48.655846 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:48:48.655846 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:48:48.655846 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:48:48.655846 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:48:48.655846 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:48:48.655846 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:48:48.655846 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:48:48.655846 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:48:48.655846 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:48:48.655846 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:48:48.658483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 13/30] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:48:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:48:48.659625 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369c0f4-03cd-4c0b-8ab1-002634c70514 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:48.699890 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 18/31] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:48:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:48:48.700880 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e33326-df65-4a2e-87d8-1f980f39eff1 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:48.813383 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e33326-df65-4a2e-87d8-1f980f39eff1 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:48.832509 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369c0f4-03cd-4c0b-8ab1-002634c70514 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:48.853054 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c652940-76c5-4b2c-9b8a-020a0a68ddb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:48.853682 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c652940-76c5-4b2c-9b8a-020a0a68ddb3 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:48.853974 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c652940-76c5-4b2c-9b8a-020a0a68ddb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:48.854252 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c652940-76c5-4b2c-9b8a-020a0a68ddb3 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:48.855078 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c652940-76c5-4b2c-9b8a-020a0a68ddb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:48:48.855390 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c652940-76c5-4b2c-9b8a-020a0a68ddb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:48.856835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c652940-76c5-4b2c-9b8a-020a0a68ddb3 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:48.866631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 19/32] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:48:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:48:48.867986 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c652940-76c5-4b2c-9b8a-020a0a68ddb3 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:48.909472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f73525-d7e6-460e-aa17-a3369e11cc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:48.911436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f73525-d7e6-460e-aa17-a3369e11cc71 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:48.912249 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f73525-d7e6-460e-aa17-a3369e11cc71 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:48.913042 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f73525-d7e6-460e-aa17-a3369e11cc71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:48.938250 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f73525-d7e6-460e-aa17-a3369e11cc71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:48.941549 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f73525-d7e6-460e-aa17-a3369e11cc71 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:48.969900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-e5f73525-d7e6-460e-aa17-a3369e11cc71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:48:48.969900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:48:48.969900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:48:48.969900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:48:48.969900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:48:48.969900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:48:48.969900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:48:48.969900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:48:48.969900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:48:48.969900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:48:48.969900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:48:48.969900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:48:48.969900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:48:48.969900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:48:48.969900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:48:48.971570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:48:48.971570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:48:48.971570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:48:48.971570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:48:48.971570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:48:48.971570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:48:48.971570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:48:48.971570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:48:48.971570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:48:48.971570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:48:48.971570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:48:48.971570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:48:48.971570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:48:48.971570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:48:48.971570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:48:48.971570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:48:48.971570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:48:48.973182 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:48:48.973182 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:48:48.973182 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:48:48.973182 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:48:48.977091 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 14/33] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:48:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:48:48.979082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f73525-d7e6-460e-aa17-a3369e11cc71 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:48.984341 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c652940-76c5-4b2c-9b8a-020a0a68ddb3 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:49.022860 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6061c-c874-46ec-9510-905862fdb4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:49.023403 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6061c-c874-46ec-9510-905862fdb4da None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:49.023692 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6061c-c874-46ec-9510-905862fdb4da None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:49.024025 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6061c-c874-46ec-9510-905862fdb4da None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:49.024797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6061c-c874-46ec-9510-905862fdb4da None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:49.026901 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6061c-c874-46ec-9510-905862fdb4da None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:49.139334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f73525-d7e6-460e-aa17-a3369e11cc71 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:49.176041 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22ed6c-bdf7-404b-8e1c-54d01bea5e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:49.176955 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22ed6c-bdf7-404b-8e1c-54d01bea5e86 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:49.177238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22ed6c-bdf7-404b-8e1c-54d01bea5e86 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:49.177515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22ed6c-bdf7-404b-8e1c-54d01bea5e86 None admin] PATH_INFO: `/v3/users/f5d162836f3c43f6919175fd34ffcf36` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:49.179439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22ed6c-bdf7-404b-8e1c-54d01bea5e86 None admin] RBAC: Authorizing `identity:get_user(user_id=f5d162836f3c43f6919175fd34ffcf36)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:49.180954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22ed6c-bdf7-404b-8e1c-54d01bea5e86 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:49.187996 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 15/34] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:48:48 2022] GET /identity/v3/users/f5d162836f3c43f6919175fd34ffcf36 => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:48:49.187996 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22ed6c-bdf7-404b-8e1c-54d01bea5e86 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:49.233812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 20/35] 10.222.0.73 () {60 vars in 1131 bytes} [Fri May 13 14:48:48 2022] POST /identity/v3/roles => generated 219 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:48:49.236606 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b9d9d-42bc-471d-951f-15001f629fbb None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:49.237105 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b9d9d-42bc-471d-951f-15001f629fbb None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:49.237602 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b9d9d-42bc-471d-951f-15001f629fbb None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:49.240428 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 21/36] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:48:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:48:49.241985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b9d9d-42bc-471d-951f-15001f629fbb None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:49.318853 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22ed6c-bdf7-404b-8e1c-54d01bea5e86 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:49.371603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cceddf-77e3-4439-b29d-897c44b459a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:49.372690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cceddf-77e3-4439-b29d-897c44b459a1 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:49.373190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cceddf-77e3-4439-b29d-897c44b459a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:49.373671 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cceddf-77e3-4439-b29d-897c44b459a1 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:49.374691 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cceddf-77e3-4439-b29d-897c44b459a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:48:49.375709 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cceddf-77e3-4439-b29d-897c44b459a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:49.378128 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cceddf-77e3-4439-b29d-897c44b459a1 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:49.408643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 16/37] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:48:49.415210 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c27d5d-c975-4f94-8166-afe47e01a2a2 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:49.415837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c27d5d-c975-4f94-8166-afe47e01a2a2 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:49.416912 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c27d5d-c975-4f94-8166-afe47e01a2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:49.432629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG passlib.handlers.bcrypt [None req-91c27d5d-c975-4f94-8166-afe47e01a2a2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79915) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 13 14:48:49.433400 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG passlib.handlers.bcrypt [None req-91c27d5d-c975-4f94-8166-afe47e01a2a2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79915) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 13 14:48:49.453696 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b9d9d-42bc-471d-951f-15001f629fbb None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:49.483016 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-91c27d5d-c975-4f94-8166-afe47e01a2a2 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:48:49.485056 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-91c27d5d-c975-4f94-8166-afe47e01a2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:48:49.523687 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9ff9a-3e7b-47d9-aa7d-4a1a854b77c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:49.525047 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9ff9a-3e7b-47d9-aa7d-4a1a854b77c7 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:49.525610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9ff9a-3e7b-47d9-aa7d-4a1a854b77c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:49.526624 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9ff9a-3e7b-47d9-aa7d-4a1a854b77c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:49.529458 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9ff9a-3e7b-47d9-aa7d-4a1a854b77c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:49.532708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9ff9a-3e7b-47d9-aa7d-4a1a854b77c7 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:49.541123 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 22/38] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:48:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:48:49.541123 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9ff9a-3e7b-47d9-aa7d-4a1a854b77c7 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:49.606210 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 17/39] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:48:49.607021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c27d5d-c975-4f94-8166-afe47e01a2a2 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:49.688200 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9ff9a-3e7b-47d9-aa7d-4a1a854b77c7 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:49.734435 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c27d5d-c975-4f94-8166-afe47e01a2a2 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:49.745515 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8055a7-da8a-4eaf-9811-a2f3129fafc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:49.746196 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8055a7-da8a-4eaf-9811-a2f3129fafc1 None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:49.746484 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8055a7-da8a-4eaf-9811-a2f3129fafc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:49.746762 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8055a7-da8a-4eaf-9811-a2f3129fafc1 None admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:49.747519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8055a7-da8a-4eaf-9811-a2f3129fafc1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:49.749001 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8055a7-da8a-4eaf-9811-a2f3129fafc1 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:49.780792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 23/40] 10.222.0.73 () {60 vars in 1141 bytes} [Fri May 13 14:48:49 2022] POST /identity/v3/projects => generated 301 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:48:49.781984 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8055a7-da8a-4eaf-9811-a2f3129fafc1 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:49.782383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c602f4-91e3-4dcc-b0a5-547266a34b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:49.783684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c602f4-91e3-4dcc-b0a5-547266a34b84 None admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:49.784024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c602f4-91e3-4dcc-b0a5-547266a34b84 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:49.784316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c602f4-91e3-4dcc-b0a5-547266a34b84 None admin] PATH_INFO: `/v3/domains/default/users/f5d162836f3c43f6919175fd34ffcf36/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:49.787240 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c602f4-91e3-4dcc-b0a5-547266a34b84 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f5d162836f3c43f6919175fd34ffcf36, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:49.788905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c602f4-91e3-4dcc-b0a5-547266a34b84 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:49.814699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 18/41] 10.222.0.73 () {58 vars in 1361 bytes} [Fri May 13 14:48:49 2022] PUT /identity/v3/domains/default/users/f5d162836f3c43f6919175fd34ffcf36/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:48:49.817194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65847f-09a5-49da-9961-e09af97d01a1 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:49.817710 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65847f-09a5-49da-9961-e09af97d01a1 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:49.818475 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65847f-09a5-49da-9961-e09af97d01a1 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:49.821548 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 19/42] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:48:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:48:49.832151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7b21b-552f-4ede-99c2-9d44794ec699 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:49.832657 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7b21b-552f-4ede-99c2-9d44794ec699 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:49.833152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7b21b-552f-4ede-99c2-9d44794ec699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:49.866359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-3fd7b21b-552f-4ede-99c2-9d44794ec699 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:48:49.868863 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-3fd7b21b-552f-4ede-99c2-9d44794ec699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:48:49.978842 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8055a7-da8a-4eaf-9811-a2f3129fafc1 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:50.014061 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 20/43] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:48:50.043400 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7b21b-552f-4ede-99c2-9d44794ec699 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:50.071267 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ae6cc-6a6d-4a50-8a7b-ef45cbe16e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:50.073031 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ae6cc-6a6d-4a50-8a7b-ef45cbe16e4b None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:50.073552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ae6cc-6a6d-4a50-8a7b-ef45cbe16e4b None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:50.074056 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ae6cc-6a6d-4a50-8a7b-ef45cbe16e4b None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:50.075639 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ae6cc-6a6d-4a50-8a7b-ef45cbe16e4b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:50.078411 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ae6cc-6a6d-4a50-8a7b-ef45cbe16e4b None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:50.109640 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 24/44] 10.222.0.73 () {60 vars in 1131 bytes} [Fri May 13 14:48:49 2022] POST /identity/v3/roles => generated 223 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:48:50.201725 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7b21b-552f-4ede-99c2-9d44794ec699 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:50.243499 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d9689-71de-4450-9a8f-e15bab5e2e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:50.244782 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d9689-71de-4450-9a8f-e15bab5e2e7e None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:50.245077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d9689-71de-4450-9a8f-e15bab5e2e7e None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:50.245358 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d9689-71de-4450-9a8f-e15bab5e2e7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:50.246769 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d9689-71de-4450-9a8f-e15bab5e2e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:50.248622 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d9689-71de-4450-9a8f-e15bab5e2e7e None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:50.250363 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 21/45] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:48:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:48:50.259544 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ae6cc-6a6d-4a50-8a7b-ef45cbe16e4b None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:50.385570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ae6cc-6a6d-4a50-8a7b-ef45cbe16e4b None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:50.427209 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06029450-8413-4a19-88ec-142bfdb075c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:50.427879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06029450-8413-4a19-88ec-142bfdb075c3 None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:50.428174 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06029450-8413-4a19-88ec-142bfdb075c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:50.428454 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06029450-8413-4a19-88ec-142bfdb075c3 None admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:50.429200 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06029450-8413-4a19-88ec-142bfdb075c3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:50.430795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06029450-8413-4a19-88ec-142bfdb075c3 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:50.466796 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 25/46] 10.222.0.73 () {60 vars in 1141 bytes} [Fri May 13 14:48:50 2022] POST /identity/v3/projects => generated 312 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:48:52.820903 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a63161-1c76-4eb3-8b72-1ee48220bc66 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:52.821865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a63161-1c76-4eb3-8b72-1ee48220bc66 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:52.821865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a63161-1c76-4eb3-8b72-1ee48220bc66 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:52.824385 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 22/47] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:48:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:48:52.831374 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c77764-5b6b-4308-94e0-f5e244fca190 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:52.831941 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c77764-5b6b-4308-94e0-f5e244fca190 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:52.832362 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c77764-5b6b-4308-94e0-f5e244fca190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:52.862854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-e0c77764-5b6b-4308-94e0-f5e244fca190 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:48:52.865605 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-e0c77764-5b6b-4308-94e0-f5e244fca190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:48:52.969187 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 26/48] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:48:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:48:52.993739 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a63161-1c76-4eb3-8b72-1ee48220bc66 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:53.141689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bce98-040c-4810-b933-d3da8bee7dee None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:53.142116 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bce98-040c-4810-b933-d3da8bee7dee None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:53.142542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bce98-040c-4810-b933-d3da8bee7dee None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:53.144212 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 27/49] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:48:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:48:53.150184 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057fd71-3c0e-4d87-b21f-efb1ff025b9d None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:53.150486 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057fd71-3c0e-4d87-b21f-efb1ff025b9d None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:53.150749 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057fd71-3c0e-4d87-b21f-efb1ff025b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:53.169445 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-a057fd71-3c0e-4d87-b21f-efb1ff025b9d None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:48:53.170899 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-a057fd71-3c0e-4d87-b21f-efb1ff025b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:48:53.171080 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a63161-1c76-4eb3-8b72-1ee48220bc66 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:53.211260 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640b2d6-094d-4888-af19-4fd56e2580bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:53.212202 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640b2d6-094d-4888-af19-4fd56e2580bb None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:53.212584 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640b2d6-094d-4888-af19-4fd56e2580bb None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:53.213065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640b2d6-094d-4888-af19-4fd56e2580bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:53.215023 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640b2d6-094d-4888-af19-4fd56e2580bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:53.217547 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640b2d6-094d-4888-af19-4fd56e2580bb None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:53.221582 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 23/50] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:48:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:48:53.226438 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640b2d6-094d-4888-af19-4fd56e2580bb None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:53.261333 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 28/51] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:48:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:48:53.285881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057fd71-3c0e-4d87-b21f-efb1ff025b9d None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:53.377885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640b2d6-094d-4888-af19-4fd56e2580bb None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:53.432101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74473510-3182-434d-825e-84dc252d49e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:53.432760 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74473510-3182-434d-825e-84dc252d49e3 None admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:53.433124 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74473510-3182-434d-825e-84dc252d49e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:53.433469 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74473510-3182-434d-825e-84dc252d49e3 None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:53.434407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74473510-3182-434d-825e-84dc252d49e3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:53.436079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74473510-3182-434d-825e-84dc252d49e3 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:53.447142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057fd71-3c0e-4d87-b21f-efb1ff025b9d None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:53.478414 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 24/52] 10.222.0.73 () {60 vars in 1140 bytes} [Fri May 13 14:48:53 2022] POST /identity/v3/projects => generated 298 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:48:53.492631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8af9a-4cc0-4777-8702-65afc21ff4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:53.493662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8af9a-4cc0-4777-8702-65afc21ff4f5 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:53.494090 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8af9a-4cc0-4777-8702-65afc21ff4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:53.494502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8af9a-4cc0-4777-8702-65afc21ff4f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:53.509588 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8af9a-4cc0-4777-8702-65afc21ff4f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:48:53.518113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-e5a8af9a-4cc0-4777-8702-65afc21ff4f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:48:53.518113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:48:53.518113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:48:53.518113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:48:53.518113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:48:53.518113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:48:53.518113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:48:53.518113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:48:53.518113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:48:53.518113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:48:53.518113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:48:53.518113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:48:53.518113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:48:53.518113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:48:53.518113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:48:53.518113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:48:53.519907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:48:53.519907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:48:53.519907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:48:53.519907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:48:53.519907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:48:53.519907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:48:53.519907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:48:53.519907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:48:53.519907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:48:53.519907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:48:53.519907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:48:53.519907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:48:53.519907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:48:53.519907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:48:53.519907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:48:53.519907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:48:53.521534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:48:53.521534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:48:53.521534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:48:53.521534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:48:53.521534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:48:53.521534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:48:53.521534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:48:53.521534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:48:53.521534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:48:53.521534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:48:53.521534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:48:53.521534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:48:53.523468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 29/53] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:48:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:48:53.527360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74473510-3182-434d-825e-84dc252d49e3 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:53.692286 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74473510-3182-434d-825e-84dc252d49e3 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:53.742027 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bf8c2-1038-40ab-82ff-998c2df0f132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:53.742724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bf8c2-1038-40ab-82ff-998c2df0f132 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:53.743041 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bf8c2-1038-40ab-82ff-998c2df0f132 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:53.743321 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bf8c2-1038-40ab-82ff-998c2df0f132 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:53.744653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bf8c2-1038-40ab-82ff-998c2df0f132 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:48:53.744936 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bf8c2-1038-40ab-82ff-998c2df0f132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:53.746375 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bf8c2-1038-40ab-82ff-998c2df0f132 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:53.760443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 25/54] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:48:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:48:53.766620 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8af9a-4cc0-4777-8702-65afc21ff4f5 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:53.886875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8af9a-4cc0-4777-8702-65afc21ff4f5 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:53.948352 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3f1fb-2215-4d46-8d7f-001ee655125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:53.949802 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3f1fb-2215-4d46-8d7f-001ee655125a None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:53.950301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3f1fb-2215-4d46-8d7f-001ee655125a None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:53.950800 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3f1fb-2215-4d46-8d7f-001ee655125a None admin] PATH_INFO: `/v3/users/f5d162836f3c43f6919175fd34ffcf36` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:53.953137 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3f1fb-2215-4d46-8d7f-001ee655125a None admin] RBAC: Authorizing `identity:get_user(user_id=f5d162836f3c43f6919175fd34ffcf36)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:53.955954 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3f1fb-2215-4d46-8d7f-001ee655125a None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:53.959148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 30/55] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:48:53 2022] GET /identity/v3/users/f5d162836f3c43f6919175fd34ffcf36 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:48:53.966346 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bf8c2-1038-40ab-82ff-998c2df0f132 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:54.144595 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bf8c2-1038-40ab-82ff-998c2df0f132 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:54.206536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e80cd-9fc5-4b6c-b779-b6040b2ffb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:54.207840 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e80cd-9fc5-4b6c-b779-b6040b2ffb01 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:54.208341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e80cd-9fc5-4b6c-b779-b6040b2ffb01 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:54.208830 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e80cd-9fc5-4b6c-b779-b6040b2ffb01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:54.211038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e80cd-9fc5-4b6c-b779-b6040b2ffb01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:54.213839 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e80cd-9fc5-4b6c-b779-b6040b2ffb01 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:54.217051 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 26/56] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:48:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:48:54.223844 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3f1fb-2215-4d46-8d7f-001ee655125a None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:54.407918 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3f1fb-2215-4d46-8d7f-001ee655125a None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:54.469585 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e6e6a-3b0d-4383-8735-b34f40afd1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:54.470640 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e6e6a-3b0d-4383-8735-b34f40afd1ff None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:54.471200 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e6e6a-3b0d-4383-8735-b34f40afd1ff None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:54.471712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e6e6a-3b0d-4383-8735-b34f40afd1ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:54.473409 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e6e6a-3b0d-4383-8735-b34f40afd1ff None admin] RBAC: Adding query filter params (role.id=b6fbf976763d4795afbfb53a09ec6f6c, scope.domain.id=default, user.id=f5d162836f3c43f6919175fd34ffcf36) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:48:54.473971 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e6e6a-3b0d-4383-8735-b34f40afd1ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:54.476826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e6e6a-3b0d-4383-8735-b34f40afd1ff None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:54.494863 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 31/57] 10.222.0.73 () {56 vars in 1322 bytes} [Fri May 13 14:48:54 2022] GET /identity/v3/role_assignments?user.id=f5d162836f3c43f6919175fd34ffcf36&scope.domain.id=default&role.id=b6fbf976763d4795afbfb53a09ec6f6c => generated 530 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:48:55.859486 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59064dbd-c11a-4c3b-af8a-668f14268378 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:55.860079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59064dbd-c11a-4c3b-af8a-668f14268378 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:55.860079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59064dbd-c11a-4c3b-af8a-668f14268378 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:55.861423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 27/58] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:48:55.867511 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b9911-c03e-4a7b-935a-950b45e2d2bf None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:55.868322 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b9911-c03e-4a7b-935a-950b45e2d2bf None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:55.868468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b9911-c03e-4a7b-935a-950b45e2d2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:55.886258 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-575b9911-c03e-4a7b-935a-950b45e2d2bf None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:48:55.887735 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-575b9911-c03e-4a7b-935a-950b45e2d2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:48:55.967302 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 32/59] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:48:55.992229 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59064dbd-c11a-4c3b-af8a-668f14268378 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:56.098382 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59064dbd-c11a-4c3b-af8a-668f14268378 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:56.136566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb6170-2e03-47d7-b6ac-9d4963f8b518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:56.137301 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb6170-2e03-47d7-b6ac-9d4963f8b518 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:56.137585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb6170-2e03-47d7-b6ac-9d4963f8b518 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:56.137862 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb6170-2e03-47d7-b6ac-9d4963f8b518 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:56.139246 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb6170-2e03-47d7-b6ac-9d4963f8b518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:56.140764 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb6170-2e03-47d7-b6ac-9d4963f8b518 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:56.142578 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 28/60] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:48:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:48:56.148672 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b9911-c03e-4a7b-935a-950b45e2d2bf None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:48:56.255529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b9911-c03e-4a7b-935a-950b45e2d2bf None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:48:56.292461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0f19b-088d-498c-9caa-9086503752a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:48:56.293154 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0f19b-088d-498c-9caa-9086503752a0 None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:48:56.293445 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0f19b-088d-498c-9caa-9086503752a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:48:56.293727 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0f19b-088d-498c-9caa-9086503752a0 None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:48:56.294467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0f19b-088d-498c-9caa-9086503752a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:48:56.295991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0f19b-088d-498c-9caa-9086503752a0 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:48:56.324232 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 33/61] 10.222.0.73 () {60 vars in 1132 bytes} [Fri May 13 14:48:56 2022] POST /identity/v3/users => generated 275 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:49:00.396856 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdc651-11ca-4d64-bb76-c2497886b940 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:00.397722 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdc651-11ca-4d64-bb76-c2497886b940 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:00.397722 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdc651-11ca-4d64-bb76-c2497886b940 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:00.399404 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 29/62] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:00.405919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0682df-f062-4cd8-aa8a-a368a7e42691 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:00.407391 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0682df-f062-4cd8-aa8a-a368a7e42691 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:00.408138 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0682df-f062-4cd8-aa8a-a368a7e42691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:00.446434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-fd0682df-f062-4cd8-aa8a-a368a7e42691 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:00.448855 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-fd0682df-f062-4cd8-aa8a-a368a7e42691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:00.631059 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 34/63] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:00.671288 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffdc651-11ca-4d64-bb76-c2497886b940 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:00.810336 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870b4d3-2715-4f28-91f8-f77ff94e8e02 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:00.811301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870b4d3-2715-4f28-91f8-f77ff94e8e02 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:00.812062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870b4d3-2715-4f28-91f8-f77ff94e8e02 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:00.827307 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 35/64] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:00 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:00.833045 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffdc651-11ca-4d64-bb76-c2497886b940 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:00.833263 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4230d4-b029-4a33-be22-7f4d48edbf60 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:00.833751 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4230d4-b029-4a33-be22-7f4d48edbf60 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:00.834233 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4230d4-b029-4a33-be22-7f4d48edbf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:00.901271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-8e4230d4-b029-4a33-be22-7f4d48edbf60 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:00.904923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-8e4230d4-b029-4a33-be22-7f4d48edbf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:00.906689 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9499d8-c807-46ab-9146-3f27b1031f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:00.907560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9499d8-c807-46ab-9146-3f27b1031f73 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:00.908547 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9499d8-c807-46ab-9146-3f27b1031f73 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:00.908547 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9499d8-c807-46ab-9146-3f27b1031f73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:00.933926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9499d8-c807-46ab-9146-3f27b1031f73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:00.941704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-0a9499d8-c807-46ab-9146-3f27b1031f73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:00.941704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:00.941704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:00.941704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:00.941704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:00.941704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:00.941704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:00.941704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:00.941704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:00.941704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:00.941704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:00.941704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:00.941704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:00.941704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:00.941704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:00.941704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:00.944951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:00.944951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:00.944951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:00.944951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:00.944951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:00.944951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:00.944951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:00.944951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:00.944951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:00.944951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:00.944951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:00.944951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:49:00.944951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:00.944951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:00.944951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:00.944951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:00.947742 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:00.947742 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:00.947742 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:00.947742 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:00.947742 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:00.947742 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:00.947742 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:00.947742 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:00.947742 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:00.947742 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:00.947742 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:00.947742 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:49:00.951502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 30/65] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:49:00.960533 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9499d8-c807-46ab-9146-3f27b1031f73 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:01.085258 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 36/66] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:01.088243 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0017ca-6a8b-447d-87b1-b11e1a2c41ae None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:01.089056 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0017ca-6a8b-447d-87b1-b11e1a2c41ae None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:01.089861 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0017ca-6a8b-447d-87b1-b11e1a2c41ae None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:01.093236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 37/67] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:01.109269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca4922-69fb-486d-88d6-4dcc6c2e1027 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:01.110243 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca4922-69fb-486d-88d6-4dcc6c2e1027 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:01.111078 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca4922-69fb-486d-88d6-4dcc6c2e1027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:01.130804 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9499d8-c807-46ab-9146-3f27b1031f73 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:01.149927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-ceca4922-69fb-486d-88d6-4dcc6c2e1027 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:01.152923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ceca4922-69fb-486d-88d6-4dcc6c2e1027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:01.181095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e84fce-1a08-403a-a9bd-d086b493eebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:01.182021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e84fce-1a08-403a-a9bd-d086b493eebb None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:01.182420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e84fce-1a08-403a-a9bd-d086b493eebb None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:01.183013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e84fce-1a08-403a-a9bd-d086b493eebb None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:01.184066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e84fce-1a08-403a-a9bd-d086b493eebb None admin] RBAC: Adding query filter params (name=member) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:01.184300 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e84fce-1a08-403a-a9bd-d086b493eebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:01.185755 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e84fce-1a08-403a-a9bd-d086b493eebb None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:01.197545 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 31/68] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:01.198067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e84fce-1a08-403a-a9bd-d086b493eebb None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:01.280970 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 38/69] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:01.283448 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba6bcc-6eda-48f6-bd3c-d66b58871520 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:01.283951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba6bcc-6eda-48f6-bd3c-d66b58871520 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:01.284326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba6bcc-6eda-48f6-bd3c-d66b58871520 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:01.285790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 39/70] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:01.291688 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba6bcc-6eda-48f6-bd3c-d66b58871520 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:01.391907 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e84fce-1a08-403a-a9bd-d086b493eebb None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:01.441581 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba6bcc-6eda-48f6-bd3c-d66b58871520 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:01.453064 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edc761-13ff-4a98-b09f-c3a26536e7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:01.454492 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edc761-13ff-4a98-b09f-c3a26536e7a9 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:01.455026 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edc761-13ff-4a98-b09f-c3a26536e7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:01.455503 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edc761-13ff-4a98-b09f-c3a26536e7a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:01.477266 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35edc761-13ff-4a98-b09f-c3a26536e7a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:01.484975 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efb5c7-b39e-45a8-9323-6047290cd863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:01.486057 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efb5c7-b39e-45a8-9323-6047290cd863 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:01.486472 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efb5c7-b39e-45a8-9323-6047290cd863 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:01.486949 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efb5c7-b39e-45a8-9323-6047290cd863 None admin] PATH_INFO: `/v3/users/f2a0711bb35944ca87b4e4380659c57f` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:01.493205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-35edc761-13ff-4a98-b09f-c3a26536e7a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:49:01.493205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:01.493205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:01.493205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:01.493205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:01.493205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:01.493205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:01.493205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:01.493205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:01.493205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:01.493205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:01.493205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:01.493205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:01.493205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:01.493205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:01.493205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:01.495820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:01.495820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:01.495820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:01.495820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:01.495820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:01.495820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:01.495820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:01.495820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:01.495820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:01.495820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:01.495820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:01.495820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:49:01.495820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:01.495820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:01.495820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:01.495820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:01.497337 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:01.497337 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:01.497337 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:01.497337 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:01.497337 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:01.497337 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:01.497337 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:01.497337 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:01.497337 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:01.497337 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:01.497337 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:49:01.497337 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:49:01.506893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 32/71] 10.222.0.73 () {56 vars in 1114 bytes} [Fri May 13 14:49:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:01.506893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78938985-0cc3-410c-9f87-9aacfc17eed5 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:01.506893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78938985-0cc3-410c-9f87-9aacfc17eed5 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:01.506893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78938985-0cc3-410c-9f87-9aacfc17eed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:01.509202 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efb5c7-b39e-45a8-9323-6047290cd863 None admin] RBAC: Authorizing `identity:get_user(user_id=f2a0711bb35944ca87b4e4380659c57f)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:01.512723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efb5c7-b39e-45a8-9323-6047290cd863 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:01.516225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 40/72] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:01 2022] GET /identity/v3/users/f2a0711bb35944ca87b4e4380659c57f => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:01.517502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efb5c7-b39e-45a8-9323-6047290cd863 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:01.539681 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-78938985-0cc3-410c-9f87-9aacfc17eed5 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:01.542217 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-78938985-0cc3-410c-9f87-9aacfc17eed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:01.648060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 33/73] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:01.649290 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78938985-0cc3-410c-9f87-9aacfc17eed5 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:01.671391 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efb5c7-b39e-45a8-9323-6047290cd863 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:01.716336 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee37fa-b3af-443d-8287-41d342e3de3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:01.717357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee37fa-b3af-443d-8287-41d342e3de3c None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:01.717693 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee37fa-b3af-443d-8287-41d342e3de3c None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:01.718017 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee37fa-b3af-443d-8287-41d342e3de3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:01.731029 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee37fa-b3af-443d-8287-41d342e3de3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:01.740707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-8aee37fa-b3af-443d-8287-41d342e3de3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:49:01.740707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:01.740707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:01.740707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:01.740707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:01.740707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:01.740707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:01.740707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:01.740707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:01.740707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:01.740707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:01.740707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:01.740707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:01.740707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:01.740707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:01.740707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:01.742433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:01.742433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:01.742433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:01.742433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:01.742433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:01.742433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:01.742433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:01.742433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:01.742433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:01.742433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:01.742433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:01.742433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:01.742433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:01.742433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:01.742433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:01.742433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:01.744653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:01.744653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:01.744653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:01.744653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:01.744653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:01.744653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:01.744653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:01.744653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:01.744653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:01.744653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:01.744653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:49:01.744653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:01.744653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 41/74] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:49:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:01.744653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee37fa-b3af-443d-8287-41d342e3de3c None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:01.778662 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78938985-0cc3-410c-9f87-9aacfc17eed5 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:01.814993 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3874a-97f3-4dfc-ae5c-fa11ac32e579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:01.815857 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3874a-97f3-4dfc-ae5c-fa11ac32e579 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:01.816291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3874a-97f3-4dfc-ae5c-fa11ac32e579 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:01.816684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3874a-97f3-4dfc-ae5c-fa11ac32e579 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:01.817550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3874a-97f3-4dfc-ae5c-fa11ac32e579 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:01.817915 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3874a-97f3-4dfc-ae5c-fa11ac32e579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:01.819731 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3874a-97f3-4dfc-ae5c-fa11ac32e579 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:01.830004 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 34/75] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:49:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:01.831271 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226dffbe-8421-4c6b-8bb9-6b6cf1dddb74 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:01.831558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226dffbe-8421-4c6b-8bb9-6b6cf1dddb74 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:01.831832 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226dffbe-8421-4c6b-8bb9-6b6cf1dddb74 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:01.833485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 35/76] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:01.836014 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226dffbe-8421-4c6b-8bb9-6b6cf1dddb74 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:01.910354 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee37fa-b3af-443d-8287-41d342e3de3c None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:01.961408 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7602661-6214-41aa-a55e-23ac2ae6f7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:01.963061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7602661-6214-41aa-a55e-23ac2ae6f7fb None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:01.963414 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226dffbe-8421-4c6b-8bb9-6b6cf1dddb74 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:01.963583 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7602661-6214-41aa-a55e-23ac2ae6f7fb None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:01.964094 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7602661-6214-41aa-a55e-23ac2ae6f7fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:01.999769 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0037583-8986-4635-9d20-19a5c7d7927c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:02.000496 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0037583-8986-4635-9d20-19a5c7d7927c None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:02.000786 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0037583-8986-4635-9d20-19a5c7d7927c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:02.001066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0037583-8986-4635-9d20-19a5c7d7927c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:02.012481 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0037583-8986-4635-9d20-19a5c7d7927c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:02.020502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-d0037583-8986-4635-9d20-19a5c7d7927c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:02.020502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:02.020502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:02.020502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:02.020502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:02.020502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:02.020502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:02.020502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:02.020502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:02.020502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:02.020502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:02.020502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:02.020502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:02.020502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:02.020502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:02.020502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:02.022230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:02.022230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:02.022230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:02.022230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:02.022230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:02.022230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:02.022230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:02.022230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:02.022230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:02.022230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:02.022230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:02.022230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:49:02.022230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:02.022230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:02.022230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:02.022230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:02.024814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:02.024814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:02.024814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:02.024814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:02.024814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:02.024814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:02.024814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:02.024814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:02.024814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:02.024814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:02.024814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:02.024814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:49:02.024814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 36/77] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:02.026597 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0037583-8986-4635-9d20-19a5c7d7927c None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:02.059610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7602661-6214-41aa-a55e-23ac2ae6f7fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:02.061262 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7602661-6214-41aa-a55e-23ac2ae6f7fb None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:02.170508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0037583-8986-4635-9d20-19a5c7d7927c None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:02.180989 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 42/78] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:49:02.182510 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7602661-6214-41aa-a55e-23ac2ae6f7fb None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:02.208173 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22744a53-913d-445c-9d59-dc095e05601f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:02.209004 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22744a53-913d-445c-9d59-dc095e05601f None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:02.209393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22744a53-913d-445c-9d59-dc095e05601f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:02.209765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22744a53-913d-445c-9d59-dc095e05601f None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:02.210664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22744a53-913d-445c-9d59-dc095e05601f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:02.211142 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22744a53-913d-445c-9d59-dc095e05601f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:02.213213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22744a53-913d-445c-9d59-dc095e05601f None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:02.222678 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 37/79] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:02.224613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e9e06-93f8-4480-b021-5655f9530ed6 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:02.224952 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e9e06-93f8-4480-b021-5655f9530ed6 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:02.225279 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e9e06-93f8-4480-b021-5655f9530ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:02.251585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-317e9e06-93f8-4480-b021-5655f9530ed6 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:02.253462 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-317e9e06-93f8-4480-b021-5655f9530ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:02.316909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7602661-6214-41aa-a55e-23ac2ae6f7fb None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:02.339275 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 38/80] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:02.340430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e9e06-93f8-4480-b021-5655f9530ed6 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:02.359946 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ba0b6-01ec-4887-a5f3-80eae4e7edbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:02.361027 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ba0b6-01ec-4887-a5f3-80eae4e7edbf None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:02.361423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ba0b6-01ec-4887-a5f3-80eae4e7edbf None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:02.361818 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ba0b6-01ec-4887-a5f3-80eae4e7edbf None admin] PATH_INFO: `/v3/users/f2a0711bb35944ca87b4e4380659c57f` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:02.363543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ba0b6-01ec-4887-a5f3-80eae4e7edbf None admin] RBAC: Authorizing `identity:get_user(user_id=f2a0711bb35944ca87b4e4380659c57f)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:02.366239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ba0b6-01ec-4887-a5f3-80eae4e7edbf None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:02.375240 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 43/81] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:02 2022] GET /identity/v3/users/f2a0711bb35944ca87b4e4380659c57f => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:02.375240 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ba0b6-01ec-4887-a5f3-80eae4e7edbf None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:02.497154 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ba0b6-01ec-4887-a5f3-80eae4e7edbf None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:02.509204 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e9e06-93f8-4480-b021-5655f9530ed6 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:02.549235 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c3f77-e3a0-4c12-8163-8517d9ba4c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:02.550342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c3f77-e3a0-4c12-8163-8517d9ba4c56 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:02.550721 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c3f77-e3a0-4c12-8163-8517d9ba4c56 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:02.551200 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c3f77-e3a0-4c12-8163-8517d9ba4c56 None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:02.552730 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c3f77-e3a0-4c12-8163-8517d9ba4c56 None admin] RBAC: Authorizing `identity:get_project(project_id=04114986615247c2bbac8845c3c3a8e7)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:02.555343 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c3f77-e3a0-4c12-8163-8517d9ba4c56 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:02.558501 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 44/82] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:02 2022] GET /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:02.558701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e158b-c79a-4ffc-8ed7-383e73ca5268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:02.559798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e158b-c79a-4ffc-8ed7-383e73ca5268 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:02.559953 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c3f77-e3a0-4c12-8163-8517d9ba4c56 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:02.560231 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e158b-c79a-4ffc-8ed7-383e73ca5268 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:02.560588 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e158b-c79a-4ffc-8ed7-383e73ca5268 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:02.561465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e158b-c79a-4ffc-8ed7-383e73ca5268 None admin] RBAC: Adding query filter params (name=member) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:02.561816 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e158b-c79a-4ffc-8ed7-383e73ca5268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:02.563379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e158b-c79a-4ffc-8ed7-383e73ca5268 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:02.574170 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 39/83] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:02.575363 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e158b-c79a-4ffc-8ed7-383e73ca5268 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:02.707342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c3f77-e3a0-4c12-8163-8517d9ba4c56 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:02.714918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e158b-c79a-4ffc-8ed7-383e73ca5268 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:02.763428 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed63ec5-edf4-461a-9a85-82ad558bb488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:02.764779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed63ec5-edf4-461a-9a85-82ad558bb488 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:02.765304 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed63ec5-edf4-461a-9a85-82ad558bb488 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:02.765719 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed63ec5-edf4-461a-9a85-82ad558bb488 None admin] PATH_INFO: `/v3/users/f5d162836f3c43f6919175fd34ffcf36` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:02.767886 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed63ec5-edf4-461a-9a85-82ad558bb488 None admin] RBAC: Authorizing `identity:get_user(user_id=f5d162836f3c43f6919175fd34ffcf36)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:02.769239 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1370cef-854b-4365-b05d-5e67ade46a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:02.770321 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed63ec5-edf4-461a-9a85-82ad558bb488 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:02.770526 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1370cef-854b-4365-b05d-5e67ade46a9a None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:02.771028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1370cef-854b-4365-b05d-5e67ade46a9a None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:02.771467 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1370cef-854b-4365-b05d-5e67ade46a9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:02.778234 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 45/84] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:02 2022] GET /identity/v3/users/f5d162836f3c43f6919175fd34ffcf36 => generated 247 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:02.778443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1370cef-854b-4365-b05d-5e67ade46a9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:02.778522 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed63ec5-edf4-461a-9a85-82ad558bb488 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:02.778597 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1370cef-854b-4365-b05d-5e67ade46a9a None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:02.778597 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 40/85] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:49:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:02.779157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1370cef-854b-4365-b05d-5e67ade46a9a None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:02.893515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1370cef-854b-4365-b05d-5e67ade46a9a None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:02.929988 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b92e8c-ebb2-4c4e-82f3-454b928a42ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:02.930677 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b92e8c-ebb2-4c4e-82f3-454b928a42ff None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:02.930987 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b92e8c-ebb2-4c4e-82f3-454b928a42ff None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:02.931800 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b92e8c-ebb2-4c4e-82f3-454b928a42ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:02.932680 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b92e8c-ebb2-4c4e-82f3-454b928a42ff None admin] RBAC: Adding query filter params (role.id=0268e6ac6fb649eb89da825c5ae328ab, scope.project.id=04114986615247c2bbac8845c3c3a8e7, user.id=f2a0711bb35944ca87b4e4380659c57f) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:02.932995 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b92e8c-ebb2-4c4e-82f3-454b928a42ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:02.934525 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b92e8c-ebb2-4c4e-82f3-454b928a42ff None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:02.943832 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 41/86] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:49:02 2022] GET /identity/v3/role_assignments?user.id=f2a0711bb35944ca87b4e4380659c57f&scope.project.id=04114986615247c2bbac8845c3c3a8e7&role.id=0268e6ac6fb649eb89da825c5ae328ab => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:02.944557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b92e8c-ebb2-4c4e-82f3-454b928a42ff None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:02.949250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed63ec5-edf4-461a-9a85-82ad558bb488 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:02.992002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112baf7e-88f2-47dc-aaa2-4c409114b9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:02.993112 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112baf7e-88f2-47dc-aaa2-4c409114b9ec None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:02.993618 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112baf7e-88f2-47dc-aaa2-4c409114b9ec None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:02.994599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112baf7e-88f2-47dc-aaa2-4c409114b9ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:03.074081 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112baf7e-88f2-47dc-aaa2-4c409114b9ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:03.075570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112baf7e-88f2-47dc-aaa2-4c409114b9ec None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:03.111591 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b92e8c-ebb2-4c4e-82f3-454b928a42ff None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:03.149129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eab315-8055-41fb-a4d9-8301d9bcbe84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:03.150068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eab315-8055-41fb-a4d9-8301d9bcbe84 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:03.150349 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eab315-8055-41fb-a4d9-8301d9bcbe84 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:03.150627 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eab315-8055-41fb-a4d9-8301d9bcbe84 None admin] PATH_INFO: `/v3/users/f2a0711bb35944ca87b4e4380659c57f` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:03.151981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eab315-8055-41fb-a4d9-8301d9bcbe84 None admin] RBAC: Authorizing `identity:get_user(user_id=f2a0711bb35944ca87b4e4380659c57f)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:03.153477 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eab315-8055-41fb-a4d9-8301d9bcbe84 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:03.160188 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 42/87] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:02 2022] GET /identity/v3/users/f2a0711bb35944ca87b4e4380659c57f => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:03.160188 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eab315-8055-41fb-a4d9-8301d9bcbe84 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:03.248123 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 46/88] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:49:03.249512 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112baf7e-88f2-47dc-aaa2-4c409114b9ec None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:03.285322 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eab315-8055-41fb-a4d9-8301d9bcbe84 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:03.325671 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf66eed-fa65-4122-abc7-e394e6adee64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:03.326577 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf66eed-fa65-4122-abc7-e394e6adee64 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:03.327083 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf66eed-fa65-4122-abc7-e394e6adee64 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:03.327624 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf66eed-fa65-4122-abc7-e394e6adee64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:03.421202 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112baf7e-88f2-47dc-aaa2-4c409114b9ec None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:03.427239 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf66eed-fa65-4122-abc7-e394e6adee64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:03.430132 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf66eed-fa65-4122-abc7-e394e6adee64 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:03.466327 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b886b7-a146-4b97-8cb1-a512ead094dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:03.467565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b886b7-a146-4b97-8cb1-a512ead094dc None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:03.468087 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b886b7-a146-4b97-8cb1-a512ead094dc None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:03.468590 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b886b7-a146-4b97-8cb1-a512ead094dc None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:03.469923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b886b7-a146-4b97-8cb1-a512ead094dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:03.472780 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b886b7-a146-4b97-8cb1-a512ead094dc None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:03.502441 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 47/89] 10.222.0.73 () {60 vars in 1132 bytes} [Fri May 13 14:49:03 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:49:03.504216 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b886b7-a146-4b97-8cb1-a512ead094dc None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:03.614470 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 43/90] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:49:03.616299 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf66eed-fa65-4122-abc7-e394e6adee64 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:03.627711 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b886b7-a146-4b97-8cb1-a512ead094dc None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:03.669323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c6f8c-d906-476a-b615-21d621bd9846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:03.670447 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c6f8c-d906-476a-b615-21d621bd9846 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:03.671028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c6f8c-d906-476a-b615-21d621bd9846 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:03.671555 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c6f8c-d906-476a-b615-21d621bd9846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:03.748173 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf66eed-fa65-4122-abc7-e394e6adee64 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:03.753848 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c6f8c-d906-476a-b615-21d621bd9846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:03.755797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c6f8c-d906-476a-b615-21d621bd9846 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:03.788182 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cf573-fbad-426c-9cea-d6862bfcb931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:03.789076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cf573-fbad-426c-9cea-d6862bfcb931 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:03.789363 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cf573-fbad-426c-9cea-d6862bfcb931 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:03.789709 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cf573-fbad-426c-9cea-d6862bfcb931 None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:03.791231 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cf573-fbad-426c-9cea-d6862bfcb931 None admin] RBAC: Authorizing `identity:get_project(project_id=04114986615247c2bbac8845c3c3a8e7)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:03.792611 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cf573-fbad-426c-9cea-d6862bfcb931 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:03.794479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 44/91] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:03 2022] GET /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:03.796146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cf573-fbad-426c-9cea-d6862bfcb931 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:03.890889 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 48/92] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:49:03.890889 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c6f8c-d906-476a-b615-21d621bd9846 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:03.940658 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cf573-fbad-426c-9cea-d6862bfcb931 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:03.985408 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c5ef4-2378-4caf-abb4-f464f866adcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:03.986597 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c5ef4-2378-4caf-abb4-f464f866adcd None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:03.986922 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c5ef4-2378-4caf-abb4-f464f866adcd None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:03.987207 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c5ef4-2378-4caf-abb4-f464f866adcd None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:03.988530 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c5ef4-2378-4caf-abb4-f464f866adcd None admin] RBAC: Authorizing `identity:get_project(project_id=04114986615247c2bbac8845c3c3a8e7)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:03.990020 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c5ef4-2378-4caf-abb4-f464f866adcd None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:03.992812 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 45/93] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:03 2022] GET /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:03.993103 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c5ef4-2378-4caf-abb4-f464f866adcd None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:04.072979 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c6f8c-d906-476a-b615-21d621bd9846 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:04.127122 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c5ef4-2378-4caf-abb4-f464f866adcd None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:04.139534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640459a-83a7-4077-b24b-90cd510a43e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:04.140681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640459a-83a7-4077-b24b-90cd510a43e9 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:04.141235 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640459a-83a7-4077-b24b-90cd510a43e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:04.141689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640459a-83a7-4077-b24b-90cd510a43e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:04.143374 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640459a-83a7-4077-b24b-90cd510a43e9 None admin] RBAC: Adding query filter params (role.id=0a8d21e5149c42a8b85ca3c0258538d4, scope.project.id=04114986615247c2bbac8845c3c3a8e7, user.id=f2a0711bb35944ca87b4e4380659c57f) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:04.143945 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640459a-83a7-4077-b24b-90cd510a43e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:04.146810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640459a-83a7-4077-b24b-90cd510a43e9 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:04.156869 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 49/94] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:49:03 2022] GET /identity/v3/role_assignments?user.id=f2a0711bb35944ca87b4e4380659c57f&scope.project.id=04114986615247c2bbac8845c3c3a8e7&role.id=0a8d21e5149c42a8b85ca3c0258538d4 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:04.158459 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640459a-83a7-4077-b24b-90cd510a43e9 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:04.169772 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2daae-efb4-4e0a-b688-34f1d1d38af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:04.170978 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2daae-efb4-4e0a-b688-34f1d1d38af8 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:04.171298 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2daae-efb4-4e0a-b688-34f1d1d38af8 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:04.171583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2daae-efb4-4e0a-b688-34f1d1d38af8 None admin] PATH_INFO: `/v3/projects/846d89c30b0243e0866cdb16fe599ec6` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:04.174198 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2daae-efb4-4e0a-b688-34f1d1d38af8 None admin] RBAC: Authorizing `identity:get_project(project_id=846d89c30b0243e0866cdb16fe599ec6)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:04.175815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2daae-efb4-4e0a-b688-34f1d1d38af8 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:04.177965 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 46/95] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:03 2022] GET /identity/v3/projects/846d89c30b0243e0866cdb16fe599ec6 => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:04.184623 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2daae-efb4-4e0a-b688-34f1d1d38af8 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:04.317427 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2daae-efb4-4e0a-b688-34f1d1d38af8 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:04.365770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a469671-ae1b-4c7c-90c4-6d30ed195817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:04.366867 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469671-ae1b-4c7c-90c4-6d30ed195817 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:04.367169 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469671-ae1b-4c7c-90c4-6d30ed195817 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:04.367451 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469671-ae1b-4c7c-90c4-6d30ed195817 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:04.368737 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a469671-ae1b-4c7c-90c4-6d30ed195817 None admin] RBAC: Adding query filter params (role.id=0268e6ac6fb649eb89da825c5ae328ab, scope.project.id=846d89c30b0243e0866cdb16fe599ec6, user.id=f2a0711bb35944ca87b4e4380659c57f) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:04.369238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a469671-ae1b-4c7c-90c4-6d30ed195817 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:04.371452 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a469671-ae1b-4c7c-90c4-6d30ed195817 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:04.380526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640459a-83a7-4077-b24b-90cd510a43e9 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:04.383182 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 47/96] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:49:04 2022] GET /identity/v3/role_assignments?user.id=f2a0711bb35944ca87b4e4380659c57f&scope.project.id=846d89c30b0243e0866cdb16fe599ec6&role.id=0268e6ac6fb649eb89da825c5ae328ab => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:04.452058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40a22a-bed7-4dd6-9cef-abe8d5775f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:04.453188 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40a22a-bed7-4dd6-9cef-abe8d5775f73 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:04.453764 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40a22a-bed7-4dd6-9cef-abe8d5775f73 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:04.454284 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40a22a-bed7-4dd6-9cef-abe8d5775f73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:04.456277 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40a22a-bed7-4dd6-9cef-abe8d5775f73 None admin] RBAC: Adding query filter params (role.id=b6fbf976763d4795afbfb53a09ec6f6c, scope.project.id=04114986615247c2bbac8845c3c3a8e7, user.id=f5d162836f3c43f6919175fd34ffcf36) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:04.456872 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40a22a-bed7-4dd6-9cef-abe8d5775f73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:04.459909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40a22a-bed7-4dd6-9cef-abe8d5775f73 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:04.473078 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 50/97] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:49:04 2022] GET /identity/v3/role_assignments?user.id=f5d162836f3c43f6919175fd34ffcf36&scope.project.id=04114986615247c2bbac8845c3c3a8e7&role.id=b6fbf976763d4795afbfb53a09ec6f6c => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:06.938485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13017ebe-b11a-4d2a-ab22-79cff95ad371 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:06.939554 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13017ebe-b11a-4d2a-ab22-79cff95ad371 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:06.940055 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13017ebe-b11a-4d2a-ab22-79cff95ad371 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:06.941682 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 48/98] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:49:06.948666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46287c-9079-4c7d-bd75-61de493115ed None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:06.949618 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46287c-9079-4c7d-bd75-61de493115ed None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:06.950110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46287c-9079-4c7d-bd75-61de493115ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:06.968923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-7f46287c-9079-4c7d-bd75-61de493115ed None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:06.970519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-7f46287c-9079-4c7d-bd75-61de493115ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:07.045303 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 51/99] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:49:07.138633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13017ebe-b11a-4d2a-ab22-79cff95ad371 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:07.254692 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13017ebe-b11a-4d2a-ab22-79cff95ad371 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:07.292978 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaaa6b-69bd-42b6-ba5f-e1433aa34ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:07.294202 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaaa6b-69bd-42b6-ba5f-e1433aa34ed4 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:07.294680 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaaa6b-69bd-42b6-ba5f-e1433aa34ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:07.295176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaaa6b-69bd-42b6-ba5f-e1433aa34ed4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:07.308055 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaaa6b-69bd-42b6-ba5f-e1433aa34ed4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:07.316733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-aaeaaa6b-69bd-42b6-ba5f-e1433aa34ed4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:07.316733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:07.316733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:07.316733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:07.316733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:07.316733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:07.316733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:07.316733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:07.316733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:07.316733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:07.316733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:07.316733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:07.316733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:07.316733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:07.316733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:07.316733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:07.317654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:07.317654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:07.317654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:07.317654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:07.317654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:07.317654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:07.317654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:07.317654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:07.317654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:07.317654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:07.317654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:07.317654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:49:07.317654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:07.317654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:07.317654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:07.317654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:07.318684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:07.318684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:07.318684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:07.318684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:07.318684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:07.318684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:07.318684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:07.318684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:07.318684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:07.318684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:07.318684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:07.318684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:49:07.321447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 49/100] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:49:07.330516 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46287c-9079-4c7d-bd75-61de493115ed None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:07.445865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46287c-9079-4c7d-bd75-61de493115ed None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:07.487701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24636afb-4e00-4866-9156-9867f2b77ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:07.488756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24636afb-4e00-4866-9156-9867f2b77ca0 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:07.489234 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24636afb-4e00-4866-9156-9867f2b77ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:07.489700 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24636afb-4e00-4866-9156-9867f2b77ca0 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:07.490654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24636afb-4e00-4866-9156-9867f2b77ca0 None admin] RBAC: Adding query filter params (name=member) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:07.491232 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24636afb-4e00-4866-9156-9867f2b77ca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:07.492840 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24636afb-4e00-4866-9156-9867f2b77ca0 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:07.503375 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 52/101] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:07.516084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaaa6b-69bd-42b6-ba5f-e1433aa34ed4 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:07.632153 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaaa6b-69bd-42b6-ba5f-e1433aa34ed4 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:07.677365 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050392dd-ba01-4a89-8268-c2e8f355ac4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:07.678926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050392dd-ba01-4a89-8268-c2e8f355ac4f None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:07.679442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050392dd-ba01-4a89-8268-c2e8f355ac4f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:07.679939 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050392dd-ba01-4a89-8268-c2e8f355ac4f None admin] PATH_INFO: `/v3/users/f2a0711bb35944ca87b4e4380659c57f` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:07.681595 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050392dd-ba01-4a89-8268-c2e8f355ac4f None admin] RBAC: Authorizing `identity:get_user(user_id=f2a0711bb35944ca87b4e4380659c57f)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:07.683390 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050392dd-ba01-4a89-8268-c2e8f355ac4f None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:07.685440 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 50/102] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:07 2022] GET /identity/v3/users/f2a0711bb35944ca87b4e4380659c57f => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:07.694774 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24636afb-4e00-4866-9156-9867f2b77ca0 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:07.828789 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24636afb-4e00-4866-9156-9867f2b77ca0 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:07.876344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548d289-59dd-4f77-9840-758be1a7c396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:07.877824 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548d289-59dd-4f77-9840-758be1a7c396 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:07.878257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548d289-59dd-4f77-9840-758be1a7c396 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:07.878680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548d289-59dd-4f77-9840-758be1a7c396 None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:07.892644 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548d289-59dd-4f77-9840-758be1a7c396 None admin] RBAC: Authorizing `identity:get_project(project_id=04114986615247c2bbac8845c3c3a8e7)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:07.895548 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548d289-59dd-4f77-9840-758be1a7c396 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:07.899013 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 53/103] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:07 2022] GET /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:07.908430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050392dd-ba01-4a89-8268-c2e8f355ac4f None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:08.129251 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65f862-ed1d-460e-8373-c59d90702b33 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:08.129795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65f862-ed1d-460e-8373-c59d90702b33 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:08.130157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65f862-ed1d-460e-8373-c59d90702b33 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:08.133619 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 54/104] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:08.143079 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbae9ba-a249-41f5-978b-e43406115465 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:08.143536 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbae9ba-a249-41f5-978b-e43406115465 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:08.143996 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbae9ba-a249-41f5-978b-e43406115465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:08.159364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050392dd-ba01-4a89-8268-c2e8f355ac4f None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:08.200455 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-5dbae9ba-a249-41f5-978b-e43406115465 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:08.202378 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-5dbae9ba-a249-41f5-978b-e43406115465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:08.233343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a892eee-78c6-4594-9387-31723b90cedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:08.234969 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a892eee-78c6-4594-9387-31723b90cedf None admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:08.235465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a892eee-78c6-4594-9387-31723b90cedf None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:08.235953 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a892eee-78c6-4594-9387-31723b90cedf None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7/users/f2a0711bb35944ca87b4e4380659c57f/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:08.241578 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a892eee-78c6-4594-9387-31723b90cedf None admin] RBAC: Authorizing `identity:create_grant(project_id=04114986615247c2bbac8845c3c3a8e7, user_id=f2a0711bb35944ca87b4e4380659c57f, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:08.250622 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a892eee-78c6-4594-9387-31723b90cedf None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:08.296313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 51/105] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:49:07 2022] PUT /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7/users/f2a0711bb35944ca87b4e4380659c57f/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:49:08.375617 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 55/106] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:49:08.416960 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a892eee-78c6-4594-9387-31723b90cedf None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:08.443546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdd606-3ecd-4312-addc-0fe76e210c9a None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:08.443874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdd606-3ecd-4312-addc-0fe76e210c9a None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:08.444158 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdd606-3ecd-4312-addc-0fe76e210c9a None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:08.445911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 56/107] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:08.454358 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78df7e6-4848-4642-8ed8-6b94a9abf416 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:08.454674 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78df7e6-4848-4642-8ed8-6b94a9abf416 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:08.454952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78df7e6-4848-4642-8ed8-6b94a9abf416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:08.504044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-d78df7e6-4848-4642-8ed8-6b94a9abf416 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:08.505290 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-d78df7e6-4848-4642-8ed8-6b94a9abf416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:08.588225 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a892eee-78c6-4594-9387-31723b90cedf None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:08.630793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 57/108] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:08.632876 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88902bec-b573-4553-9dc8-bad170c280af None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:08.633496 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88902bec-b573-4553-9dc8-bad170c280af None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:08.633987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88902bec-b573-4553-9dc8-bad170c280af None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:08.636473 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 58/109] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:08.643446 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2b6d1-5690-4cd7-9304-1e410e7f640b None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:08.643756 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d68739-0be4-42af-91ea-06ac8c0c1812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:08.644331 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2b6d1-5690-4cd7-9304-1e410e7f640b None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:08.644606 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d68739-0be4-42af-91ea-06ac8c0c1812 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:08.644894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d68739-0be4-42af-91ea-06ac8c0c1812 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:08.645172 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d68739-0be4-42af-91ea-06ac8c0c1812 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:08.645505 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2b6d1-5690-4cd7-9304-1e410e7f640b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:08.670882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d68739-0be4-42af-91ea-06ac8c0c1812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:08.679222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-48d68739-0be4-42af-91ea-06ac8c0c1812 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:08.679222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:08.679222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:08.679222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:08.679222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:08.679222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:08.679222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:08.679222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:08.679222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:08.679222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:08.679222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:08.679222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:08.679222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:08.679222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:08.679222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:08.679222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:08.680151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:08.680151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:08.680151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:08.680151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:08.680151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:08.680151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:08.680151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:08.680151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:08.680151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:08.680151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:08.680151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:08.680151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:49:08.680151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:08.680151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:08.680151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:08.680151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:08.680926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:08.680926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:08.680926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:08.680926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:08.680926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:08.680926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:08.680926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:08.680926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:08.680926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:08.680926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:08.680926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:08.680926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:49:08.682071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-67c2b6d1-5690-4cd7-9304-1e410e7f640b None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:08.682071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-67c2b6d1-5690-4cd7-9304-1e410e7f640b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:08.684316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 52/110] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:08.690556 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d68739-0be4-42af-91ea-06ac8c0c1812 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:08.768840 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 59/111] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:08.769635 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2b6d1-5690-4cd7-9304-1e410e7f640b None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:08.807095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d68739-0be4-42af-91ea-06ac8c0c1812 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:08.860774 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c2366-bf01-4d6b-866f-e2dea536d5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:08.862010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c2366-bf01-4d6b-866f-e2dea536d5d8 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:08.862517 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c2366-bf01-4d6b-866f-e2dea536d5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:08.863056 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c2366-bf01-4d6b-866f-e2dea536d5d8 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:08.864072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c2366-bf01-4d6b-866f-e2dea536d5d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:08.864735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c2366-bf01-4d6b-866f-e2dea536d5d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:08.866404 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c2366-bf01-4d6b-866f-e2dea536d5d8 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:08.888057 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 53/112] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:08.895090 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c2366-bf01-4d6b-866f-e2dea536d5d8 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:08.915308 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2b6d1-5690-4cd7-9304-1e410e7f640b None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:08.955025 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91428104-b1d6-4cc5-966e-2a68e58485c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:08.955851 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91428104-b1d6-4cc5-966e-2a68e58485c2 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:08.956138 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91428104-b1d6-4cc5-966e-2a68e58485c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:08.956408 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91428104-b1d6-4cc5-966e-2a68e58485c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:08.957809 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91428104-b1d6-4cc5-966e-2a68e58485c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:08.959366 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91428104-b1d6-4cc5-966e-2a68e58485c2 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:08.961087 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 60/113] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:49:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:08.961877 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91428104-b1d6-4cc5-966e-2a68e58485c2 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:09.078180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91428104-b1d6-4cc5-966e-2a68e58485c2 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:09.100769 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c2366-bf01-4d6b-866f-e2dea536d5d8 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:09.115206 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f666e8-b662-4280-90f9-9a74377700d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:09.116096 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f666e8-b662-4280-90f9-9a74377700d3 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:09.116378 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f666e8-b662-4280-90f9-9a74377700d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:09.116654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f666e8-b662-4280-90f9-9a74377700d3 None admin] PATH_INFO: `/v3/users/f2a0711bb35944ca87b4e4380659c57f` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:09.117930 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f666e8-b662-4280-90f9-9a74377700d3 None admin] RBAC: Authorizing `identity:get_user(user_id=f2a0711bb35944ca87b4e4380659c57f)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:09.120042 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f666e8-b662-4280-90f9-9a74377700d3 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:09.121796 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 61/114] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:08 2022] GET /identity/v3/users/f2a0711bb35944ca87b4e4380659c57f => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:09.123122 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c9933-3178-478a-9391-8a57764ddb53 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:09.123407 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c9933-3178-478a-9391-8a57764ddb53 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:09.123683 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c9933-3178-478a-9391-8a57764ddb53 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:09.125277 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 62/115] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:09.126018 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c9933-3178-478a-9391-8a57764ddb53 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:09.172036 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527595c-f50d-4e93-b67d-4d2cd75929ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:09.173295 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527595c-f50d-4e93-b67d-4d2cd75929ff None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:09.173778 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527595c-f50d-4e93-b67d-4d2cd75929ff None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:09.174263 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527595c-f50d-4e93-b67d-4d2cd75929ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:09.194442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527595c-f50d-4e93-b67d-4d2cd75929ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:09.211095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-9527595c-f50d-4e93-b67d-4d2cd75929ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:49:09.211095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:09.211095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:09.211095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:09.211095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:09.211095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:09.211095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:09.211095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:09.211095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:09.211095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:09.211095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:09.211095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:09.211095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:09.211095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:09.211095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:09.211095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:09.213150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:09.213150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:09.213150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:09.213150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:09.213150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:09.213150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:09.213150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:09.213150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:09.213150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:09.213150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:09.213150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:09.213150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:49:09.213150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:09.213150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:09.213150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:09.213150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:09.215146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:09.215146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:09.215146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:09.215146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:09.215146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:09.215146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:09.215146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:09.215146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:09.215146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:09.215146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:09.215146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:49:09.215146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:49:09.215146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 54/116] 10.222.0.73 () {56 vars in 1114 bytes} [Fri May 13 14:49:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:09.216641 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527595c-f50d-4e93-b67d-4d2cd75929ff None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:09.242161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c9933-3178-478a-9391-8a57764ddb53 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:09.292895 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cce3b9-9d28-4cfd-a59c-6029e14cf17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:09.294348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cce3b9-9d28-4cfd-a59c-6029e14cf17b None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:09.295371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cce3b9-9d28-4cfd-a59c-6029e14cf17b None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:09.295841 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cce3b9-9d28-4cfd-a59c-6029e14cf17b None admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:09.297127 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cce3b9-9d28-4cfd-a59c-6029e14cf17b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:09.301411 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cce3b9-9d28-4cfd-a59c-6029e14cf17b None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:09.355285 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527595c-f50d-4e93-b67d-4d2cd75929ff None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:09.359771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 63/117] 10.222.0.73 () {60 vars in 1141 bytes} [Fri May 13 14:49:09 2022] POST /identity/v3/projects => generated 302 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:49:09.367159 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d0df3-2d45-49a4-9ff9-2ba812ca6e19 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:09.367159 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d0df3-2d45-49a4-9ff9-2ba812ca6e19 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:09.367159 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d0df3-2d45-49a4-9ff9-2ba812ca6e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:09.402588 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-7a7d0df3-2d45-49a4-9ff9-2ba812ca6e19 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:09.405517 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-7a7d0df3-2d45-49a4-9ff9-2ba812ca6e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:09.432042 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9af0e-534a-45dc-b089-a81f188e67bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:09.432857 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9af0e-534a-45dc-b089-a81f188e67bd None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:09.433227 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9af0e-534a-45dc-b089-a81f188e67bd None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:09.433411 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9af0e-534a-45dc-b089-a81f188e67bd None admin] PATH_INFO: `/v3/projects/846d89c30b0243e0866cdb16fe599ec6` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:09.436495 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9af0e-534a-45dc-b089-a81f188e67bd None admin] RBAC: Authorizing `identity:get_project(project_id=846d89c30b0243e0866cdb16fe599ec6)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:09.438000 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9af0e-534a-45dc-b089-a81f188e67bd None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:09.442007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 55/118] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:09 2022] GET /identity/v3/projects/846d89c30b0243e0866cdb16fe599ec6 => generated 312 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:09.443638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9af0e-534a-45dc-b089-a81f188e67bd None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:09.526474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 64/119] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:09.527609 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d0df3-2d45-49a4-9ff9-2ba812ca6e19 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:09.653887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d0df3-2d45-49a4-9ff9-2ba812ca6e19 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:09.693904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9af0e-534a-45dc-b089-a81f188e67bd None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:09.694995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cde573-45bf-4cda-980a-c21043f64c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:09.695946 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cde573-45bf-4cda-980a-c21043f64c5c None admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:09.696223 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cde573-45bf-4cda-980a-c21043f64c5c None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:09.696500 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cde573-45bf-4cda-980a-c21043f64c5c None admin] PATH_INFO: `/v3/projects/846d89c30b0243e0866cdb16fe599ec6/users/f2a0711bb35944ca87b4e4380659c57f/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:09.699645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cde573-45bf-4cda-980a-c21043f64c5c None admin] RBAC: Authorizing `identity:create_grant(project_id=846d89c30b0243e0866cdb16fe599ec6, user_id=f2a0711bb35944ca87b4e4380659c57f, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:09.701176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cde573-45bf-4cda-980a-c21043f64c5c None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:09.724318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 65/120] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:49:09 2022] PUT /identity/v3/projects/846d89c30b0243e0866cdb16fe599ec6/users/f2a0711bb35944ca87b4e4380659c57f/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:49:09.725568 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cde573-45bf-4cda-980a-c21043f64c5c None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:09.836089 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a75fc-d243-4abe-bf48-669a4d1875e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:09.837181 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a75fc-d243-4abe-bf48-669a4d1875e5 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:09.837688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a75fc-d243-4abe-bf48-669a4d1875e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:09.838160 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a75fc-d243-4abe-bf48-669a4d1875e5 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:09.839523 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a75fc-d243-4abe-bf48-669a4d1875e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:09.840032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a75fc-d243-4abe-bf48-669a4d1875e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:09.842566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a75fc-d243-4abe-bf48-669a4d1875e5 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:09.868243 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 56/121] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:49:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:09.875313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a75fc-d243-4abe-bf48-669a4d1875e5 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:09.974581 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cde573-45bf-4cda-980a-c21043f64c5c None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:10.071066 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dd1e7-d65a-4362-ae47-1eb23f6add1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:10.072517 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dd1e7-d65a-4362-ae47-1eb23f6add1c None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:10.073003 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dd1e7-d65a-4362-ae47-1eb23f6add1c None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:10.073487 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dd1e7-d65a-4362-ae47-1eb23f6add1c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:10.085598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a75fc-d243-4abe-bf48-669a4d1875e5 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:10.095854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7dd1e7-d65a-4362-ae47-1eb23f6add1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:10.114526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-dc7dd1e7-d65a-4362-ae47-1eb23f6add1c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:49:10.114526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:10.114526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:10.114526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:10.114526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:10.114526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:10.114526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:10.114526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:10.114526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:10.114526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:10.114526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:10.114526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:10.114526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:10.114526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:10.114526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:10.114526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:10.115490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:10.115490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:10.115490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:10.115490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:10.115490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:10.115490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:10.115490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:10.115490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:10.115490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:10.115490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:10.115490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:10.115490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:10.115490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:10.115490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:10.115490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:10.115490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:10.116250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:10.116250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:10.116250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:10.116250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:10.116250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:10.116250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:10.116250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:10.116250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:10.116250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:10.116250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:10.116250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:49:10.116250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:10.116847 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 66/122] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:10.126557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dd1e7-d65a-4362-ae47-1eb23f6add1c None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:10.132670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adb973-3245-4d5e-8e17-b62ff4260071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:10.134200 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adb973-3245-4d5e-8e17-b62ff4260071 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:10.134739 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adb973-3245-4d5e-8e17-b62ff4260071 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:10.135253 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adb973-3245-4d5e-8e17-b62ff4260071 None admin] PATH_INFO: `/v3/users/f2a0711bb35944ca87b4e4380659c57f` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:10.138083 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adb973-3245-4d5e-8e17-b62ff4260071 None admin] RBAC: Authorizing `identity:get_user(user_id=f2a0711bb35944ca87b4e4380659c57f)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:10.141099 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adb973-3245-4d5e-8e17-b62ff4260071 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:10.143651 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 57/123] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:09 2022] GET /identity/v3/users/f2a0711bb35944ca87b4e4380659c57f => generated 275 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:10.148220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eda991-00d2-47ef-ab87-21b3ce84d836 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:10.148831 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eda991-00d2-47ef-ab87-21b3ce84d836 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:10.149305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eda991-00d2-47ef-ab87-21b3ce84d836 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:10.151523 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 58/124] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:49:10.152576 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eda991-00d2-47ef-ab87-21b3ce84d836 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:10.266529 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eda991-00d2-47ef-ab87-21b3ce84d836 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:10.305456 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4b4d0-2bc4-4215-a0df-e7b59c2f6ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:10.306960 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4b4d0-2bc4-4215-a0df-e7b59c2f6ccc None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:10.307467 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4b4d0-2bc4-4215-a0df-e7b59c2f6ccc None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:10.307943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4b4d0-2bc4-4215-a0df-e7b59c2f6ccc None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:10.309476 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4b4d0-2bc4-4215-a0df-e7b59c2f6ccc None admin] RBAC: Authorizing `identity:get_project(project_id=04114986615247c2bbac8845c3c3a8e7)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:10.311234 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4b4d0-2bc4-4215-a0df-e7b59c2f6ccc None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:10.313340 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 59/125] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:10 2022] GET /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:10.315075 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b10b8-a743-4796-8110-b15c375e62aa None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:10.315576 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b10b8-a743-4796-8110-b15c375e62aa None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:10.316049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b10b8-a743-4796-8110-b15c375e62aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:10.323390 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dd1e7-d65a-4362-ae47-1eb23f6add1c None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:10.335168 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-a75b10b8-a743-4796-8110-b15c375e62aa None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:10.336760 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a75b10b8-a743-4796-8110-b15c375e62aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:10.386771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdeafdf-9533-46f1-bb2e-e5947de0bdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:10.388019 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdeafdf-9533-46f1-bb2e-e5947de0bdfc None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:10.388488 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdeafdf-9533-46f1-bb2e-e5947de0bdfc None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:10.388926 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdeafdf-9533-46f1-bb2e-e5947de0bdfc None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:10.390482 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdeafdf-9533-46f1-bb2e-e5947de0bdfc None admin] RBAC: Adding query filter params (name=reader) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:10.390912 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdeafdf-9533-46f1-bb2e-e5947de0bdfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:10.393620 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdeafdf-9533-46f1-bb2e-e5947de0bdfc None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:10.410091 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 67/126] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:10.411620 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdeafdf-9533-46f1-bb2e-e5947de0bdfc None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:10.425483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 60/127] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:10.426855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b10b8-a743-4796-8110-b15c375e62aa None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:10.543250 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b10b8-a743-4796-8110-b15c375e62aa None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:10.580720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e5afe-50a6-4b6e-b24c-241715481253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:10.582053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e5afe-50a6-4b6e-b24c-241715481253 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:10.582558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e5afe-50a6-4b6e-b24c-241715481253 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:10.583062 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e5afe-50a6-4b6e-b24c-241715481253 None admin] PATH_INFO: `/v3/users/24fa92078ef74317af703e412b13932e` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:10.601533 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e5afe-50a6-4b6e-b24c-241715481253 None admin] RBAC: Authorizing `identity:get_user(user_id=24fa92078ef74317af703e412b13932e)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:10.603582 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e5afe-50a6-4b6e-b24c-241715481253 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:10.603919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdeafdf-9533-46f1-bb2e-e5947de0bdfc None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:10.606220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 61/128] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:10 2022] GET /identity/v3/users/24fa92078ef74317af703e412b13932e => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:10.607397 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e5afe-50a6-4b6e-b24c-241715481253 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:10.675170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b57a9-6ef1-4b6b-8b71-e040b9c064dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:10.676852 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b57a9-6ef1-4b6b-8b71-e040b9c064dc None admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:10.677244 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b57a9-6ef1-4b6b-8b71-e040b9c064dc None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:10.677726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b57a9-6ef1-4b6b-8b71-e040b9c064dc None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7/users/f2a0711bb35944ca87b4e4380659c57f/roles/0a8d21e5149c42a8b85ca3c0258538d4` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:10.688049 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b57a9-6ef1-4b6b-8b71-e040b9c064dc None admin] RBAC: Authorizing `identity:create_grant(project_id=04114986615247c2bbac8845c3c3a8e7, user_id=f2a0711bb35944ca87b4e4380659c57f, role_id=0a8d21e5149c42a8b85ca3c0258538d4)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:10.690871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b57a9-6ef1-4b6b-8b71-e040b9c064dc None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:10.726270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 68/129] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:49:10 2022] PUT /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7/users/f2a0711bb35944ca87b4e4380659c57f/roles/0a8d21e5149c42a8b85ca3c0258538d4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:49:10.732294 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b57a9-6ef1-4b6b-8b71-e040b9c064dc None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:10.782126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e5afe-50a6-4b6e-b24c-241715481253 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:10.835756 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b57578-d165-4a98-a45e-4754461f4183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:10.837128 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b57578-d165-4a98-a45e-4754461f4183 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:10.838328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b57578-d165-4a98-a45e-4754461f4183 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:10.838845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b57578-d165-4a98-a45e-4754461f4183 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:10.853209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b57578-d165-4a98-a45e-4754461f4183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:10.862317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-23b57578-d165-4a98-a45e-4754461f4183 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:49:10.862317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:10.862317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:10.862317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:10.862317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:10.862317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:10.862317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:10.862317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:10.862317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:10.862317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:10.862317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:10.862317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:10.862317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:10.862317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:10.862317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:10.862317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:10.863289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:10.863289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:10.863289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:10.863289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:10.863289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:10.863289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:10.863289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:10.863289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:10.863289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:10.863289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:10.863289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:10.863289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:49:10.863289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:10.863289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:10.863289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:10.863289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:10.864144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:10.864144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:10.864144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:10.864144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:10.864144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:10.864144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:10.864144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:10.864144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:10.864144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:10.864144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:10.864144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:49:10.864144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:49:10.867250 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 62/130] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:49:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:10.876382 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b57578-d165-4a98-a45e-4754461f4183 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:11.015042 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b57578-d165-4a98-a45e-4754461f4183 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:11.055331 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acd0ca-fa34-4a2b-a8b5-2cfd34e88348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:11.056977 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acd0ca-fa34-4a2b-a8b5-2cfd34e88348 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:11.057490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acd0ca-fa34-4a2b-a8b5-2cfd34e88348 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:11.058178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acd0ca-fa34-4a2b-a8b5-2cfd34e88348 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:11.059294 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acd0ca-fa34-4a2b-a8b5-2cfd34e88348 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:11.059867 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acd0ca-fa34-4a2b-a8b5-2cfd34e88348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:11.061543 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acd0ca-fa34-4a2b-a8b5-2cfd34e88348 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:11.073294 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 63/131] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:11.085627 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acd0ca-fa34-4a2b-a8b5-2cfd34e88348 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:11.087750 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b57a9-6ef1-4b6b-8b71-e040b9c064dc None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:11.205828 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9910f6-3fd1-4f0b-a913-3ebadf86df00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:11.206926 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9910f6-3fd1-4f0b-a913-3ebadf86df00 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:11.207449 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9910f6-3fd1-4f0b-a913-3ebadf86df00 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:11.207933 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9910f6-3fd1-4f0b-a913-3ebadf86df00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:11.293661 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9910f6-3fd1-4f0b-a913-3ebadf86df00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:11.295566 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9910f6-3fd1-4f0b-a913-3ebadf86df00 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:11.402101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acd0ca-fa34-4a2b-a8b5-2cfd34e88348 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:11.407938 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 69/132] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:49:11.422433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9910f6-3fd1-4f0b-a913-3ebadf86df00 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:11.485007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e61b8-c9d5-4607-b226-1031edb71747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:11.486607 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e61b8-c9d5-4607-b226-1031edb71747 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:11.487417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e61b8-c9d5-4607-b226-1031edb71747 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:11.487638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e61b8-c9d5-4607-b226-1031edb71747 None admin] PATH_INFO: `/v3/users/f5d162836f3c43f6919175fd34ffcf36` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:11.489919 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e61b8-c9d5-4607-b226-1031edb71747 None admin] RBAC: Authorizing `identity:get_user(user_id=f5d162836f3c43f6919175fd34ffcf36)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:11.492714 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e61b8-c9d5-4607-b226-1031edb71747 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:11.496044 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 64/133] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:11 2022] GET /identity/v3/users/f5d162836f3c43f6919175fd34ffcf36 => generated 247 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:11.504398 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e61b8-c9d5-4607-b226-1031edb71747 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:11.546494 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9910f6-3fd1-4f0b-a913-3ebadf86df00 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:11.605869 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1b6a9-5885-4580-ad3b-5370d9428a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:11.607999 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1b6a9-5885-4580-ad3b-5370d9428a28 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:11.608866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1b6a9-5885-4580-ad3b-5370d9428a28 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:11.609625 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1b6a9-5885-4580-ad3b-5370d9428a28 None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:11.612536 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1b6a9-5885-4580-ad3b-5370d9428a28 None admin] RBAC: Authorizing `identity:get_project(project_id=04114986615247c2bbac8845c3c3a8e7)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:11.615714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1b6a9-5885-4580-ad3b-5370d9428a28 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:11.619566 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 70/134] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:11 2022] GET /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:11.629016 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1b6a9-5885-4580-ad3b-5370d9428a28 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:11.694587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e61b8-c9d5-4607-b226-1031edb71747 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:11.773074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c9620-6622-44f0-a715-898df530d4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:11.774718 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c9620-6622-44f0-a715-898df530d4de None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:11.775233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c9620-6622-44f0-a715-898df530d4de None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:11.775722 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c9620-6622-44f0-a715-898df530d4de None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:11.785121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c9620-6622-44f0-a715-898df530d4de None admin] RBAC: Authorizing `identity:get_project(project_id=04114986615247c2bbac8845c3c3a8e7)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:11.787127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c9620-6622-44f0-a715-898df530d4de None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:11.790774 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 65/135] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:11 2022] GET /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:11.799676 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c9620-6622-44f0-a715-898df530d4de None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:11.878680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1b6a9-5885-4580-ad3b-5370d9428a28 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:11.956320 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438ed7d-6e62-449f-a029-d4feb2004c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:11.957419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438ed7d-6e62-449f-a029-d4feb2004c77 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:11.957901 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438ed7d-6e62-449f-a029-d4feb2004c77 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:11.958446 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438ed7d-6e62-449f-a029-d4feb2004c77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:11.960065 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438ed7d-6e62-449f-a029-d4feb2004c77 None admin] RBAC: Adding query filter params (role.id=8a5dc4dc644046d487fb9977cd999599, scope.project.id=04114986615247c2bbac8845c3c3a8e7, user.id=24fa92078ef74317af703e412b13932e) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:11.960624 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438ed7d-6e62-449f-a029-d4feb2004c77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:11.962928 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438ed7d-6e62-449f-a029-d4feb2004c77 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:11.979610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 71/136] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:49:11 2022] GET /identity/v3/role_assignments?user.id=24fa92078ef74317af703e412b13932e&scope.project.id=04114986615247c2bbac8845c3c3a8e7&role.id=8a5dc4dc644046d487fb9977cd999599 => generated 259 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:12.022855 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6659c3-f036-4aa1-8864-6a45a359a010 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:12.023421 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6659c3-f036-4aa1-8864-6a45a359a010 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:12.024001 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6659c3-f036-4aa1-8864-6a45a359a010 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:12.026233 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 72/137] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:49:12.053600 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d1ae4-3586-4b7b-8d94-d5227a29f432 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:12.054098 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d1ae4-3586-4b7b-8d94-d5227a29f432 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:12.054605 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d1ae4-3586-4b7b-8d94-d5227a29f432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:12.111249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-6a3d1ae4-3586-4b7b-8d94-d5227a29f432 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:12.112786 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6a3d1ae4-3586-4b7b-8d94-d5227a29f432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:12.144713 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c9620-6622-44f0-a715-898df530d4de None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:12.249354 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754f08f-d97c-40d6-b6e4-93566e72936d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:12.251502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754f08f-d97c-40d6-b6e4-93566e72936d None admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:12.252332 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754f08f-d97c-40d6-b6e4-93566e72936d None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:12.253121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754f08f-d97c-40d6-b6e4-93566e72936d None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7/users/f5d162836f3c43f6919175fd34ffcf36/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:12.264457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754f08f-d97c-40d6-b6e4-93566e72936d None admin] RBAC: Authorizing `identity:create_grant(project_id=04114986615247c2bbac8845c3c3a8e7, user_id=f5d162836f3c43f6919175fd34ffcf36, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:12.267850 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754f08f-d97c-40d6-b6e4-93566e72936d None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:12.280456 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 73/138] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:49:12.296608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 66/139] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:49:11 2022] PUT /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7/users/f5d162836f3c43f6919175fd34ffcf36/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:49:12.349485 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d1ae4-3586-4b7b-8d94-d5227a29f432 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:12.571175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d1ae4-3586-4b7b-8d94-d5227a29f432 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:12.637887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2a40f-5e22-4a0e-8ed9-d57fdb60f4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:12.639915 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2a40f-5e22-4a0e-8ed9-d57fdb60f4ad None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:12.640737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2a40f-5e22-4a0e-8ed9-d57fdb60f4ad None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:12.641521 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2a40f-5e22-4a0e-8ed9-d57fdb60f4ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:12.670564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2a40f-5e22-4a0e-8ed9-d57fdb60f4ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:12.692364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-aba2a40f-5e22-4a0e-8ed9-d57fdb60f4ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:12.692364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:12.692364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:12.692364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:12.692364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:12.692364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:12.692364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:12.692364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:12.692364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:12.692364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:12.692364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:12.692364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:12.692364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:12.692364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:12.692364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:12.692364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:12.694348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:12.694348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:12.694348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:12.694348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:12.694348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:12.694348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:12.694348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:12.694348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:12.694348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:12.694348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:12.694348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:12.694348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:12.694348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:12.694348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:12.694348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:12.694348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:12.695985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:12.695985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:12.695985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:12.695985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:12.695985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:12.695985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:12.695985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:12.695985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:12.695985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:12.695985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:12.695985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:12.695985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:12.701112 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 74/140] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:12.711262 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754f08f-d97c-40d6-b6e4-93566e72936d None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:12.954771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754f08f-d97c-40d6-b6e4-93566e72936d None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:13.020766 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8ba5a-fc81-413e-8c3e-8a8a2a7ac8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:13.022440 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8ba5a-fc81-413e-8c3e-8a8a2a7ac8c3 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:13.023277 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8ba5a-fc81-413e-8c3e-8a8a2a7ac8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:13.024059 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8ba5a-fc81-413e-8c3e-8a8a2a7ac8c3 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:13.025907 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8ba5a-fc81-413e-8c3e-8a8a2a7ac8c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:13.026740 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8ba5a-fc81-413e-8c3e-8a8a2a7ac8c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:13.029398 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8ba5a-fc81-413e-8c3e-8a8a2a7ac8c3 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:13.046220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 67/141] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:13.052896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2a40f-5e22-4a0e-8ed9-d57fdb60f4ad None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:13.196364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2a40f-5e22-4a0e-8ed9-d57fdb60f4ad None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:13.235084 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0c598-d074-49c4-87f2-551e88c960fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:13.235979 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0c598-d074-49c4-87f2-551e88c960fd None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:13.236257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0c598-d074-49c4-87f2-551e88c960fd None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:13.236532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0c598-d074-49c4-87f2-551e88c960fd None admin] PATH_INFO: `/v3/users/f2a0711bb35944ca87b4e4380659c57f` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:13.237805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0c598-d074-49c4-87f2-551e88c960fd None admin] RBAC: Authorizing `identity:get_user(user_id=f2a0711bb35944ca87b4e4380659c57f)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:13.239327 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0c598-d074-49c4-87f2-551e88c960fd None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:13.241293 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 75/142] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:13 2022] GET /identity/v3/users/f2a0711bb35944ca87b4e4380659c57f => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:13.246744 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8ba5a-fc81-413e-8c3e-8a8a2a7ac8c3 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:13.376717 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8ba5a-fc81-413e-8c3e-8a8a2a7ac8c3 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:13.422275 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78144794-4e13-4d2c-9956-594f7f7796af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:13.422972 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78144794-4e13-4d2c-9956-594f7f7796af None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:13.423255 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78144794-4e13-4d2c-9956-594f7f7796af None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:13.423524 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78144794-4e13-4d2c-9956-594f7f7796af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:13.508205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78144794-4e13-4d2c-9956-594f7f7796af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:13.508437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78144794-4e13-4d2c-9956-594f7f7796af None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:13.638883 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 68/143] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:49:13.644569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0c598-d074-49c4-87f2-551e88c960fd None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:13.905468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0c598-d074-49c4-87f2-551e88c960fd None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:13.978576 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ee1bb-494d-4537-8668-63ad7d23636d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:13.980563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ee1bb-494d-4537-8668-63ad7d23636d None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:13.981357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ee1bb-494d-4537-8668-63ad7d23636d None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:13.982103 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ee1bb-494d-4537-8668-63ad7d23636d None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:13.984243 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ee1bb-494d-4537-8668-63ad7d23636d None admin] RBAC: Authorizing `identity:get_project(project_id=04114986615247c2bbac8845c3c3a8e7)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:13.986715 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ee1bb-494d-4537-8668-63ad7d23636d None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:13.990428 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 76/144] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:13 2022] GET /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7 => generated 298 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:13.996682 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78144794-4e13-4d2c-9956-594f7f7796af None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:14.159941 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78144794-4e13-4d2c-9956-594f7f7796af None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:14.213951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d9a3a-798b-4b51-8775-4af3fef12cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:14.214643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d9a3a-798b-4b51-8775-4af3fef12cb5 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:14.214972 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d9a3a-798b-4b51-8775-4af3fef12cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:14.215224 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d9a3a-798b-4b51-8775-4af3fef12cb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:14.216083 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d9a3a-798b-4b51-8775-4af3fef12cb5 None admin] RBAC: Adding query filter params (role.id=0268e6ac6fb649eb89da825c5ae328ab, scope.project.id=04114986615247c2bbac8845c3c3a8e7, user.id=f2a0711bb35944ca87b4e4380659c57f) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:14.216414 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d9a3a-798b-4b51-8775-4af3fef12cb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:14.217872 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d9a3a-798b-4b51-8775-4af3fef12cb5 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:14.228702 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 69/145] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:49:13 2022] GET /identity/v3/role_assignments?user.id=f2a0711bb35944ca87b4e4380659c57f&scope.project.id=04114986615247c2bbac8845c3c3a8e7&role.id=0268e6ac6fb649eb89da825c5ae328ab => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:14.410427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee446d-5207-4b0f-afe2-b39f7f648ff7 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:14.410654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee446d-5207-4b0f-afe2-b39f7f648ff7 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:14.411072 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee446d-5207-4b0f-afe2-b39f7f648ff7 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:14.412418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 77/146] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:14.418557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149add9-de36-4e4f-911e-b3e15f54aa90 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:14.418981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149add9-de36-4e4f-911e-b3e15f54aa90 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:14.419136 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149add9-de36-4e4f-911e-b3e15f54aa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:14.441657 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-9149add9-de36-4e4f-911e-b3e15f54aa90 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:14.443193 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-9149add9-de36-4e4f-911e-b3e15f54aa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:14.527302 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ebc60-9447-40a3-b20d-dd5bb3fff8f8 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:14.527766 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ebc60-9447-40a3-b20d-dd5bb3fff8f8 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:14.527914 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ebc60-9447-40a3-b20d-dd5bb3fff8f8 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:14.529714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 78/147] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:14.536181 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65355e81-9252-40fe-905b-f6ad715ae01b None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:14.536625 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65355e81-9252-40fe-905b-f6ad715ae01b None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:14.537068 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65355e81-9252-40fe-905b-f6ad715ae01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:14.544471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 70/148] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:14.567492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-65355e81-9252-40fe-905b-f6ad715ae01b None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:14.568992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-65355e81-9252-40fe-905b-f6ad715ae01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:14.595778 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131222b-d65c-434a-8d49-4b92cb31a1b8 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:14.596102 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131222b-d65c-434a-8d49-4b92cb31a1b8 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:14.596517 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131222b-d65c-434a-8d49-4b92cb31a1b8 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:14.597993 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 71/149] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:14.603985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd62bc8-4cc9-463e-bb81-119b2f6272d8 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:14.604255 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd62bc8-4cc9-463e-bb81-119b2f6272d8 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:14.604554 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd62bc8-4cc9-463e-bb81-119b2f6272d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:14.637185 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-8fd62bc8-4cc9-463e-bb81-119b2f6272d8 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:14.639832 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-8fd62bc8-4cc9-463e-bb81-119b2f6272d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:14.695590 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 79/150] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:14.696511 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65355e81-9252-40fe-905b-f6ad715ae01b None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:14.767903 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 72/151] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:49:14.769161 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd62bc8-4cc9-463e-bb81-119b2f6272d8 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:14.845368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65355e81-9252-40fe-905b-f6ad715ae01b None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:14.884642 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c7f2a-ae32-4a6e-9fb6-0ba268ab6870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:14.885480 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c7f2a-ae32-4a6e-9fb6-0ba268ab6870 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:14.885766 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c7f2a-ae32-4a6e-9fb6-0ba268ab6870 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:14.886040 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c7f2a-ae32-4a6e-9fb6-0ba268ab6870 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:14.886261 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd62bc8-4cc9-463e-bb81-119b2f6272d8 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:14.887427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c7f2a-ae32-4a6e-9fb6-0ba268ab6870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:14.888946 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c7f2a-ae32-4a6e-9fb6-0ba268ab6870 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:14.890731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 80/152] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:49:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:14.891951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c7f2a-ae32-4a6e-9fb6-0ba268ab6870 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:14.933968 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21747a6-b23e-4ae8-899f-ce1c74812fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:14.935381 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21747a6-b23e-4ae8-899f-ce1c74812fa4 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:14.936754 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21747a6-b23e-4ae8-899f-ce1c74812fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:14.937269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21747a6-b23e-4ae8-899f-ce1c74812fa4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:14.952124 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21747a6-b23e-4ae8-899f-ce1c74812fa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:14.962940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-d21747a6-b23e-4ae8-899f-ce1c74812fa4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:14.962940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:14.962940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:14.962940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:14.962940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:14.962940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:14.962940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:14.962940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:14.962940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:14.962940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:14.962940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:14.962940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:14.962940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:14.962940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:14.962940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:14.962940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:14.963873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:14.963873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:14.963873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:14.963873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:14.963873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:14.963873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:14.963873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:14.963873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:14.963873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:14.963873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:14.963873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:14.963873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:49:14.963873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:14.963873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:14.963873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:14.963873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:14.964646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:14.964646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:14.964646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:14.964646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:14.964646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:14.964646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:14.964646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:14.964646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:14.964646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:14.964646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:14.964646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:14.964646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:49:14.967819 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 73/153] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:14.968874 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21747a6-b23e-4ae8-899f-ce1c74812fa4 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:15.020256 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c7f2a-ae32-4a6e-9fb6-0ba268ab6870 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:15.060354 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a92af-140d-4b0a-9a4a-351e81cc400a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:15.061219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a92af-140d-4b0a-9a4a-351e81cc400a None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:15.061601 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a92af-140d-4b0a-9a4a-351e81cc400a None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:15.062416 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a92af-140d-4b0a-9a4a-351e81cc400a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:15.075736 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a92af-140d-4b0a-9a4a-351e81cc400a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:15.084810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-716a92af-140d-4b0a-9a4a-351e81cc400a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:49:15.084810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:15.084810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:15.084810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:15.084810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:15.084810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:15.084810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:15.084810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:15.084810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:15.084810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:15.084810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:15.084810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:15.084810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:15.084810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:15.084810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:15.084810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:15.085923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:15.085923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:15.085923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:15.085923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:15.085923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:15.085923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:15.085923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:15.085923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:15.085923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:15.085923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:15.085923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:15.085923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:15.085923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:15.085923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:15.085923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:15.085923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:15.086897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:15.086897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:15.086897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:15.086897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:15.086897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:15.086897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:15.086897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:15.086897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:15.086897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:15.086897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:15.086897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:49:15.086897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:15.088982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 81/154] 10.222.0.73 () {56 vars in 1114 bytes} [Fri May 13 14:49:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:15.090007 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a92af-140d-4b0a-9a4a-351e81cc400a None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:15.111272 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21747a6-b23e-4ae8-899f-ce1c74812fa4 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:15.159089 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681d4b1-a90e-4f1e-9a9d-9608b4e4b132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:15.160331 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681d4b1-a90e-4f1e-9a9d-9608b4e4b132 None admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:15.160800 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681d4b1-a90e-4f1e-9a9d-9608b4e4b132 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:15.161231 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681d4b1-a90e-4f1e-9a9d-9608b4e4b132 None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:15.163034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681d4b1-a90e-4f1e-9a9d-9608b4e4b132 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:15.165114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681d4b1-a90e-4f1e-9a9d-9608b4e4b132 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:15.206352 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 74/155] 10.222.0.73 () {60 vars in 1132 bytes} [Fri May 13 14:49:14 2022] POST /identity/v3/users => generated 283 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:49:15.208076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681d4b1-a90e-4f1e-9a9d-9608b4e4b132 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:15.211118 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a92af-140d-4b0a-9a4a-351e81cc400a None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:15.277142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a053d7-c7c8-4d88-a0ce-6f67bc6f7bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:15.278011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a053d7-c7c8-4d88-a0ce-6f67bc6f7bad None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:15.278329 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a053d7-c7c8-4d88-a0ce-6f67bc6f7bad None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:15.278605 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a053d7-c7c8-4d88-a0ce-6f67bc6f7bad None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:15.279757 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a053d7-c7c8-4d88-a0ce-6f67bc6f7bad None admin] RBAC: Adding query filter params (name=member) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:15.279757 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a053d7-c7c8-4d88-a0ce-6f67bc6f7bad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:15.281309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a053d7-c7c8-4d88-a0ce-6f67bc6f7bad None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:15.301465 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 82/156] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:15.307670 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a053d7-c7c8-4d88-a0ce-6f67bc6f7bad None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:15.355186 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681d4b1-a90e-4f1e-9a9d-9608b4e4b132 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:15.401679 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8ad62-1e13-4d94-bef7-f8bd7ecd70cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:15.402905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8ad62-1e13-4d94-bef7-f8bd7ecd70cf None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:15.403429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8ad62-1e13-4d94-bef7-f8bd7ecd70cf None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:15.404181 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8ad62-1e13-4d94-bef7-f8bd7ecd70cf None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:15.405432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8ad62-1e13-4d94-bef7-f8bd7ecd70cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:15.406748 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8ad62-1e13-4d94-bef7-f8bd7ecd70cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:15.408825 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8ad62-1e13-4d94-bef7-f8bd7ecd70cf None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:15.420398 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 75/157] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:49:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:15.430325 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8ad62-1e13-4d94-bef7-f8bd7ecd70cf None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:15.541262 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a053d7-c7c8-4d88-a0ce-6f67bc6f7bad None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:15.585214 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8ad62-1e13-4d94-bef7-f8bd7ecd70cf None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:15.619034 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a24f0-dbf4-4ab8-87cb-5024a4620522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:15.620567 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a24f0-dbf4-4ab8-87cb-5024a4620522 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:15.621047 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a24f0-dbf4-4ab8-87cb-5024a4620522 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:15.621542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a24f0-dbf4-4ab8-87cb-5024a4620522 None admin] PATH_INFO: `/v3/users/f2a0711bb35944ca87b4e4380659c57f` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:15.623925 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a24f0-dbf4-4ab8-87cb-5024a4620522 None admin] RBAC: Authorizing `identity:get_user(user_id=f2a0711bb35944ca87b4e4380659c57f)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:15.626843 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a24f0-dbf4-4ab8-87cb-5024a4620522 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:15.631061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 83/158] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:15 2022] GET /identity/v3/users/f2a0711bb35944ca87b4e4380659c57f => generated 275 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:15.633624 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb7841-df30-4ed4-af01-ee981aa9089c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:15.637352 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb7841-df30-4ed4-af01-ee981aa9089c None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:15.637352 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb7841-df30-4ed4-af01-ee981aa9089c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:15.637352 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb7841-df30-4ed4-af01-ee981aa9089c None admin] PATH_INFO: `/v3/users/f2a0711bb35944ca87b4e4380659c57f` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:15.638576 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb7841-df30-4ed4-af01-ee981aa9089c None admin] RBAC: Authorizing `identity:get_user(user_id=f2a0711bb35944ca87b4e4380659c57f)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:15.639921 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a24f0-dbf4-4ab8-87cb-5024a4620522 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:15.640325 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb7841-df30-4ed4-af01-ee981aa9089c None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:15.642208 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 76/159] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:15 2022] GET /identity/v3/users/f2a0711bb35944ca87b4e4380659c57f => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:15.648552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb7841-df30-4ed4-af01-ee981aa9089c None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:15.786377 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb7841-df30-4ed4-af01-ee981aa9089c None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:15.834639 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17c7b9-fd60-4aca-9bfc-df6c69e66ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:15.836115 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17c7b9-fd60-4aca-9bfc-df6c69e66ebe None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:15.836838 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17c7b9-fd60-4aca-9bfc-df6c69e66ebe None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:15.837717 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17c7b9-fd60-4aca-9bfc-df6c69e66ebe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:15.842066 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a24f0-dbf4-4ab8-87cb-5024a4620522 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:15.896441 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b260bd1-7dbc-4b9a-800b-926417701d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:15.897136 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b260bd1-7dbc-4b9a-800b-926417701d10 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:15.897423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b260bd1-7dbc-4b9a-800b-926417701d10 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:15.897702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b260bd1-7dbc-4b9a-800b-926417701d10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:16.001642 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b260bd1-7dbc-4b9a-800b-926417701d10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:16.003577 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b260bd1-7dbc-4b9a-800b-926417701d10 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:16.011675 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17c7b9-fd60-4aca-9bfc-df6c69e66ebe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:16.014583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17c7b9-fd60-4aca-9bfc-df6c69e66ebe None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:16.167311 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 84/160] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:49:16.168111 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80747a3-b1a4-4975-8cca-010ca59b23bf None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:16.168409 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80747a3-b1a4-4975-8cca-010ca59b23bf None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:16.168676 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80747a3-b1a4-4975-8cca-010ca59b23bf None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:16.170027 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 85/161] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:16.173244 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b01f23-213e-4b54-9eca-df20a10df415 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:16.173833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b01f23-213e-4b54-9eca-df20a10df415 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:16.174406 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b01f23-213e-4b54-9eca-df20a10df415 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:16.176078 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 86/162] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:16.182855 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b01f23-213e-4b54-9eca-df20a10df415 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:16.203194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 77/163] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:49:16.204307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728019d-cba1-46b8-b424-224e83c4efa4 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:16.204588 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728019d-cba1-46b8-b424-224e83c4efa4 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:16.204861 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728019d-cba1-46b8-b424-224e83c4efa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:16.231197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-8728019d-cba1-46b8-b424-224e83c4efa4 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:16.233774 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-8728019d-cba1-46b8-b424-224e83c4efa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:16.340947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 78/164] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:16.342268 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98113e2f-df43-458f-8c9c-f9ad2cdcb285 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:16.342549 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98113e2f-df43-458f-8c9c-f9ad2cdcb285 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:16.342840 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98113e2f-df43-458f-8c9c-f9ad2cdcb285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:16.346074 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b01f23-213e-4b54-9eca-df20a10df415 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:16.375177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-98113e2f-df43-458f-8c9c-f9ad2cdcb285 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:16.376420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-98113e2f-df43-458f-8c9c-f9ad2cdcb285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:16.395493 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c0bbf-ae6e-433e-944d-ecd28974dae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:16.396904 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c0bbf-ae6e-433e-944d-ecd28974dae7 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:16.397375 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c0bbf-ae6e-433e-944d-ecd28974dae7 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:16.397982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c0bbf-ae6e-433e-944d-ecd28974dae7 None admin] PATH_INFO: `/v3/projects/846d89c30b0243e0866cdb16fe599ec6` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:16.400580 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c0bbf-ae6e-433e-944d-ecd28974dae7 None admin] RBAC: Authorizing `identity:get_project(project_id=846d89c30b0243e0866cdb16fe599ec6)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:16.402640 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c0bbf-ae6e-433e-944d-ecd28974dae7 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:16.405355 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 87/165] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:16 2022] GET /identity/v3/projects/846d89c30b0243e0866cdb16fe599ec6 => generated 312 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:16.406418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c0bbf-ae6e-433e-944d-ecd28974dae7 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:16.473614 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 79/166] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:16.474479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98113e2f-df43-458f-8c9c-f9ad2cdcb285 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:16.573128 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c0bbf-ae6e-433e-944d-ecd28974dae7 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:16.643150 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e64c6-48a7-4a04-8c40-a9021effcbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:16.645542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e64c6-48a7-4a04-8c40-a9021effcbcd None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:16.646198 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e64c6-48a7-4a04-8c40-a9021effcbcd None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:16.647601 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e64c6-48a7-4a04-8c40-a9021effcbcd None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:16.650231 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e64c6-48a7-4a04-8c40-a9021effcbcd None admin] RBAC: Authorizing `identity:get_project(project_id=04114986615247c2bbac8845c3c3a8e7)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:16.652713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e64c6-48a7-4a04-8c40-a9021effcbcd None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:16.655774 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 88/167] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:16 2022] GET /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:16.658132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e64c6-48a7-4a04-8c40-a9021effcbcd None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:16.668920 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98113e2f-df43-458f-8c9c-f9ad2cdcb285 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:16.739738 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49875a8b-c44e-4ec6-8d12-d0cf183d6225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:16.740885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49875a8b-c44e-4ec6-8d12-d0cf183d6225 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:16.741373 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49875a8b-c44e-4ec6-8d12-d0cf183d6225 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:16.741869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49875a8b-c44e-4ec6-8d12-d0cf183d6225 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:16.763012 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49875a8b-c44e-4ec6-8d12-d0cf183d6225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:16.780439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-49875a8b-c44e-4ec6-8d12-d0cf183d6225 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:49:16.780439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:16.780439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:16.780439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:16.780439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:16.780439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:16.780439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:16.780439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:16.780439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:16.780439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:16.780439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:16.780439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:16.780439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:16.780439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:16.780439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:16.780439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:16.781557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:16.781557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:16.781557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:16.781557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:16.781557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:16.781557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:16.781557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:16.781557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:16.781557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:16.781557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:16.781557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:16.781557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:49:16.781557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:16.781557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:16.781557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:16.781557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:16.782420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:16.782420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:16.782420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:16.782420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:16.782420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:16.782420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:16.782420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:16.782420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:16.782420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:16.782420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:16.782420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:49:16.782420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:49:16.785592 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 80/168] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:16.787778 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49875a8b-c44e-4ec6-8d12-d0cf183d6225 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:16.873272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e64c6-48a7-4a04-8c40-a9021effcbcd None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:17.002370 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0886c-2e17-4844-abf6-483719bcfb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:17.003499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0886c-2e17-4844-abf6-483719bcfb94 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:17.004013 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0886c-2e17-4844-abf6-483719bcfb94 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:17.004524 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0886c-2e17-4844-abf6-483719bcfb94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:17.006226 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0886c-2e17-4844-abf6-483719bcfb94 None admin] RBAC: Adding query filter params (role.id=0268e6ac6fb649eb89da825c5ae328ab, scope.project.id=846d89c30b0243e0866cdb16fe599ec6, user.id=f2a0711bb35944ca87b4e4380659c57f) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:17.006807 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0886c-2e17-4844-abf6-483719bcfb94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:17.013161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0886c-2e17-4844-abf6-483719bcfb94 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:17.021854 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49875a8b-c44e-4ec6-8d12-d0cf183d6225 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:17.035146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 89/169] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:49:16 2022] GET /identity/v3/role_assignments?user.id=f2a0711bb35944ca87b4e4380659c57f&scope.project.id=846d89c30b0243e0866cdb16fe599ec6&role.id=0268e6ac6fb649eb89da825c5ae328ab => generated 608 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:17.036013 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0886c-2e17-4844-abf6-483719bcfb94 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:17.110344 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cbc7a-9324-4467-81d8-f40c037a5bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:17.112102 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cbc7a-9324-4467-81d8-f40c037a5bc3 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:17.112420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cbc7a-9324-4467-81d8-f40c037a5bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:17.112752 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cbc7a-9324-4467-81d8-f40c037a5bc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:17.144060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cbc7a-9324-4467-81d8-f40c037a5bc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:17.157583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-2e8cbc7a-9324-4467-81d8-f40c037a5bc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:49:17.157583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:17.157583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:17.157583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:17.157583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:17.157583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:17.157583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:17.157583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:17.157583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:17.157583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:17.157583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:17.157583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:17.157583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:17.157583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:17.157583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:17.157583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:17.158552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:17.158552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:17.158552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:17.158552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:17.158552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:17.158552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:17.158552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:17.158552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:17.158552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:17.158552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:17.158552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:17.158552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:49:17.158552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:17.158552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:17.158552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:17.158552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:17.159384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:17.159384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:17.159384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:17.159384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:17.159384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:17.159384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:17.159384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:17.159384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:17.159384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:17.159384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:17.159384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:49:17.159384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:49:17.159384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 81/170] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:49:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:17.160218 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cbc7a-9324-4467-81d8-f40c037a5bc3 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:17.435293 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cbc7a-9324-4467-81d8-f40c037a5bc3 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:17.437114 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0886c-2e17-4844-abf6-483719bcfb94 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:17.532261 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84943b0-7e5f-4846-8911-45f89d4eaec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:17.533445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84943b0-7e5f-4846-8911-45f89d4eaec1 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:17.533926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84943b0-7e5f-4846-8911-45f89d4eaec1 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:17.534432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84943b0-7e5f-4846-8911-45f89d4eaec1 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:17.535553 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4ef8e-0e8c-4185-a1fb-234983e196d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:17.535936 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84943b0-7e5f-4846-8911-45f89d4eaec1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:17.536489 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84943b0-7e5f-4846-8911-45f89d4eaec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:17.537006 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4ef8e-0e8c-4185-a1fb-234983e196d1 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:17.537507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4ef8e-0e8c-4185-a1fb-234983e196d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:17.537983 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4ef8e-0e8c-4185-a1fb-234983e196d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:17.539082 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4ef8e-0e8c-4185-a1fb-234983e196d1 None admin] RBAC: Adding query filter params (role.id=0a8d21e5149c42a8b85ca3c0258538d4, scope.project.id=04114986615247c2bbac8845c3c3a8e7, user.id=f2a0711bb35944ca87b4e4380659c57f) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:17.539195 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84943b0-7e5f-4846-8911-45f89d4eaec1 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:17.539723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4ef8e-0e8c-4185-a1fb-234983e196d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:17.541623 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4ef8e-0e8c-4185-a1fb-234983e196d1 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:17.553452 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 90/171] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:49:17 2022] GET /identity/v3/role_assignments?user.id=f2a0711bb35944ca87b4e4380659c57f&scope.project.id=04114986615247c2bbac8845c3c3a8e7&role.id=0a8d21e5149c42a8b85ca3c0258538d4 => generated 608 bytes in 518 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:17.554663 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4ef8e-0e8c-4185-a1fb-234983e196d1 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:17.564091 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 82/172] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:17.571123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84943b0-7e5f-4846-8911-45f89d4eaec1 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:17.741943 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4ef8e-0e8c-4185-a1fb-234983e196d1 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:17.805320 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84943b0-7e5f-4846-8911-45f89d4eaec1 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:17.820124 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79aaab4-d191-43eb-a691-fe32e725919b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:17.821344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79aaab4-d191-43eb-a691-fe32e725919b None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:17.822379 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79aaab4-d191-43eb-a691-fe32e725919b None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:17.822904 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79aaab4-d191-43eb-a691-fe32e725919b None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:17.824357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79aaab4-d191-43eb-a691-fe32e725919b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:17.824897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79aaab4-d191-43eb-a691-fe32e725919b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:17.827608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79aaab4-d191-43eb-a691-fe32e725919b None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:17.856259 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 91/173] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:17.862942 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79aaab4-d191-43eb-a691-fe32e725919b None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:17.884731 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fddb51-edf3-4233-a7e2-e2e092746e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:17.888124 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fddb51-edf3-4233-a7e2-e2e092746e00 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:17.888124 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fddb51-edf3-4233-a7e2-e2e092746e00 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:17.888124 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fddb51-edf3-4233-a7e2-e2e092746e00 None admin] PATH_INFO: `/v3/users/24fa92078ef74317af703e412b13932e` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:17.889653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fddb51-edf3-4233-a7e2-e2e092746e00 None admin] RBAC: Authorizing `identity:get_user(user_id=24fa92078ef74317af703e412b13932e)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:17.894876 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fddb51-edf3-4233-a7e2-e2e092746e00 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:17.895779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 83/174] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:17 2022] GET /identity/v3/users/24fa92078ef74317af703e412b13932e => generated 289 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:17.901387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fddb51-edf3-4233-a7e2-e2e092746e00 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:18.047871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79aaab4-d191-43eb-a691-fe32e725919b None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:18.120899 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1dedb-26d6-40ac-bcc3-5c1200015f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:18.122469 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1dedb-26d6-40ac-bcc3-5c1200015f93 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:18.123018 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1dedb-26d6-40ac-bcc3-5c1200015f93 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:18.123509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1dedb-26d6-40ac-bcc3-5c1200015f93 None admin] PATH_INFO: `/v3/users/f5d162836f3c43f6919175fd34ffcf36` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:18.128211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1dedb-26d6-40ac-bcc3-5c1200015f93 None admin] RBAC: Authorizing `identity:get_user(user_id=f5d162836f3c43f6919175fd34ffcf36)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:18.131028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1dedb-26d6-40ac-bcc3-5c1200015f93 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:18.137069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 92/175] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:17 2022] GET /identity/v3/users/f5d162836f3c43f6919175fd34ffcf36 => generated 247 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:18.147708 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fddb51-edf3-4233-a7e2-e2e092746e00 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:18.148516 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1dedb-26d6-40ac-bcc3-5c1200015f93 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:18.205923 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c98fe5-078c-45dd-8162-6ec8af18192d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:18.206455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c98fe5-078c-45dd-8162-6ec8af18192d None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:18.206739 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c98fe5-078c-45dd-8162-6ec8af18192d None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:18.207102 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c98fe5-078c-45dd-8162-6ec8af18192d None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:18.208577 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c98fe5-078c-45dd-8162-6ec8af18192d None admin] RBAC: Authorizing `identity:get_project(project_id=04114986615247c2bbac8845c3c3a8e7)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:18.210145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c98fe5-078c-45dd-8162-6ec8af18192d None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:18.212675 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 84/176] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:17 2022] GET /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:18.219061 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c98fe5-078c-45dd-8162-6ec8af18192d None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:18.391522 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1dedb-26d6-40ac-bcc3-5c1200015f93 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:18.471582 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051babe7-495a-433f-9afd-5e7c97910788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:18.472625 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051babe7-495a-433f-9afd-5e7c97910788 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:18.473113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051babe7-495a-433f-9afd-5e7c97910788 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:18.473594 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051babe7-495a-433f-9afd-5e7c97910788 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:18.504070 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c98fe5-078c-45dd-8162-6ec8af18192d None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:18.610165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65883b1d-c656-4558-b310-15c0dc20e4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:18.611489 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65883b1d-c656-4558-b310-15c0dc20e4e5 None admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:18.611977 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65883b1d-c656-4558-b310-15c0dc20e4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:18.612452 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65883b1d-c656-4558-b310-15c0dc20e4e5 None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7/users/24fa92078ef74317af703e412b13932e/roles/8a5dc4dc644046d487fb9977cd999599` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:18.620475 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65883b1d-c656-4558-b310-15c0dc20e4e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=04114986615247c2bbac8845c3c3a8e7, user_id=24fa92078ef74317af703e412b13932e, role_id=8a5dc4dc644046d487fb9977cd999599)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:18.622336 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65883b1d-c656-4558-b310-15c0dc20e4e5 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:18.645446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 85/177] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:49:18 2022] PUT /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7/users/24fa92078ef74317af703e412b13932e/roles/8a5dc4dc644046d487fb9977cd999599 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:49:18.649599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051babe7-495a-433f-9afd-5e7c97910788 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:18.652653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051babe7-495a-433f-9afd-5e7c97910788 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:18.855796 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 93/178] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:49:18.861605 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65883b1d-c656-4558-b310-15c0dc20e4e5 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:19.120177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65883b1d-c656-4558-b310-15c0dc20e4e5 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:19.205789 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5c87c-c8c0-4b70-bfbe-71108a102b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:19.207331 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5c87c-c8c0-4b70-bfbe-71108a102b59 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:19.207845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5c87c-c8c0-4b70-bfbe-71108a102b59 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:19.208238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5c87c-c8c0-4b70-bfbe-71108a102b59 None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:19.210442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5c87c-c8c0-4b70-bfbe-71108a102b59 None admin] RBAC: Authorizing `identity:get_project(project_id=04114986615247c2bbac8845c3c3a8e7)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:19.213459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5c87c-c8c0-4b70-bfbe-71108a102b59 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:19.217024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 86/179] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:18 2022] GET /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7 => generated 298 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:19.223921 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051babe7-495a-433f-9afd-5e7c97910788 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:19.320423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db07c9-8c40-47f9-ad4f-6a894d10b216 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:19.320924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db07c9-8c40-47f9-ad4f-6a894d10b216 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:19.321938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db07c9-8c40-47f9-ad4f-6a894d10b216 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:19.324587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 87/180] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:19.331356 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a3b4f-5f87-410b-bf62-7f5b264417d7 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:19.331749 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a3b4f-5f87-410b-bf62-7f5b264417d7 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:19.332183 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a3b4f-5f87-410b-bf62-7f5b264417d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:19.386141 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-640a3b4f-5f87-410b-bf62-7f5b264417d7 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:19.387613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-640a3b4f-5f87-410b-bf62-7f5b264417d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:19.420804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051babe7-495a-433f-9afd-5e7c97910788 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:19.472328 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4456ee-b8ca-4387-87ec-37faaa910b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:19.473357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4456ee-b8ca-4387-87ec-37faaa910b8c None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:19.473954 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4456ee-b8ca-4387-87ec-37faaa910b8c None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:19.474467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4456ee-b8ca-4387-87ec-37faaa910b8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:19.475556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4456ee-b8ca-4387-87ec-37faaa910b8c None admin] RBAC: Adding query filter params (role.id=b6fbf976763d4795afbfb53a09ec6f6c, scope.project.id=04114986615247c2bbac8845c3c3a8e7, user.id=f5d162836f3c43f6919175fd34ffcf36) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:19.476080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4456ee-b8ca-4387-87ec-37faaa910b8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:19.478398 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4456ee-b8ca-4387-87ec-37faaa910b8c None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:19.486073 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 94/181] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:49:19 2022] GET /identity/v3/role_assignments?user.id=f5d162836f3c43f6919175fd34ffcf36&scope.project.id=04114986615247c2bbac8845c3c3a8e7&role.id=b6fbf976763d4795afbfb53a09ec6f6c => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:19.494352 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44d946-ea6a-49a7-a17b-333877fb9dfe None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:19.495028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44d946-ea6a-49a7-a17b-333877fb9dfe None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:19.495514 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44d946-ea6a-49a7-a17b-333877fb9dfe None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:19.497249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 95/182] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:49:19.503520 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04a9e8-ba07-49e9-a472-8bf53c21c179 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:19.504186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04a9e8-ba07-49e9-a472-8bf53c21c179 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:19.504702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04a9e8-ba07-49e9-a472-8bf53c21c179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:19.527529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-6d04a9e8-ba07-49e9-a472-8bf53c21c179 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:19.529502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6d04a9e8-ba07-49e9-a472-8bf53c21c179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:19.575623 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 88/183] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:49:19.613744 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a3b4f-5f87-410b-bf62-7f5b264417d7 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:19.624999 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 96/184] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:49:19.677547 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04a9e8-ba07-49e9-a472-8bf53c21c179 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:19.833932 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a3b4f-5f87-410b-bf62-7f5b264417d7 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:19.869774 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04a9e8-ba07-49e9-a472-8bf53c21c179 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:19.913808 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b34552-151f-428f-82a4-7e69d27873a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:19.914677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b34552-151f-428f-82a4-7e69d27873a4 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:19.915719 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b34552-151f-428f-82a4-7e69d27873a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:19.916013 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b34552-151f-428f-82a4-7e69d27873a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:19.917926 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b34552-151f-428f-82a4-7e69d27873a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:19.918496 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e755b-7c51-49e7-9b0d-77accc072291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:19.919468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b34552-151f-428f-82a4-7e69d27873a4 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:19.920397 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e755b-7c51-49e7-9b0d-77accc072291 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:19.921092 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e755b-7c51-49e7-9b0d-77accc072291 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:19.921244 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 97/185] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:49:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:19.921944 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e755b-7c51-49e7-9b0d-77accc072291 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:19.922539 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccbdb9-82c5-41ce-b683-db63f6a82ccf None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:19.922845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccbdb9-82c5-41ce-b683-db63f6a82ccf None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:19.923144 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccbdb9-82c5-41ce-b683-db63f6a82ccf None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:19.924878 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 98/186] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:19.930308 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccbdb9-82c5-41ce-b683-db63f6a82ccf None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:19.940686 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e755b-7c51-49e7-9b0d-77accc072291 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:19.949270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-cd1e755b-7c51-49e7-9b0d-77accc072291 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:49:19.949270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:19.949270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:19.949270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:19.949270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:19.949270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:19.949270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:19.949270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:19.949270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:19.949270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:19.949270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:19.949270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:19.949270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:19.949270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:19.949270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:19.949270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:19.950498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:19.950498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:19.950498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:19.950498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:19.950498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:19.950498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:19.950498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:19.950498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:19.950498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:19.950498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:19.950498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:19.950498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:49:19.950498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:19.950498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:19.950498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:19.950498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:19.951448 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:19.951448 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:19.951448 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:19.951448 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:19.951448 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:19.951448 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:19.951448 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:19.951448 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:19.951448 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:19.951448 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:19.951448 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:49:19.951448 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:49:19.951448 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 89/187] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:49:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:49:19.952191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9d07a-752e-4f1b-9bf5-cc0d39867789 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:19.952191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9d07a-752e-4f1b-9bf5-cc0d39867789 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:19.952414 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9d07a-752e-4f1b-9bf5-cc0d39867789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:19.972779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-82f9d07a-752e-4f1b-9bf5-cc0d39867789 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:19.974440 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-82f9d07a-752e-4f1b-9bf5-cc0d39867789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:20.067364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccbdb9-82c5-41ce-b683-db63f6a82ccf None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:20.071912 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 90/188] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:20.073357 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9d07a-752e-4f1b-9bf5-cc0d39867789 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:20.109159 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b882c-ed6e-4634-8d49-78b371dd649c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:20.109906 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b882c-ed6e-4634-8d49-78b371dd649c None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:20.110182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b882c-ed6e-4634-8d49-78b371dd649c None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:20.110453 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b882c-ed6e-4634-8d49-78b371dd649c None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:20.111223 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b882c-ed6e-4634-8d49-78b371dd649c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:20.112797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b882c-ed6e-4634-8d49-78b371dd649c None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:20.142869 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 99/189] 10.222.0.73 () {60 vars in 1132 bytes} [Fri May 13 14:49:19 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:49:20.142869 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b882c-ed6e-4634-8d49-78b371dd649c None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:20.267591 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9d07a-752e-4f1b-9bf5-cc0d39867789 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:20.331428 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40822300-bf18-4e62-a90d-791bb2bed20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:20.332712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40822300-bf18-4e62-a90d-791bb2bed20d None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:20.333256 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40822300-bf18-4e62-a90d-791bb2bed20d None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:20.333770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40822300-bf18-4e62-a90d-791bb2bed20d None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:20.335198 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40822300-bf18-4e62-a90d-791bb2bed20d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:20.335929 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40822300-bf18-4e62-a90d-791bb2bed20d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:20.339231 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40822300-bf18-4e62-a90d-791bb2bed20d None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:20.353271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b882c-ed6e-4634-8d49-78b371dd649c None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:20.355058 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 91/190] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:20.361610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40822300-bf18-4e62-a90d-791bb2bed20d None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:20.421001 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ade2d-d430-47b2-9aef-4d06b25b48e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:20.422744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ade2d-d430-47b2-9aef-4d06b25b48e2 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:20.423631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ade2d-d430-47b2-9aef-4d06b25b48e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:20.424136 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ade2d-d430-47b2-9aef-4d06b25b48e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:20.442306 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ade2d-d430-47b2-9aef-4d06b25b48e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:20.453498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-b29ade2d-d430-47b2-9aef-4d06b25b48e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:49:20.453498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:20.453498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:20.453498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:20.453498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:20.453498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:20.453498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:20.453498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:20.453498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:20.453498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:20.453498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:20.453498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:20.453498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:20.453498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:20.453498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:20.453498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:20.455269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:20.455269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:20.455269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:20.455269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:20.455269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:20.455269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:20.455269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:20.455269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:20.455269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:20.455269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:20.455269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:20.455269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:20.455269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:20.455269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:20.455269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:20.455269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:20.456506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:20.456506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:20.456506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:20.456506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:20.456506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:20.456506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:20.456506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:20.456506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:20.456506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:20.456506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:20.456506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:49:20.456506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:20.458457 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 100/191] 10.222.0.73 () {56 vars in 1114 bytes} [Fri May 13 14:49:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:20.462121 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ade2d-d430-47b2-9aef-4d06b25b48e2 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:20.548158 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40822300-bf18-4e62-a90d-791bb2bed20d None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:20.604577 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ade2d-d430-47b2-9aef-4d06b25b48e2 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:20.609343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb70607-200f-41b9-9b34-bf7776a3d60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:20.611726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb70607-200f-41b9-9b34-bf7776a3d60c None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:20.612445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb70607-200f-41b9-9b34-bf7776a3d60c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:20.613153 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb70607-200f-41b9-9b34-bf7776a3d60c None admin] PATH_INFO: `/v3/users/f90312df06bb414baf6437907e4d720c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:20.638739 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb70607-200f-41b9-9b34-bf7776a3d60c None admin] RBAC: Authorizing `identity:get_user(user_id=f90312df06bb414baf6437907e4d720c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:20.641725 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb70607-200f-41b9-9b34-bf7776a3d60c None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:20.645558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 92/192] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:20 2022] GET /identity/v3/users/f90312df06bb414baf6437907e4d720c => generated 283 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:20.654665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb70607-200f-41b9-9b34-bf7776a3d60c None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:20.656028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b64a34-fe10-4f20-a04d-e834b00bd853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:20.656783 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b64a34-fe10-4f20-a04d-e834b00bd853 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:20.657063 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b64a34-fe10-4f20-a04d-e834b00bd853 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:20.657386 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b64a34-fe10-4f20-a04d-e834b00bd853 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:20.658167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b64a34-fe10-4f20-a04d-e834b00bd853 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:20.658477 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b64a34-fe10-4f20-a04d-e834b00bd853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:20.659931 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b64a34-fe10-4f20-a04d-e834b00bd853 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:20.672187 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 101/193] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:49:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:20.682687 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b64a34-fe10-4f20-a04d-e834b00bd853 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:20.863342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b64a34-fe10-4f20-a04d-e834b00bd853 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:20.866173 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb70607-200f-41b9-9b34-bf7776a3d60c None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:20.930418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7f575-4c03-4eb5-b0fb-be32c3b970be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:20.932904 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7f575-4c03-4eb5-b0fb-be32c3b970be None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:20.933727 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7f575-4c03-4eb5-b0fb-be32c3b970be None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:20.934459 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7f575-4c03-4eb5-b0fb-be32c3b970be None admin] PATH_INFO: `/v3/users/f90312df06bb414baf6437907e4d720c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:20.937128 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7f575-4c03-4eb5-b0fb-be32c3b970be None admin] RBAC: Authorizing `identity:get_user(user_id=f90312df06bb414baf6437907e4d720c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:20.940168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7f575-4c03-4eb5-b0fb-be32c3b970be None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:20.944166 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 102/194] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:20 2022] GET /identity/v3/users/f90312df06bb414baf6437907e4d720c => generated 283 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:20.950466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693434b3-6f8b-43f0-bc2a-0288540a8cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:20.950466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693434b3-6f8b-43f0-bc2a-0288540a8cd8 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:20.950466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693434b3-6f8b-43f0-bc2a-0288540a8cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:20.950466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693434b3-6f8b-43f0-bc2a-0288540a8cd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:20.952678 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7f575-4c03-4eb5-b0fb-be32c3b970be None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:21.187627 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7f575-4c03-4eb5-b0fb-be32c3b970be None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:21.188709 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693434b3-6f8b-43f0-bc2a-0288540a8cd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:21.191430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693434b3-6f8b-43f0-bc2a-0288540a8cd8 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:21.266545 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642187b0-86f9-4ae9-9736-115eb1124cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:21.268044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642187b0-86f9-4ae9-9736-115eb1124cf6 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:21.268735 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642187b0-86f9-4ae9-9736-115eb1124cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:21.269406 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642187b0-86f9-4ae9-9736-115eb1124cf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:21.442400 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 93/195] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 788 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:49:21.450989 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693434b3-6f8b-43f0-bc2a-0288540a8cd8 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:21.504200 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642187b0-86f9-4ae9-9736-115eb1124cf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:21.514246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642187b0-86f9-4ae9-9736-115eb1124cf6 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:21.685943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693434b3-6f8b-43f0-bc2a-0288540a8cd8 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:21.756216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa92c04-f84b-4800-9f52-5339dadf904c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:21.757001 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa92c04-f84b-4800-9f52-5339dadf904c None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:21.757275 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa92c04-f84b-4800-9f52-5339dadf904c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:21.757542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa92c04-f84b-4800-9f52-5339dadf904c None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:21.761555 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa92c04-f84b-4800-9f52-5339dadf904c None admin] RBAC: Authorizing `identity:get_project(project_id=5f5a44d5fda44f2586666bd534a896a4)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:21.763084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa92c04-f84b-4800-9f52-5339dadf904c None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:21.765162 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 94/196] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:21 2022] GET /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4 => generated 302 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:21.773951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa92c04-f84b-4800-9f52-5339dadf904c None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:21.815126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 103/197] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 863 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:49:21.825247 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642187b0-86f9-4ae9-9736-115eb1124cf6 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:22.023511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa92c04-f84b-4800-9f52-5339dadf904c None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:22.081344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642187b0-86f9-4ae9-9736-115eb1124cf6 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:22.148664 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0fdf3-12bf-4f9d-9559-821fec034d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:22.150723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0fdf3-12bf-4f9d-9559-821fec034d50 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:22.151248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0fdf3-12bf-4f9d-9559-821fec034d50 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:22.151729 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0fdf3-12bf-4f9d-9559-821fec034d50 None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:22.153854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0fdf3-12bf-4f9d-9559-821fec034d50 None admin] RBAC: Authorizing `identity:get_project(project_id=5f5a44d5fda44f2586666bd534a896a4)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:22.155222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e8083-8ba9-4b3e-8441-e7b252406699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:22.156629 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0fdf3-12bf-4f9d-9559-821fec034d50 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:22.156798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e8083-8ba9-4b3e-8441-e7b252406699 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:22.157523 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e8083-8ba9-4b3e-8441-e7b252406699 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:22.158262 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e8083-8ba9-4b3e-8441-e7b252406699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:22.160168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 104/198] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:21 2022] GET /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4 => generated 302 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:22.160786 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e8083-8ba9-4b3e-8441-e7b252406699 None admin] RBAC: Adding query filter params (role.id=b6fbf976763d4795afbfb53a09ec6f6c, scope.project.id=5f5a44d5fda44f2586666bd534a896a4, user.id=f90312df06bb414baf6437907e4d720c) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:22.161570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e8083-8ba9-4b3e-8441-e7b252406699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:22.170851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e8083-8ba9-4b3e-8441-e7b252406699 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:22.171131 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0fdf3-12bf-4f9d-9559-821fec034d50 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:22.190860 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 95/199] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:49:21 2022] GET /identity/v3/role_assignments?user.id=f90312df06bb414baf6437907e4d720c&scope.project.id=5f5a44d5fda44f2586666bd534a896a4&role.id=b6fbf976763d4795afbfb53a09ec6f6c => generated 259 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:22.376047 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0fdf3-12bf-4f9d-9559-821fec034d50 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:22.441798 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f88e6a-8ce9-4557-aea1-201daf2b7313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:22.443161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f88e6a-8ce9-4557-aea1-201daf2b7313 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:22.443608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f88e6a-8ce9-4557-aea1-201daf2b7313 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:22.444053 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f88e6a-8ce9-4557-aea1-201daf2b7313 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:22.445601 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f88e6a-8ce9-4557-aea1-201daf2b7313 None admin] RBAC: Adding query filter params (role.id=0a8d21e5149c42a8b85ca3c0258538d4, scope.project.id=5f5a44d5fda44f2586666bd534a896a4, user.id=f90312df06bb414baf6437907e4d720c) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:22.446110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f88e6a-8ce9-4557-aea1-201daf2b7313 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:22.448948 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f88e6a-8ce9-4557-aea1-201daf2b7313 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:22.459750 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 105/200] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:49:22 2022] GET /identity/v3/role_assignments?user.id=f90312df06bb414baf6437907e4d720c&scope.project.id=5f5a44d5fda44f2586666bd534a896a4&role.id=0a8d21e5149c42a8b85ca3c0258538d4 => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:22.636847 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969d1a4-0c24-40e0-985e-8fedab1d9118 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:22.637312 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969d1a4-0c24-40e0-985e-8fedab1d9118 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:22.637632 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969d1a4-0c24-40e0-985e-8fedab1d9118 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:22.639648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 96/201] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:22.651159 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b71013-bb42-4379-8734-e8cbf01e6ea8 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:22.651901 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b71013-bb42-4379-8734-e8cbf01e6ea8 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:22.652212 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b71013-bb42-4379-8734-e8cbf01e6ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:22.682991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-27b71013-bb42-4379-8734-e8cbf01e6ea8 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:22.685100 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-27b71013-bb42-4379-8734-e8cbf01e6ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:22.831078 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 106/202] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:22.867740 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969d1a4-0c24-40e0-985e-8fedab1d9118 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:23.105648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969d1a4-0c24-40e0-985e-8fedab1d9118 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:23.195855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f768088-b97b-48fe-bcf7-800639cb0685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:23.197648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f768088-b97b-48fe-bcf7-800639cb0685 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:23.198159 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f768088-b97b-48fe-bcf7-800639cb0685 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:23.198664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f768088-b97b-48fe-bcf7-800639cb0685 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:23.224408 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f768088-b97b-48fe-bcf7-800639cb0685 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:23.245265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-8f768088-b97b-48fe-bcf7-800639cb0685 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:49:23.245265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:23.245265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:23.245265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:23.245265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:23.245265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:23.245265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:23.245265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:23.245265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:23.245265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:23.245265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:23.245265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:23.245265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:23.245265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:23.245265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:23.245265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:23.246961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:23.246961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:23.246961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:23.246961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:23.246961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:23.246961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:23.246961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:23.246961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:23.246961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:23.246961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:23.246961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:23.246961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:49:23.246961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:23.246961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:23.246961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:23.246961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:23.248407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:23.248407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:23.248407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:23.248407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:23.248407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:23.248407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:23.248407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:23.248407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:23.248407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:23.248407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:23.248407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:49:23.248407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:49:23.248407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 97/203] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:23.257564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b71013-bb42-4379-8734-e8cbf01e6ea8 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:23.476209 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b71013-bb42-4379-8734-e8cbf01e6ea8 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:23.554617 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6502fb9-cdb2-4133-a39d-58e2ae753232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:23.555349 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6502fb9-cdb2-4133-a39d-58e2ae753232 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:23.555696 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6502fb9-cdb2-4133-a39d-58e2ae753232 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:23.555971 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6502fb9-cdb2-4133-a39d-58e2ae753232 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:23.556741 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6502fb9-cdb2-4133-a39d-58e2ae753232 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:23.557044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6502fb9-cdb2-4133-a39d-58e2ae753232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:23.558490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6502fb9-cdb2-4133-a39d-58e2ae753232 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:23.572297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 107/204] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:23.581802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f768088-b97b-48fe-bcf7-800639cb0685 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:23.880132 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f768088-b97b-48fe-bcf7-800639cb0685 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:23.980007 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45a4a5-4a3d-472f-8457-b40c88957eae None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:23.980851 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45a4a5-4a3d-472f-8457-b40c88957eae None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:23.980851 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45a4a5-4a3d-472f-8457-b40c88957eae None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:23.981115 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd2ca5-ab6e-4cf9-98d1-242dda8b75af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:23.982384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd2ca5-ab6e-4cf9-98d1-242dda8b75af None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:23.982913 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd2ca5-ab6e-4cf9-98d1-242dda8b75af None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:23.983462 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd2ca5-ab6e-4cf9-98d1-242dda8b75af None admin] PATH_INFO: `/v3/users/24fa92078ef74317af703e412b13932e` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:23.983626 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 108/205] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:23.987834 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd2ca5-ab6e-4cf9-98d1-242dda8b75af None admin] RBAC: Authorizing `identity:get_user(user_id=24fa92078ef74317af703e412b13932e)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:23.988200 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196d702-40a3-4c89-8010-633ffeae2b9a None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:23.988485 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196d702-40a3-4c89-8010-633ffeae2b9a None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:23.988732 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196d702-40a3-4c89-8010-633ffeae2b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:23.990661 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd2ca5-ab6e-4cf9-98d1-242dda8b75af None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:23.995268 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 98/206] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:23 2022] GET /identity/v3/users/24fa92078ef74317af703e412b13932e => generated 289 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:24.005516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd2ca5-ab6e-4cf9-98d1-242dda8b75af None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:24.016156 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-f196d702-40a3-4c89-8010-633ffeae2b9a None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:24.017974 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-f196d702-40a3-4c89-8010-633ffeae2b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:24.190137 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 109/207] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:49:24.232170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196d702-40a3-4c89-8010-633ffeae2b9a None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:24.285395 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd2ca5-ab6e-4cf9-98d1-242dda8b75af None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:24.361579 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f96ee-1e24-40c7-ad9e-fc26f58c23ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:24.362688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f96ee-1e24-40c7-ad9e-fc26f58c23ef None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:24.363187 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f96ee-1e24-40c7-ad9e-fc26f58c23ef None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:24.363646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f96ee-1e24-40c7-ad9e-fc26f58c23ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:24.453366 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196d702-40a3-4c89-8010-633ffeae2b9a None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:24.531509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179a041-a6f8-4922-b272-9c6e0125ef8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:24.532891 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179a041-a6f8-4922-b272-9c6e0125ef8b None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:24.533386 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179a041-a6f8-4922-b272-9c6e0125ef8b None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:24.533899 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179a041-a6f8-4922-b272-9c6e0125ef8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:24.539358 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179a041-a6f8-4922-b272-9c6e0125ef8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:24.543941 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179a041-a6f8-4922-b272-9c6e0125ef8b None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:24.548927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 110/208] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:49:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:24.558393 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179a041-a6f8-4922-b272-9c6e0125ef8b None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:24.601883 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f96ee-1e24-40c7-ad9e-fc26f58c23ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:24.603475 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f96ee-1e24-40c7-ad9e-fc26f58c23ef None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:24.792361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 99/209] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 787 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:49:24.793511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43ae84-bb8e-431f-a5cd-199d51b183ce None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:24.793786 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43ae84-bb8e-431f-a5cd-199d51b183ce None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:24.794057 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43ae84-bb8e-431f-a5cd-199d51b183ce None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:24.795836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 100/210] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:24.802944 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e533a-da9d-49ee-9643-9a928ccef8be None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:24.803305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e533a-da9d-49ee-9643-9a928ccef8be None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:24.803592 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e533a-da9d-49ee-9643-9a928ccef8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:24.808221 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179a041-a6f8-4922-b272-9c6e0125ef8b None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:24.821966 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-477e533a-da9d-49ee-9643-9a928ccef8be None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:24.823229 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-477e533a-da9d-49ee-9643-9a928ccef8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:24.872952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df139d-d178-4d4e-9015-28e804679176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:24.874121 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df139d-d178-4d4e-9015-28e804679176 None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:24.874616 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df139d-d178-4d4e-9015-28e804679176 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:24.875151 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df139d-d178-4d4e-9015-28e804679176 None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:24.876524 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df139d-d178-4d4e-9015-28e804679176 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:24.879492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df139d-d178-4d4e-9015-28e804679176 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:24.900892 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 101/211] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:24.903142 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e533a-da9d-49ee-9643-9a928ccef8be None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:24.935838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 111/212] 10.222.0.73 () {60 vars in 1132 bytes} [Fri May 13 14:49:24 2022] POST /identity/v3/users => generated 297 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:49:24.959702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df139d-d178-4d4e-9015-28e804679176 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:25.089166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e533a-da9d-49ee-9643-9a928ccef8be None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:25.143199 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df139d-d178-4d4e-9015-28e804679176 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:25.151853 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb5825-0686-4238-aec9-50d9e9019351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:25.153252 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb5825-0686-4238-aec9-50d9e9019351 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:25.153694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb5825-0686-4238-aec9-50d9e9019351 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:25.154151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb5825-0686-4238-aec9-50d9e9019351 None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:25.163306 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb5825-0686-4238-aec9-50d9e9019351 None admin] RBAC: Authorizing `identity:get_project(project_id=04114986615247c2bbac8845c3c3a8e7)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:25.171991 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb5825-0686-4238-aec9-50d9e9019351 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:25.187190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 102/213] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:24 2022] GET /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:25.188901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb5825-0686-4238-aec9-50d9e9019351 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:25.250470 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1c2fb-b859-4052-8f29-7cf1a634332d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:25.251867 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1c2fb-b859-4052-8f29-7cf1a634332d None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:25.252365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1c2fb-b859-4052-8f29-7cf1a634332d None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:25.252847 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1c2fb-b859-4052-8f29-7cf1a634332d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:25.273442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1c2fb-b859-4052-8f29-7cf1a634332d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:25.289603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-b2a1c2fb-b859-4052-8f29-7cf1a634332d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:25.289603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:25.289603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:25.289603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:25.289603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:25.289603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:25.289603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:25.289603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:25.289603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:25.289603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:25.289603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:25.289603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:25.289603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:25.289603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:25.289603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:25.289603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:25.291992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:25.291992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:25.291992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:25.291992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:25.291992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:25.291992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:25.291992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:25.291992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:25.291992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:25.291992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:25.291992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:25.291992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:25.291992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:25.291992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:25.291992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:25.291992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:25.293552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:25.293552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:25.293552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:25.293552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:25.293552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:25.293552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:25.293552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:25.293552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:25.293552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:25.293552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:25.293552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:25.293552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:25.293552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 112/214] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:49:25.301820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1c2fb-b859-4052-8f29-7cf1a634332d None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:25.498461 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb5825-0686-4238-aec9-50d9e9019351 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:25.502635 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1c2fb-b859-4052-8f29-7cf1a634332d None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:25.582615 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345bca8-dc51-40f6-b579-41c88ab0de6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:25.584099 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345bca8-dc51-40f6-b579-41c88ab0de6b None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:25.584729 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345bca8-dc51-40f6-b579-41c88ab0de6b None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:25.585206 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345bca8-dc51-40f6-b579-41c88ab0de6b None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:25.586766 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345bca8-dc51-40f6-b579-41c88ab0de6b None admin] RBAC: Adding query filter params (name=member) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:25.589621 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345bca8-dc51-40f6-b579-41c88ab0de6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:25.592614 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdd02f-c448-4e58-bf76-51694e7cf3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:25.592823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345bca8-dc51-40f6-b579-41c88ab0de6b None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:25.593753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdd02f-c448-4e58-bf76-51694e7cf3b5 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:25.594250 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdd02f-c448-4e58-bf76-51694e7cf3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:25.594719 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdd02f-c448-4e58-bf76-51694e7cf3b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:25.598989 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdd02f-c448-4e58-bf76-51694e7cf3b5 None admin] RBAC: Adding query filter params (role.id=8a5dc4dc644046d487fb9977cd999599, scope.project.id=04114986615247c2bbac8845c3c3a8e7, user.id=24fa92078ef74317af703e412b13932e) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:25.599715 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdd02f-c448-4e58-bf76-51694e7cf3b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:25.602651 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdd02f-c448-4e58-bf76-51694e7cf3b5 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:25.616434 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 103/215] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:49:25 2022] GET /identity/v3/role_assignments?user.id=24fa92078ef74317af703e412b13932e&scope.project.id=04114986615247c2bbac8845c3c3a8e7&role.id=8a5dc4dc644046d487fb9977cd999599 => generated 608 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:25.621899 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 113/216] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:25.630802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdd02f-c448-4e58-bf76-51694e7cf3b5 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:25.871458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdd02f-c448-4e58-bf76-51694e7cf3b5 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:25.952934 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7c2a9-c4e3-47e3-87e4-425cc7b68a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:25.954366 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7c2a9-c4e3-47e3-87e4-425cc7b68a8b None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:25.954810 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7c2a9-c4e3-47e3-87e4-425cc7b68a8b None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:25.955306 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7c2a9-c4e3-47e3-87e4-425cc7b68a8b None admin] PATH_INFO: `/v3/users/c2f3e8af5cea4849b942cdf9f0752698` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:25.980415 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7c2a9-c4e3-47e3-87e4-425cc7b68a8b None admin] RBAC: Authorizing `identity:get_user(user_id=c2f3e8af5cea4849b942cdf9f0752698)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:25.982926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7c2a9-c4e3-47e3-87e4-425cc7b68a8b None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:25.985643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 104/217] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:25 2022] GET /identity/v3/users/c2f3e8af5cea4849b942cdf9f0752698 => generated 297 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:25.995277 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345bca8-dc51-40f6-b579-41c88ab0de6b None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:26.203136 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345bca8-dc51-40f6-b579-41c88ab0de6b None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:26.283953 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ff528-e3bd-449d-aa56-c77352295f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:26.285039 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ff528-e3bd-449d-aa56-c77352295f24 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:26.285538 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ff528-e3bd-449d-aa56-c77352295f24 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:26.285993 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ff528-e3bd-449d-aa56-c77352295f24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:26.311497 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3d549-ad61-4cf9-b55f-ffc275dc7a7b None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:26.311970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3d549-ad61-4cf9-b55f-ffc275dc7a7b None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:26.312430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3d549-ad61-4cf9-b55f-ffc275dc7a7b None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:26.314946 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 105/218] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:49:26.322018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3ad78-5f1e-462a-a2df-01ba484665ac None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:26.322499 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3ad78-5f1e-462a-a2df-01ba484665ac None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:26.323006 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3ad78-5f1e-462a-a2df-01ba484665ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:26.361564 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-7ce3ad78-5f1e-462a-a2df-01ba484665ac None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:26.363699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-7ce3ad78-5f1e-462a-a2df-01ba484665ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:26.493855 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ff528-e3bd-449d-aa56-c77352295f24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:26.496677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ff528-e3bd-449d-aa56-c77352295f24 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:26.498504 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 106/219] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:49:26.541235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3ad78-5f1e-462a-a2df-01ba484665ac None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:26.746120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 114/220] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 752 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 14:49:26.755565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ff528-e3bd-449d-aa56-c77352295f24 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:26.890282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3ad78-5f1e-462a-a2df-01ba484665ac None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:26.952106 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ff528-e3bd-449d-aa56-c77352295f24 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:26.995616 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356c581-b309-4eff-8169-7146759eecb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:26.996552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356c581-b309-4eff-8169-7146759eecb0 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:26.996774 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356c581-b309-4eff-8169-7146759eecb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:26.997047 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356c581-b309-4eff-8169-7146759eecb0 None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:26.998391 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356c581-b309-4eff-8169-7146759eecb0 None admin] RBAC: Authorizing `identity:get_project(project_id=5f5a44d5fda44f2586666bd534a896a4)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:26.999911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356c581-b309-4eff-8169-7146759eecb0 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:27.002770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 115/221] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:26 2022] GET /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:27.009790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356c581-b309-4eff-8169-7146759eecb0 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:27.022035 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe08bb-e3f5-409f-8905-7aa7ad57bd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:27.023424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe08bb-e3f5-409f-8905-7aa7ad57bd24 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:27.023847 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe08bb-e3f5-409f-8905-7aa7ad57bd24 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:27.024831 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe08bb-e3f5-409f-8905-7aa7ad57bd24 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:27.068667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe08bb-e3f5-409f-8905-7aa7ad57bd24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:27.094018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-c8fe08bb-e3f5-409f-8905-7aa7ad57bd24 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:49:27.094018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:27.094018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:27.094018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:27.094018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:27.094018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:27.094018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:27.094018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:27.094018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:27.094018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:27.094018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:27.094018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:27.094018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:27.094018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:27.094018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:27.094018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:27.095030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:27.095030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:27.095030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:27.095030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:27.095030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:27.095030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:27.095030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:27.095030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:27.095030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:27.095030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:27.095030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:27.095030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:49:27.095030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:27.095030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:27.095030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:27.095030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:27.095815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:27.095815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:27.095815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:27.095815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:27.095815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:27.095815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:27.095815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:27.095815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:27.095815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:27.095815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:27.095815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:49:27.095815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:49:27.108291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 107/222] 10.222.0.73 () {56 vars in 1114 bytes} [Fri May 13 14:49:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 569 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:49:27.115288 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe08bb-e3f5-409f-8905-7aa7ad57bd24 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:27.125183 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356c581-b309-4eff-8169-7146759eecb0 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:27.181090 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49003c04-6e7c-4374-af55-7f91df4ae071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:27.182244 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49003c04-6e7c-4374-af55-7f91df4ae071 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:27.182673 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49003c04-6e7c-4374-af55-7f91df4ae071 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:27.183126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49003c04-6e7c-4374-af55-7f91df4ae071 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:27.184255 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49003c04-6e7c-4374-af55-7f91df4ae071 None admin] RBAC: Adding query filter params (role.id=0268e6ac6fb649eb89da825c5ae328ab, scope.project.id=5f5a44d5fda44f2586666bd534a896a4, user.id=c2f3e8af5cea4849b942cdf9f0752698) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:27.184730 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49003c04-6e7c-4374-af55-7f91df4ae071 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:27.186420 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49003c04-6e7c-4374-af55-7f91df4ae071 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:27.193750 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 116/223] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:49:27 2022] GET /identity/v3/role_assignments?user.id=c2f3e8af5cea4849b942cdf9f0752698&scope.project.id=5f5a44d5fda44f2586666bd534a896a4&role.id=0268e6ac6fb649eb89da825c5ae328ab => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:27.395561 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe08bb-e3f5-409f-8905-7aa7ad57bd24 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:27.438652 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b388a-0d39-4779-9b24-f1f730587cce None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:27.439709 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b388a-0d39-4779-9b24-f1f730587cce None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:27.440715 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b388a-0d39-4779-9b24-f1f730587cce None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:27.443159 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 117/224] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:27.447592 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daedbe-668e-4e8a-aef2-d223bcbf9390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:27.448671 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daedbe-668e-4e8a-aef2-d223bcbf9390 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:27.449229 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daedbe-668e-4e8a-aef2-d223bcbf9390 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:27.451239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718b32b-ac46-4ef9-b79f-ebc7f116322b None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:27.451787 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718b32b-ac46-4ef9-b79f-ebc7f116322b None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:27.452252 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718b32b-ac46-4ef9-b79f-ebc7f116322b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:27.459604 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daedbe-668e-4e8a-aef2-d223bcbf9390 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:27.461158 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2daedbe-668e-4e8a-aef2-d223bcbf9390 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:27.462255 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2daedbe-668e-4e8a-aef2-d223bcbf9390 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:27.465986 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2daedbe-668e-4e8a-aef2-d223bcbf9390 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:27.472348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-0718b32b-ac46-4ef9-b79f-ebc7f116322b None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:27.475171 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-0718b32b-ac46-4ef9-b79f-ebc7f116322b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:27.492859 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 108/225] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:49:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:27.499815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daedbe-668e-4e8a-aef2-d223bcbf9390 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:27.562180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 118/226] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:27.610612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718b32b-ac46-4ef9-b79f-ebc7f116322b None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:27.726930 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daedbe-668e-4e8a-aef2-d223bcbf9390 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:27.767442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718b32b-ac46-4ef9-b79f-ebc7f116322b None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:27.807834 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6415da-576f-44f8-aac0-6d0705d5cc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:27.809209 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6415da-576f-44f8-aac0-6d0705d5cc07 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:27.809713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6415da-576f-44f8-aac0-6d0705d5cc07 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:27.810206 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6415da-576f-44f8-aac0-6d0705d5cc07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:27.824107 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6415da-576f-44f8-aac0-6d0705d5cc07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:27.832316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461ef82-f4a3-4ba6-ad37-446cc4c4d2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:27.833215 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461ef82-f4a3-4ba6-ad37-446cc4c4d2c8 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:27.833493 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461ef82-f4a3-4ba6-ad37-446cc4c4d2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:27.833725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-ee6415da-576f-44f8-aac0-6d0705d5cc07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:49:27.833725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:27.833725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:27.833725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:27.833725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:27.833725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:27.833725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:27.833725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:27.833725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:27.833725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:27.833725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:27.833725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:27.833725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:27.833725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:27.833725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:27.833725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:27.834556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:27.834556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:27.834556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:27.834556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:27.834556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:27.834556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:27.834556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:27.834556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:27.834556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:27.834556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:27.834556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:27.834556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:27.834556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:27.834556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:27.834556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:27.834556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:27.835388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:27.835388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:27.835388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:27.835388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:27.835388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:27.835388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:27.835388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:27.835388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:27.835388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:27.835388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:27.835388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:49:27.835388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:27.835990 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461ef82-f4a3-4ba6-ad37-446cc4c4d2c8 None admin] PATH_INFO: `/v3/users/f90312df06bb414baf6437907e4d720c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:27.838127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461ef82-f4a3-4ba6-ad37-446cc4c4d2c8 None admin] RBAC: Authorizing `identity:get_user(user_id=f90312df06bb414baf6437907e4d720c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:27.838922 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 119/227] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:49:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:49:27.839663 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461ef82-f4a3-4ba6-ad37-446cc4c4d2c8 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:27.841411 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 109/228] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:27 2022] GET /identity/v3/users/f90312df06bb414baf6437907e4d720c => generated 283 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:27.847553 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6415da-576f-44f8-aac0-6d0705d5cc07 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:27.848717 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461ef82-f4a3-4ba6-ad37-446cc4c4d2c8 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:28.037141 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461ef82-f4a3-4ba6-ad37-446cc4c4d2c8 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:28.119815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45aebf9-1e90-4d2e-89a7-034bd8ba60b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:28.121001 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45aebf9-1e90-4d2e-89a7-034bd8ba60b3 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:28.121473 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45aebf9-1e90-4d2e-89a7-034bd8ba60b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:28.121919 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45aebf9-1e90-4d2e-89a7-034bd8ba60b3 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:28.123383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45aebf9-1e90-4d2e-89a7-034bd8ba60b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:28.123911 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45aebf9-1e90-4d2e-89a7-034bd8ba60b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:28.133616 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45aebf9-1e90-4d2e-89a7-034bd8ba60b3 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:28.167821 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 110/229] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:28.177932 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45aebf9-1e90-4d2e-89a7-034bd8ba60b3 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:28.205243 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6415da-576f-44f8-aac0-6d0705d5cc07 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:28.275374 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce690dd-9aab-42b3-810b-f501b9e8d8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:28.277407 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce690dd-9aab-42b3-810b-f501b9e8d8c7 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:28.278070 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce690dd-9aab-42b3-810b-f501b9e8d8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:28.278534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce690dd-9aab-42b3-810b-f501b9e8d8c7 None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:28.280693 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce690dd-9aab-42b3-810b-f501b9e8d8c7 None admin] RBAC: Authorizing `identity:get_project(project_id=5f5a44d5fda44f2586666bd534a896a4)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:28.283636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce690dd-9aab-42b3-810b-f501b9e8d8c7 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:28.286968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 120/230] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:27 2022] GET /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4 => generated 302 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:28.293655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce690dd-9aab-42b3-810b-f501b9e8d8c7 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:28.461320 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45aebf9-1e90-4d2e-89a7-034bd8ba60b3 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:28.538654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c8167-c549-4655-bdb0-bc9f45cb0383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:28.540807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c8167-c549-4655-bdb0-bc9f45cb0383 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:28.541305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c8167-c549-4655-bdb0-bc9f45cb0383 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:28.541794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c8167-c549-4655-bdb0-bc9f45cb0383 None admin] PATH_INFO: `/v3/users/f90312df06bb414baf6437907e4d720c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:28.544099 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c8167-c549-4655-bdb0-bc9f45cb0383 None admin] RBAC: Authorizing `identity:get_user(user_id=f90312df06bb414baf6437907e4d720c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:28.547628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c8167-c549-4655-bdb0-bc9f45cb0383 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:28.551206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 111/231] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:28 2022] GET /identity/v3/users/f90312df06bb414baf6437907e4d720c => generated 283 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:28.560561 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c8167-c549-4655-bdb0-bc9f45cb0383 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:28.573006 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce690dd-9aab-42b3-810b-f501b9e8d8c7 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:28.635020 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d603cc-81c1-4d8d-b6ac-5a329e1294e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:28.636563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d603cc-81c1-4d8d-b6ac-5a329e1294e1 None admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:28.637044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d603cc-81c1-4d8d-b6ac-5a329e1294e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:28.637542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d603cc-81c1-4d8d-b6ac-5a329e1294e1 None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4/users/f90312df06bb414baf6437907e4d720c/roles/0a8d21e5149c42a8b85ca3c0258538d4` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:28.641951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d603cc-81c1-4d8d-b6ac-5a329e1294e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f5a44d5fda44f2586666bd534a896a4, user_id=f90312df06bb414baf6437907e4d720c, role_id=0a8d21e5149c42a8b85ca3c0258538d4)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:28.644819 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d603cc-81c1-4d8d-b6ac-5a329e1294e1 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:28.681873 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 121/232] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:49:28 2022] PUT /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4/users/f90312df06bb414baf6437907e4d720c/roles/0a8d21e5149c42a8b85ca3c0258538d4 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:49:28.818175 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c8167-c549-4655-bdb0-bc9f45cb0383 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:28.887851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e06617-3e54-4ab9-a1ec-afc793b57b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:28.894866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e06617-3e54-4ab9-a1ec-afc793b57b3b None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:28.894866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e06617-3e54-4ab9-a1ec-afc793b57b3b None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:28.894866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e06617-3e54-4ab9-a1ec-afc793b57b3b None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:28.894866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e06617-3e54-4ab9-a1ec-afc793b57b3b None admin] RBAC: Authorizing `identity:get_project(project_id=5f5a44d5fda44f2586666bd534a896a4)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:28.895727 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e06617-3e54-4ab9-a1ec-afc793b57b3b None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:28.899839 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 112/233] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:28 2022] GET /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4 => generated 302 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:28.909576 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d603cc-81c1-4d8d-b6ac-5a329e1294e1 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:29.107616 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d603cc-81c1-4d8d-b6ac-5a329e1294e1 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:29.172759 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b904d-c1cc-4e44-98b9-e01120e31a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:29.174336 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b904d-c1cc-4e44-98b9-e01120e31a70 None admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:29.174850 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b904d-c1cc-4e44-98b9-e01120e31a70 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:29.175341 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b904d-c1cc-4e44-98b9-e01120e31a70 None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4/users/f90312df06bb414baf6437907e4d720c/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:29.179072 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b904d-c1cc-4e44-98b9-e01120e31a70 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f5a44d5fda44f2586666bd534a896a4, user_id=f90312df06bb414baf6437907e4d720c, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:29.182300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b904d-c1cc-4e44-98b9-e01120e31a70 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:29.222181 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 122/234] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:49:28 2022] PUT /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4/users/f90312df06bb414baf6437907e4d720c/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:49:29.469073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057744f9-72cf-4922-a762-880a698ef5f1 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:29.469613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057744f9-72cf-4922-a762-880a698ef5f1 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:29.469926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057744f9-72cf-4922-a762-880a698ef5f1 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:29.473181 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 113/235] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:29.479953 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f96f2f-328a-4438-95b7-1fa85c776e6a None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:29.480460 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f96f2f-328a-4438-95b7-1fa85c776e6a None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:29.481033 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f96f2f-328a-4438-95b7-1fa85c776e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:29.521326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-73f96f2f-328a-4438-95b7-1fa85c776e6a None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:29.523920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-73f96f2f-328a-4438-95b7-1fa85c776e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:29.701539 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 123/236] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:49:29.759591 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057744f9-72cf-4922-a762-880a698ef5f1 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:29.761028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e710-8dc7-46ca-9953-482e7989019f None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:29.761522 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e710-8dc7-46ca-9953-482e7989019f None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:29.762012 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e710-8dc7-46ca-9953-482e7989019f None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:29.764720 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 124/237] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:49:29.784741 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb09c0-48e8-40ca-8d12-8b4fe1babaf9 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:29.785245 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb09c0-48e8-40ca-8d12-8b4fe1babaf9 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:29.785736 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb09c0-48e8-40ca-8d12-8b4fe1babaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:29.835171 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-4bfb09c0-48e8-40ca-8d12-8b4fe1babaf9 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:29.837216 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-4bfb09c0-48e8-40ca-8d12-8b4fe1babaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:29.989560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 125/238] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:30.056670 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb09c0-48e8-40ca-8d12-8b4fe1babaf9 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:30.071612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057744f9-72cf-4922-a762-880a698ef5f1 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:30.176135 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c6110-da5b-4201-bcc3-e8b75536f1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:30.179478 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c6110-da5b-4201-bcc3-e8b75536f1d6 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:30.182479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c6110-da5b-4201-bcc3-e8b75536f1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:30.183261 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c6110-da5b-4201-bcc3-e8b75536f1d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:30.187906 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c6110-da5b-4201-bcc3-e8b75536f1d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:30.191902 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c6110-da5b-4201-bcc3-e8b75536f1d6 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:30.199520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 114/239] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:49:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:30.206317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c6110-da5b-4201-bcc3-e8b75536f1d6 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:30.310040 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb09c0-48e8-40ca-8d12-8b4fe1babaf9 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:30.428951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d12265-d96b-458c-af49-0c5f8dc2a677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:30.429782 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d12265-d96b-458c-af49-0c5f8dc2a677 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:30.430068 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d12265-d96b-458c-af49-0c5f8dc2a677 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:30.430919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d12265-d96b-458c-af49-0c5f8dc2a677 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:30.459975 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d12265-d96b-458c-af49-0c5f8dc2a677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:30.468011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-c7d12265-d96b-458c-af49-0c5f8dc2a677 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:49:30.468011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:30.468011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:30.468011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:30.468011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:30.468011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:30.468011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:30.468011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:30.468011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:30.468011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:30.468011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:30.468011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:30.468011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:30.468011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:30.468011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:30.468011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:30.474269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:30.474269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:30.474269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:30.474269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:30.474269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:30.474269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:30.474269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:30.474269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:30.474269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:30.474269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:30.474269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:30.474269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:30.474269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:30.474269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:30.474269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:30.474269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:30.476132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:30.476132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:30.476132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:30.476132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:30.476132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:30.476132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:30.476132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:30.476132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:30.476132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:30.476132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:30.476132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:49:30.476132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:30.476132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 126/240] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:49:30.503886 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d12265-d96b-458c-af49-0c5f8dc2a677 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:30.510792 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c6110-da5b-4201-bcc3-e8b75536f1d6 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:30.575285 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d472da-daba-4f50-bd21-5515fc074a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:30.576045 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d472da-daba-4f50-bd21-5515fc074a24 None admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:30.576423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d472da-daba-4f50-bd21-5515fc074a24 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:30.576800 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d472da-daba-4f50-bd21-5515fc074a24 None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:30.577626 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d472da-daba-4f50-bd21-5515fc074a24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:30.579245 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d472da-daba-4f50-bd21-5515fc074a24 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:30.606805 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 115/241] 10.222.0.73 () {60 vars in 1132 bytes} [Fri May 13 14:49:30 2022] POST /identity/v3/users => generated 293 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:49:30.608412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18c245-c5c8-47c7-b1af-b65e7794fbd3 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:30.608713 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18c245-c5c8-47c7-b1af-b65e7794fbd3 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:30.609151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18c245-c5c8-47c7-b1af-b65e7794fbd3 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:30.611126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 116/242] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:30.618399 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c2ef9-315a-488a-8d17-b4e5be25897e None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:30.618759 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c2ef9-315a-488a-8d17-b4e5be25897e None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:30.619155 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c2ef9-315a-488a-8d17-b4e5be25897e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:30.649162 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-e58c2ef9-315a-488a-8d17-b4e5be25897e None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:30.652246 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e58c2ef9-315a-488a-8d17-b4e5be25897e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:30.712120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d12265-d96b-458c-af49-0c5f8dc2a677 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:30.769008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 117/243] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:49:30.781283 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc0bd1-8837-4e06-8312-8831bf7612e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:30.782895 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc0bd1-8837-4e06-8312-8831bf7612e1 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:30.783664 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc0bd1-8837-4e06-8312-8831bf7612e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:30.784427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc0bd1-8837-4e06-8312-8831bf7612e1 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:30.786212 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc0bd1-8837-4e06-8312-8831bf7612e1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:30.787152 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc0bd1-8837-4e06-8312-8831bf7612e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:30.790649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc0bd1-8837-4e06-8312-8831bf7612e1 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:30.814043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 127/244] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:30.819081 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c2ef9-315a-488a-8d17-b4e5be25897e None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:30.826302 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc0bd1-8837-4e06-8312-8831bf7612e1 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:31.060999 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c2ef9-315a-488a-8d17-b4e5be25897e None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:31.091900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc0bd1-8837-4e06-8312-8831bf7612e1 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:31.116172 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1539d99-0d86-4b4e-9f9f-ddcddc633a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:31.116985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1539d99-0d86-4b4e-9f9f-ddcddc633a8b None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:31.117314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1539d99-0d86-4b4e-9f9f-ddcddc633a8b None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:31.117650 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1539d99-0d86-4b4e-9f9f-ddcddc633a8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:31.140778 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1539d99-0d86-4b4e-9f9f-ddcddc633a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:31.154557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da1721-6894-4754-bc5c-75bf38b99475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:31.155668 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da1721-6894-4754-bc5c-75bf38b99475 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:31.156013 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da1721-6894-4754-bc5c-75bf38b99475 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:31.156391 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da1721-6894-4754-bc5c-75bf38b99475 None admin] PATH_INFO: `/v3/users/81792c0a5eb145268a4d8b04b1b539d2` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:31.158120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-a1539d99-0d86-4b4e-9f9f-ddcddc633a8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:31.158120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:31.158120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:31.158120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:31.158120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:31.158120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:31.158120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:31.158120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:31.158120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:31.158120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:31.158120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:31.158120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:31.158120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:31.158120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:31.158120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:31.158120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:31.159894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:31.159894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:31.159894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:31.159894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:31.159894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:31.159894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:31.159894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:31.159894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:31.159894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:31.159894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:31.159894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:31.159894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:49:31.159894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:31.159894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:31.159894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:31.159894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:31.161527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:31.161527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:31.161527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:31.161527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:31.161527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:31.161527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:31.161527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:31.161527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:31.161527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:31.161527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:31.161527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:31.161527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:49:31.166546 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 118/245] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:49:31.173698 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1539d99-0d86-4b4e-9f9f-ddcddc633a8b None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:31.191247 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da1721-6894-4754-bc5c-75bf38b99475 None admin] RBAC: Authorizing `identity:get_user(user_id=81792c0a5eb145268a4d8b04b1b539d2)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:31.194697 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da1721-6894-4754-bc5c-75bf38b99475 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:31.205319 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 128/246] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:30 2022] GET /identity/v3/users/81792c0a5eb145268a4d8b04b1b539d2 => generated 297 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:31.208013 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da1721-6894-4754-bc5c-75bf38b99475 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:31.328402 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1539d99-0d86-4b4e-9f9f-ddcddc633a8b None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:31.374001 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea157895-b13b-439c-918a-3f9d9bb46e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:31.374602 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea157895-b13b-439c-918a-3f9d9bb46e80 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:31.376446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea157895-b13b-439c-918a-3f9d9bb46e80 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:31.376834 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea157895-b13b-439c-918a-3f9d9bb46e80 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:31.377709 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea157895-b13b-439c-918a-3f9d9bb46e80 None admin] RBAC: Adding query filter params (name=member) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:31.378031 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea157895-b13b-439c-918a-3f9d9bb46e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:31.379643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea157895-b13b-439c-918a-3f9d9bb46e80 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:31.391635 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 119/247] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:31.397731 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea157895-b13b-439c-918a-3f9d9bb46e80 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:31.442406 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da1721-6894-4754-bc5c-75bf38b99475 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:31.498999 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2366f-b4fd-4314-a95d-c5860fd48a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:31.501455 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2366f-b4fd-4314-a95d-c5860fd48a28 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:31.502446 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2366f-b4fd-4314-a95d-c5860fd48a28 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:31.503491 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2366f-b4fd-4314-a95d-c5860fd48a28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:31.580837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea157895-b13b-439c-918a-3f9d9bb46e80 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:31.623902 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e994769-c4ef-47ef-92a2-6d03e9e46f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:31.624880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e994769-c4ef-47ef-92a2-6d03e9e46f19 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:31.625142 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e994769-c4ef-47ef-92a2-6d03e9e46f19 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:31.625397 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e994769-c4ef-47ef-92a2-6d03e9e46f19 None admin] PATH_INFO: `/v3/users/c2f3e8af5cea4849b942cdf9f0752698` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:31.627649 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e994769-c4ef-47ef-92a2-6d03e9e46f19 None admin] RBAC: Authorizing `identity:get_user(user_id=c2f3e8af5cea4849b942cdf9f0752698)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:31.629342 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e994769-c4ef-47ef-92a2-6d03e9e46f19 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:31.631131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 120/248] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:31 2022] GET /identity/v3/users/c2f3e8af5cea4849b942cdf9f0752698 => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:31.637598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e994769-c4ef-47ef-92a2-6d03e9e46f19 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:31.708008 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2366f-b4fd-4314-a95d-c5860fd48a28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:31.709637 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2366f-b4fd-4314-a95d-c5860fd48a28 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:31.756468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e994769-c4ef-47ef-92a2-6d03e9e46f19 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:31.793400 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef6c64-4aef-4e3b-b310-93a290966a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:31.794283 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef6c64-4aef-4e3b-b310-93a290966a78 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:31.794552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef6c64-4aef-4e3b-b310-93a290966a78 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:31.794856 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef6c64-4aef-4e3b-b310-93a290966a78 None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:31.796102 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef6c64-4aef-4e3b-b310-93a290966a78 None admin] RBAC: Authorizing `identity:get_project(project_id=5f5a44d5fda44f2586666bd534a896a4)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:31.797573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef6c64-4aef-4e3b-b310-93a290966a78 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:31.799676 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 121/249] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:31 2022] GET /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:31.805561 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef6c64-4aef-4e3b-b310-93a290966a78 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:31.860412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 129/250] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:49:31.869664 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2366f-b4fd-4314-a95d-c5860fd48a28 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:31.920667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef6c64-4aef-4e3b-b310-93a290966a78 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:31.956935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c3222-d448-469a-8133-eadde7ff4f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:31.957872 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c3222-d448-469a-8133-eadde7ff4f95 None admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:31.958150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c3222-d448-469a-8133-eadde7ff4f95 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:31.958423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c3222-d448-469a-8133-eadde7ff4f95 None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4/users/c2f3e8af5cea4849b942cdf9f0752698/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:31.960541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c3222-d448-469a-8133-eadde7ff4f95 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f5a44d5fda44f2586666bd534a896a4, user_id=c2f3e8af5cea4849b942cdf9f0752698, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:31.962069 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c3222-d448-469a-8133-eadde7ff4f95 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:31.986587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 122/251] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:49:31 2022] PUT /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4/users/c2f3e8af5cea4849b942cdf9f0752698/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:49:32.007091 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2366f-b4fd-4314-a95d-c5860fd48a28 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:32.050496 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc88d12-5fd8-46b2-93fb-b2fb898d2d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:32.051438 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc88d12-5fd8-46b2-93fb-b2fb898d2d85 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:32.051754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc88d12-5fd8-46b2-93fb-b2fb898d2d85 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:32.052029 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc88d12-5fd8-46b2-93fb-b2fb898d2d85 None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:32.056317 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc88d12-5fd8-46b2-93fb-b2fb898d2d85 None admin] RBAC: Authorizing `identity:get_project(project_id=5f5a44d5fda44f2586666bd534a896a4)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:32.057816 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc88d12-5fd8-46b2-93fb-b2fb898d2d85 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:32.060019 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 130/252] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:31 2022] GET /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:32.071638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c3222-d448-469a-8133-eadde7ff4f95 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:32.229611 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c3222-d448-469a-8133-eadde7ff4f95 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:32.268908 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f37fdc-ebb9-4d1a-9ac2-3e4510d38e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:32.269666 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f37fdc-ebb9-4d1a-9ac2-3e4510d38e66 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:32.269946 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f37fdc-ebb9-4d1a-9ac2-3e4510d38e66 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:32.270220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f37fdc-ebb9-4d1a-9ac2-3e4510d38e66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:32.271170 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f37fdc-ebb9-4d1a-9ac2-3e4510d38e66 None admin] RBAC: Adding query filter params (role.id=8a5dc4dc644046d487fb9977cd999599, scope.project.id=5f5a44d5fda44f2586666bd534a896a4, user.id=81792c0a5eb145268a4d8b04b1b539d2) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:32.271482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f37fdc-ebb9-4d1a-9ac2-3e4510d38e66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:32.272952 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f37fdc-ebb9-4d1a-9ac2-3e4510d38e66 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:32.280061 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 123/253] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:49:32 2022] GET /identity/v3/role_assignments?user.id=81792c0a5eb145268a4d8b04b1b539d2&scope.project.id=5f5a44d5fda44f2586666bd534a896a4&role.id=8a5dc4dc644046d487fb9977cd999599 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:33.153182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ea739-c1b1-4d28-bbb2-52a8c73d6c1c None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:33.153732 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ea739-c1b1-4d28-bbb2-52a8c73d6c1c None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:33.153732 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ea739-c1b1-4d28-bbb2-52a8c73d6c1c None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:33.155450 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 131/254] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:33.160979 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79f69f-3e81-49ae-9185-ac1ccc63ad9e None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:33.161482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79f69f-3e81-49ae-9185-ac1ccc63ad9e None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:33.161561 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79f69f-3e81-49ae-9185-ac1ccc63ad9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:33.179751 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-0f79f69f-3e81-49ae-9185-ac1ccc63ad9e None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:33.181436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-0f79f69f-3e81-49ae-9185-ac1ccc63ad9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:33.255646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 124/255] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:33.287570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ea739-c1b1-4d28-bbb2-52a8c73d6c1c None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:33.422733 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ea739-c1b1-4d28-bbb2-52a8c73d6c1c None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:33.469399 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb59b9-825d-476e-be05-c584c0642a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:33.470636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb59b9-825d-476e-be05-c584c0642a55 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:33.471164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb59b9-825d-476e-be05-c584c0642a55 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:33.471640 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb59b9-825d-476e-be05-c584c0642a55 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:33.485994 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb59b9-825d-476e-be05-c584c0642a55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:33.495752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-65cb59b9-825d-476e-be05-c584c0642a55 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:49:33.495752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:33.495752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:33.495752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:33.495752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:33.495752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:33.495752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:33.495752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:33.495752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:33.495752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:33.495752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:33.495752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:33.495752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:33.495752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:33.495752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:33.495752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:33.496714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:33.496714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:33.496714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:33.496714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:33.496714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:33.496714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:33.496714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:33.496714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:33.496714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:33.496714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:33.496714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:33.496714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:33.496714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:33.496714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:33.496714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:33.496714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:33.497505 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:33.497505 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:33.497505 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:33.497505 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:33.497505 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:33.497505 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:33.497505 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:33.497505 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:33.497505 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:33.497505 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:33.497505 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:49:33.497505 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:33.505386 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 132/256] 10.222.0.73 () {56 vars in 1114 bytes} [Fri May 13 14:49:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:33.508097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79f69f-3e81-49ae-9185-ac1ccc63ad9e None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:33.706516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79f69f-3e81-49ae-9185-ac1ccc63ad9e None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:33.791073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3de21-2ce4-4382-80fe-fa616fd975c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:33.792231 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3de21-2ce4-4382-80fe-fa616fd975c5 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:33.792758 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3de21-2ce4-4382-80fe-fa616fd975c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:33.793277 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3de21-2ce4-4382-80fe-fa616fd975c5 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:33.794854 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3de21-2ce4-4382-80fe-fa616fd975c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:33.795442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3de21-2ce4-4382-80fe-fa616fd975c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:33.798211 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3de21-2ce4-4382-80fe-fa616fd975c5 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:33.828932 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 125/257] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:49:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:33.834874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb59b9-825d-476e-be05-c584c0642a55 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:33.885292 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4368e8e-ecef-4d53-abbf-6d453484b424 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:33.885292 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4368e8e-ecef-4d53-abbf-6d453484b424 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:33.885292 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4368e8e-ecef-4d53-abbf-6d453484b424 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:33.888341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 126/258] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:33.900147 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9ca4e-ea6a-4337-a9e2-877fd9b64588 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:33.900608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9ca4e-ea6a-4337-a9e2-877fd9b64588 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:33.901071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9ca4e-ea6a-4337-a9e2-877fd9b64588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:33.948368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-d8e9ca4e-ea6a-4337-a9e2-877fd9b64588 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:33.951077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-d8e9ca4e-ea6a-4337-a9e2-877fd9b64588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:34.110480 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb59b9-825d-476e-be05-c584c0642a55 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:34.173326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913bfdb-a885-460f-b018-42bce8c0d1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:34.174224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913bfdb-a885-460f-b018-42bce8c0d1fd None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:34.174507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913bfdb-a885-460f-b018-42bce8c0d1fd None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:34.174780 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913bfdb-a885-460f-b018-42bce8c0d1fd None admin] PATH_INFO: `/v3/users/f90312df06bb414baf6437907e4d720c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:34.184797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913bfdb-a885-460f-b018-42bce8c0d1fd None admin] RBAC: Authorizing `identity:get_user(user_id=f90312df06bb414baf6437907e4d720c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:34.185604 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 127/259] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 13 14:49:34.186460 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913bfdb-a885-460f-b018-42bce8c0d1fd None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:34.188371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 133/260] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:33 2022] GET /identity/v3/users/f90312df06bb414baf6437907e4d720c => generated 283 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:34.195164 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9ca4e-ea6a-4337-a9e2-877fd9b64588 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:34.249670 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913bfdb-a885-460f-b018-42bce8c0d1fd None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:34.418946 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913bfdb-a885-460f-b018-42bce8c0d1fd None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:34.434853 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9ca4e-ea6a-4337-a9e2-877fd9b64588 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:34.473207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d790c6-0ec5-4810-9c4b-e5b8f4bf2ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:34.474017 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d790c6-0ec5-4810-9c4b-e5b8f4bf2ea0 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:34.474298 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d790c6-0ec5-4810-9c4b-e5b8f4bf2ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:34.474571 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d790c6-0ec5-4810-9c4b-e5b8f4bf2ea0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:34.487091 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d790c6-0ec5-4810-9c4b-e5b8f4bf2ea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:34.495781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-d8d790c6-0ec5-4810-9c4b-e5b8f4bf2ea0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:49:34.495781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:34.495781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:34.495781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:34.495781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:34.495781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:34.495781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:34.495781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:34.495781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:34.495781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:34.495781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:34.495781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:34.495781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:34.495781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:34.495781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:34.495781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:34.496737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:34.496737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:34.496737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:34.496737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:34.496737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:34.496737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:34.496737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:34.496737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:34.496737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:34.496737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:34.496737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:34.496737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:34.496737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:34.496737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:34.496737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:34.496737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:34.497533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:34.497533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:34.497533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:34.497533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:34.497533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:34.497533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:34.497533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:34.497533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:34.497533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:34.497533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:34.497533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:49:34.497533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:34.497533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 134/261] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:49:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:49:34.501500 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5420d8-5208-40ae-98e3-d3abbf043902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:34.502318 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5420d8-5208-40ae-98e3-d3abbf043902 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:34.502690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5420d8-5208-40ae-98e3-d3abbf043902 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:34.503079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5420d8-5208-40ae-98e3-d3abbf043902 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:34.507074 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d790c6-0ec5-4810-9c4b-e5b8f4bf2ea0 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:34.644069 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5420d8-5208-40ae-98e3-d3abbf043902 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:34.645548 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5420d8-5208-40ae-98e3-d3abbf043902 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:34.723654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d790c6-0ec5-4810-9c4b-e5b8f4bf2ea0 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:34.763136 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cfe11-4398-48af-8364-13be6285f6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:34.763824 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cfe11-4398-48af-8364-13be6285f6bf None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:34.764108 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cfe11-4398-48af-8364-13be6285f6bf None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:34.764382 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cfe11-4398-48af-8364-13be6285f6bf None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:34.765133 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cfe11-4398-48af-8364-13be6285f6bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:34.765437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cfe11-4398-48af-8364-13be6285f6bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:34.766871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cfe11-4398-48af-8364-13be6285f6bf None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:34.776680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 135/262] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:34.782677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cfe11-4398-48af-8364-13be6285f6bf None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:34.894579 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cfe11-4398-48af-8364-13be6285f6bf None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:34.934441 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5582887-8e26-4c72-9b01-293ed992b90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:34.935364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5582887-8e26-4c72-9b01-293ed992b90e None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:34.935638 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5582887-8e26-4c72-9b01-293ed992b90e None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:34.935916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5582887-8e26-4c72-9b01-293ed992b90e None admin] PATH_INFO: `/v3/users/f90312df06bb414baf6437907e4d720c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:34.937198 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5582887-8e26-4c72-9b01-293ed992b90e None admin] RBAC: Authorizing `identity:get_user(user_id=f90312df06bb414baf6437907e4d720c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:34.938692 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5582887-8e26-4c72-9b01-293ed992b90e None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:34.940582 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 136/263] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:34 2022] GET /identity/v3/users/f90312df06bb414baf6437907e4d720c => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:34.946974 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5582887-8e26-4c72-9b01-293ed992b90e None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:34.982627 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 128/264] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 785 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:49:34.989373 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5420d8-5208-40ae-98e3-d3abbf043902 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:35.183308 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5582887-8e26-4c72-9b01-293ed992b90e None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:35.282299 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5420d8-5208-40ae-98e3-d3abbf043902 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:35.304033 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2caed-2121-4be7-835a-a3a13510ce51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:35.305591 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2caed-2121-4be7-835a-a3a13510ce51 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:35.306108 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2caed-2121-4be7-835a-a3a13510ce51 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:35.306708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2caed-2121-4be7-835a-a3a13510ce51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:35.357608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3d80d-b109-486a-ae87-843ef28f4f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:35.359465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3d80d-b109-486a-ae87-843ef28f4f8b None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:35.360129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3d80d-b109-486a-ae87-843ef28f4f8b None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:35.360801 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3d80d-b109-486a-ae87-843ef28f4f8b None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:35.371183 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3d80d-b109-486a-ae87-843ef28f4f8b None admin] RBAC: Authorizing `identity:get_project(project_id=5f5a44d5fda44f2586666bd534a896a4)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:35.374141 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3d80d-b109-486a-ae87-843ef28f4f8b None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:35.377902 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 129/265] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:34 2022] GET /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4 => generated 302 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:35.385406 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3d80d-b109-486a-ae87-843ef28f4f8b None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:35.473710 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2caed-2121-4be7-835a-a3a13510ce51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:35.477778 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2caed-2121-4be7-835a-a3a13510ce51 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:35.709789 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3d80d-b109-486a-ae87-843ef28f4f8b None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:35.730243 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 137/266] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 784 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:49:35.735831 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2caed-2121-4be7-835a-a3a13510ce51 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:35.789569 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41fb19-41af-428a-b9ce-aeebccdb3a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:35.790243 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41fb19-41af-428a-b9ce-aeebccdb3a36 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:35.790520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41fb19-41af-428a-b9ce-aeebccdb3a36 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:35.790793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41fb19-41af-428a-b9ce-aeebccdb3a36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:35.791828 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41fb19-41af-428a-b9ce-aeebccdb3a36 None admin] RBAC: Adding query filter params (role.id=0a8d21e5149c42a8b85ca3c0258538d4, scope.project.id=5f5a44d5fda44f2586666bd534a896a4, user.id=f90312df06bb414baf6437907e4d720c) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:35.792137 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41fb19-41af-428a-b9ce-aeebccdb3a36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:35.793916 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41fb19-41af-428a-b9ce-aeebccdb3a36 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:35.809959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 130/267] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:49:35 2022] GET /identity/v3/role_assignments?user.id=f90312df06bb414baf6437907e4d720c&scope.project.id=5f5a44d5fda44f2586666bd534a896a4&role.id=0a8d21e5149c42a8b85ca3c0258538d4 => generated 608 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:35.934208 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b96990-48a0-4af9-8e29-eb408275cbcd None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:35.936002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b96990-48a0-4af9-8e29-eb408275cbcd None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:35.937068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b96990-48a0-4af9-8e29-eb408275cbcd None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:35.939728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 131/268] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:49:35.952968 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d2672-ad5d-480b-8fd3-bda89747aff9 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:35.954406 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d2672-ad5d-480b-8fd3-bda89747aff9 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:35.955385 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d2672-ad5d-480b-8fd3-bda89747aff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:35.961102 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2caed-2121-4be7-835a-a3a13510ce51 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:35.997693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-524d2672-ad5d-480b-8fd3-bda89747aff9 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:36.009124 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-524d2672-ad5d-480b-8fd3-bda89747aff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:36.063609 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad09ac-32dc-4b21-b829-79bc3686a5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:36.064716 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad09ac-32dc-4b21-b829-79bc3686a5b3 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:36.065054 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad09ac-32dc-4b21-b829-79bc3686a5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:36.065435 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad09ac-32dc-4b21-b829-79bc3686a5b3 None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:36.067032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad09ac-32dc-4b21-b829-79bc3686a5b3 None admin] RBAC: Authorizing `identity:get_project(project_id=5f5a44d5fda44f2586666bd534a896a4)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:36.068886 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad09ac-32dc-4b21-b829-79bc3686a5b3 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:36.075225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 138/269] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:35 2022] GET /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4 => generated 302 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:36.076745 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad09ac-32dc-4b21-b829-79bc3686a5b3 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:36.159949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 132/270] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:49:36.201713 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576235d-611a-4081-93a3-7328251c1c8c None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:36.201991 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576235d-611a-4081-93a3-7328251c1c8c None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:36.202295 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576235d-611a-4081-93a3-7328251c1c8c None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:36.203932 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 133/271] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:36.209492 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fadfc6-c517-4bbe-b3da-1214ff5d5c2b None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:36.209933 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fadfc6-c517-4bbe-b3da-1214ff5d5c2b None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:36.210119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fadfc6-c517-4bbe-b3da-1214ff5d5c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:36.238081 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-79fadfc6-c517-4bbe-b3da-1214ff5d5c2b None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:36.239344 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-79fadfc6-c517-4bbe-b3da-1214ff5d5c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:36.338902 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 134/272] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:49:36.340258 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1756181-7a3f-4c79-8e5c-010b67023d60 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:36.340547 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1756181-7a3f-4c79-8e5c-010b67023d60 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:36.340801 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1756181-7a3f-4c79-8e5c-010b67023d60 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:36.342725 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 135/273] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:36.351456 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad09ac-32dc-4b21-b829-79bc3686a5b3 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:36.352821 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1756181-7a3f-4c79-8e5c-010b67023d60 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:36.425611 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8255bb-80de-48e2-b0cd-32fa5582cc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:36.427340 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8255bb-80de-48e2-b0cd-32fa5582cc9a None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:36.428061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8255bb-80de-48e2-b0cd-32fa5582cc9a None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:36.428757 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8255bb-80de-48e2-b0cd-32fa5582cc9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:36.431262 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8255bb-80de-48e2-b0cd-32fa5582cc9a None admin] RBAC: Adding query filter params (role.id=b6fbf976763d4795afbfb53a09ec6f6c, scope.project.id=5f5a44d5fda44f2586666bd534a896a4, user.id=f90312df06bb414baf6437907e4d720c) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:36.432269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8255bb-80de-48e2-b0cd-32fa5582cc9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:36.435127 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8255bb-80de-48e2-b0cd-32fa5582cc9a None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:36.447770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 139/274] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:49:36 2022] GET /identity/v3/role_assignments?user.id=f90312df06bb414baf6437907e4d720c&scope.project.id=5f5a44d5fda44f2586666bd534a896a4&role.id=b6fbf976763d4795afbfb53a09ec6f6c => generated 608 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:36.450516 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cfa9b-01aa-4d35-b0d6-bb8979b1ebf6 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:36.451801 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cfa9b-01aa-4d35-b0d6-bb8979b1ebf6 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:36.452684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cfa9b-01aa-4d35-b0d6-bb8979b1ebf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:36.485594 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-499cfa9b-01aa-4d35-b0d6-bb8979b1ebf6 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:36.487562 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-499cfa9b-01aa-4d35-b0d6-bb8979b1ebf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:36.527121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1756181-7a3f-4c79-8e5c-010b67023d60 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:36.581914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e8875-8325-4667-9efe-a1854869b025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:36.583333 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e8875-8325-4667-9efe-a1854869b025 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:36.583825 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e8875-8325-4667-9efe-a1854869b025 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:36.584282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e8875-8325-4667-9efe-a1854869b025 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:36.587043 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e8875-8325-4667-9efe-a1854869b025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:36.589937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e8875-8325-4667-9efe-a1854869b025 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:36.593246 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 136/275] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:49:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:36.594292 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e8875-8325-4667-9efe-a1854869b025 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:36.609325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 140/276] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:36.609325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b7a37-9e99-4f48-af16-4f35959ca4b5 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:36.609325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b7a37-9e99-4f48-af16-4f35959ca4b5 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:36.609325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b7a37-9e99-4f48-af16-4f35959ca4b5 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:36.609325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 141/277] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:36.615797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b7a37-9e99-4f48-af16-4f35959ca4b5 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:36.747803 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b7a37-9e99-4f48-af16-4f35959ca4b5 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:36.770254 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e8875-8325-4667-9efe-a1854869b025 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:36.801020 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61baac-03bc-4f2a-9dfc-d4578c6d59dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:36.802065 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61baac-03bc-4f2a-9dfc-d4578c6d59dd None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:36.802582 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61baac-03bc-4f2a-9dfc-d4578c6d59dd None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:36.803114 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61baac-03bc-4f2a-9dfc-d4578c6d59dd None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:36.804436 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61baac-03bc-4f2a-9dfc-d4578c6d59dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:36.807989 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad794e0-3409-4538-b088-596a3ceff2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:36.808487 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61baac-03bc-4f2a-9dfc-d4578c6d59dd None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:36.808789 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad794e0-3409-4538-b088-596a3ceff2b7 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:36.809068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad794e0-3409-4538-b088-596a3ceff2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:36.809340 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad794e0-3409-4538-b088-596a3ceff2b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:36.820893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad794e0-3409-4538-b088-596a3ceff2b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:36.829479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-0ad794e0-3409-4538-b088-596a3ceff2b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:49:36.829479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:36.829479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:36.829479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:36.829479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:36.829479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:36.829479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:36.829479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:36.829479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:36.829479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:36.829479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:36.829479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:36.829479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:36.829479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:36.829479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:36.829479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:36.830770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:36.830770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:36.830770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:36.830770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:36.830770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:36.830770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:36.830770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:36.830770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:36.830770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:36.830770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:36.830770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:36.830770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:49:36.830770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:36.830770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:36.830770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:36.830770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:36.832076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:36.832076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:36.832076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:36.832076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:36.832076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:36.832076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:36.832076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:36.832076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:36.832076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:36.832076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:36.832076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:49:36.832076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:49:36.832076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 137/278] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:36.832076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90708179-2766-4d71-8d6d-695cffd22237 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:36.832803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90708179-2766-4d71-8d6d-695cffd22237 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:36.832803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90708179-2766-4d71-8d6d-695cffd22237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:36.843590 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 142/279] 10.222.0.73 () {60 vars in 1132 bytes} [Fri May 13 14:49:36 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:49:36.844527 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61baac-03bc-4f2a-9dfc-d4578c6d59dd None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:36.856356 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-90708179-2766-4d71-8d6d-695cffd22237 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:36.857637 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-90708179-2766-4d71-8d6d-695cffd22237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:36.966494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 138/280] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:36.967831 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90708179-2766-4d71-8d6d-695cffd22237 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:37.008388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61baac-03bc-4f2a-9dfc-d4578c6d59dd None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:37.061538 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8110b-bb3a-49e6-80fd-cc2832fac509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:37.062459 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8110b-bb3a-49e6-80fd-cc2832fac509 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:37.063425 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8110b-bb3a-49e6-80fd-cc2832fac509 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:37.063425 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8110b-bb3a-49e6-80fd-cc2832fac509 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:37.079428 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8110b-bb3a-49e6-80fd-cc2832fac509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:37.087708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-40b8110b-bb3a-49e6-80fd-cc2832fac509 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:37.087708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:37.087708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:37.087708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:37.087708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:37.087708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:37.087708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:37.087708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:37.087708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:37.087708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:37.087708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:37.087708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:37.087708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:37.087708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:37.087708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:37.087708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:37.088677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:37.088677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:37.088677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:37.088677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:37.088677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:37.088677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:37.088677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:37.088677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:37.088677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:37.088677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:37.088677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:37.088677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:37.088677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:37.088677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:37.088677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:37.088677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:37.089654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:37.089654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:37.089654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:37.089654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:37.089654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:37.089654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:37.089654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:37.089654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:37.089654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:37.089654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:37.089654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:37.089654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:37.089654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 143/281] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:37.090452 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8110b-bb3a-49e6-80fd-cc2832fac509 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:37.107895 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90708179-2766-4d71-8d6d-695cffd22237 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:37.153170 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bc315-a6a7-4c2a-8e82-17803f3c66f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:37.153957 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bc315-a6a7-4c2a-8e82-17803f3c66f0 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:37.155430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bc315-a6a7-4c2a-8e82-17803f3c66f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:37.155430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bc315-a6a7-4c2a-8e82-17803f3c66f0 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:37.156162 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bc315-a6a7-4c2a-8e82-17803f3c66f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:37.156623 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bc315-a6a7-4c2a-8e82-17803f3c66f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:37.159426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bc315-a6a7-4c2a-8e82-17803f3c66f0 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:37.174415 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 139/282] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:37.177064 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bc315-a6a7-4c2a-8e82-17803f3c66f0 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:37.227942 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8110b-bb3a-49e6-80fd-cc2832fac509 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:37.267520 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09ef1b-a8f0-4e01-9a7a-8eb2029a6e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:37.268522 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09ef1b-a8f0-4e01-9a7a-8eb2029a6e05 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:37.268811 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09ef1b-a8f0-4e01-9a7a-8eb2029a6e05 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:37.269086 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09ef1b-a8f0-4e01-9a7a-8eb2029a6e05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:37.281651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09ef1b-a8f0-4e01-9a7a-8eb2029a6e05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:37.290168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-bf09ef1b-a8f0-4e01-9a7a-8eb2029a6e05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:37.290168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:37.290168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:37.290168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:37.290168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:37.290168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:37.290168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:37.290168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:37.290168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:37.290168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:37.290168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:37.290168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:37.290168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:37.290168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:37.290168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:37.290168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:37.291908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:37.291908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:37.291908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:37.291908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:37.291908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:37.291908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:37.291908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:37.291908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:37.291908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:37.291908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:37.291908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:37.291908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:37.291908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:37.291908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:37.291908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:37.291908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:37.293569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:37.293569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:37.293569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:37.293569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:37.293569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:37.293569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:37.293569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:37.293569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:37.293569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:37.293569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:37.293569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:37.293569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:37.293569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 144/283] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:37.293569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09ef1b-a8f0-4e01-9a7a-8eb2029a6e05 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:37.356785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bc315-a6a7-4c2a-8e82-17803f3c66f0 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:37.400224 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b179f0-a299-4e81-8b55-200c9e3d2132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:37.401189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b179f0-a299-4e81-8b55-200c9e3d2132 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:37.401663 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b179f0-a299-4e81-8b55-200c9e3d2132 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:37.402084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b179f0-a299-4e81-8b55-200c9e3d2132 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:37.403031 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b179f0-a299-4e81-8b55-200c9e3d2132 None admin] RBAC: Adding query filter params (name=member) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:37.403563 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b179f0-a299-4e81-8b55-200c9e3d2132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:37.405110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b179f0-a299-4e81-8b55-200c9e3d2132 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:37.415372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 140/284] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:37.416471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b179f0-a299-4e81-8b55-200c9e3d2132 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:37.463492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09ef1b-a8f0-4e01-9a7a-8eb2029a6e05 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:37.505821 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc560a-a810-48c7-b54a-d46d18de9581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:37.507123 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc560a-a810-48c7-b54a-d46d18de9581 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:37.507593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc560a-a810-48c7-b54a-d46d18de9581 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:37.508560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc560a-a810-48c7-b54a-d46d18de9581 None admin] PATH_INFO: `/v3/users/81792c0a5eb145268a4d8b04b1b539d2` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:37.510260 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc560a-a810-48c7-b54a-d46d18de9581 None admin] RBAC: Authorizing `identity:get_user(user_id=81792c0a5eb145268a4d8b04b1b539d2)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:37.512459 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc560a-a810-48c7-b54a-d46d18de9581 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:37.514996 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 145/285] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:37 2022] GET /identity/v3/users/81792c0a5eb145268a4d8b04b1b539d2 => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:37.516240 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc560a-a810-48c7-b54a-d46d18de9581 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:37.599979 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b179f0-a299-4e81-8b55-200c9e3d2132 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:37.637925 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc560a-a810-48c7-b54a-d46d18de9581 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:37.662889 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38a9cd-4db0-425b-a017-ae9fee2a90cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:37.664181 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38a9cd-4db0-425b-a017-ae9fee2a90cb None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:37.664181 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38a9cd-4db0-425b-a017-ae9fee2a90cb None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:37.665800 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38a9cd-4db0-425b-a017-ae9fee2a90cb None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:37.666089 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38a9cd-4db0-425b-a017-ae9fee2a90cb None admin] RBAC: Adding query filter params (name=member) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:37.666629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38a9cd-4db0-425b-a017-ae9fee2a90cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:37.669393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38a9cd-4db0-425b-a017-ae9fee2a90cb None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:37.686127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 141/286] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:37.692982 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38a9cd-4db0-425b-a017-ae9fee2a90cb None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:37.700652 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9678a0d-2cf4-43a9-ba30-95d7246c8d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:37.702105 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9678a0d-2cf4-43a9-ba30-95d7246c8d60 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:37.702607 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9678a0d-2cf4-43a9-ba30-95d7246c8d60 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:37.703140 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9678a0d-2cf4-43a9-ba30-95d7246c8d60 None admin] PATH_INFO: `/v3/users/47fba3d547df4b4eb02f45ffe817a223` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:37.740068 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9678a0d-2cf4-43a9-ba30-95d7246c8d60 None admin] RBAC: Authorizing `identity:get_user(user_id=47fba3d547df4b4eb02f45ffe817a223)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:37.743798 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9678a0d-2cf4-43a9-ba30-95d7246c8d60 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:37.746371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 146/287] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:37 2022] GET /identity/v3/users/47fba3d547df4b4eb02f45ffe817a223 => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:37.750938 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9678a0d-2cf4-43a9-ba30-95d7246c8d60 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:37.833255 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38a9cd-4db0-425b-a017-ae9fee2a90cb None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:37.876243 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bd6c0-252f-41cf-8788-8ede4684b7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:37.877130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bd6c0-252f-41cf-8788-8ede4684b7b2 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:37.877475 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bd6c0-252f-41cf-8788-8ede4684b7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:37.877760 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bd6c0-252f-41cf-8788-8ede4684b7b2 None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:37.879116 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bd6c0-252f-41cf-8788-8ede4684b7b2 None admin] RBAC: Authorizing `identity:get_project(project_id=5f5a44d5fda44f2586666bd534a896a4)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:37.880634 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bd6c0-252f-41cf-8788-8ede4684b7b2 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:37.884486 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 142/288] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:37 2022] GET /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:37.885378 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bd6c0-252f-41cf-8788-8ede4684b7b2 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:37.946404 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9678a0d-2cf4-43a9-ba30-95d7246c8d60 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:38.003528 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3692690-1638-4705-8376-09d0690ae319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:38.005404 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3692690-1638-4705-8376-09d0690ae319 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:38.006174 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3692690-1638-4705-8376-09d0690ae319 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:38.006883 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3692690-1638-4705-8376-09d0690ae319 None admin] PATH_INFO: `/v3/users/c2f3e8af5cea4849b942cdf9f0752698` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:38.010056 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3692690-1638-4705-8376-09d0690ae319 None admin] RBAC: Authorizing `identity:get_user(user_id=c2f3e8af5cea4849b942cdf9f0752698)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:38.013067 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3692690-1638-4705-8376-09d0690ae319 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:38.014494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bd6c0-252f-41cf-8788-8ede4684b7b2 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:38.016690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 147/289] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:37 2022] GET /identity/v3/users/c2f3e8af5cea4849b942cdf9f0752698 => generated 297 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:38.018332 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3692690-1638-4705-8376-09d0690ae319 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:38.054568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09794df-c844-4d82-9158-01f87aea418c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:38.055822 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09794df-c844-4d82-9158-01f87aea418c None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:38.056109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09794df-c844-4d82-9158-01f87aea418c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:38.056388 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09794df-c844-4d82-9158-01f87aea418c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:38.057239 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09794df-c844-4d82-9158-01f87aea418c None admin] RBAC: Adding query filter params (role.id=0268e6ac6fb649eb89da825c5ae328ab, user.id=47fba3d547df4b4eb02f45ffe817a223, scope.system=all) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:38.057554 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09794df-c844-4d82-9158-01f87aea418c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:38.059281 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09794df-c844-4d82-9158-01f87aea418c None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:38.066475 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 143/290] 10.222.0.73 () {56 vars in 1308 bytes} [Fri May 13 14:49:37 2022] GET /identity/v3/role_assignments?user.id=47fba3d547df4b4eb02f45ffe817a223&scope.system=all&role.id=0268e6ac6fb649eb89da825c5ae328ab => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:38.072240 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09794df-c844-4d82-9158-01f87aea418c None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:38.261459 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3692690-1638-4705-8376-09d0690ae319 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:38.331130 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652af54e-3ca2-467f-82a7-db13923528b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:38.332052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652af54e-3ca2-467f-82a7-db13923528b1 None admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:38.332336 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652af54e-3ca2-467f-82a7-db13923528b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:38.332615 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652af54e-3ca2-467f-82a7-db13923528b1 None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4/users/81792c0a5eb145268a4d8b04b1b539d2/roles/8a5dc4dc644046d487fb9977cd999599` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:38.334707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652af54e-3ca2-467f-82a7-db13923528b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f5a44d5fda44f2586666bd534a896a4, user_id=81792c0a5eb145268a4d8b04b1b539d2, role_id=8a5dc4dc644046d487fb9977cd999599)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:38.336269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652af54e-3ca2-467f-82a7-db13923528b1 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:38.360642 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09794df-c844-4d82-9158-01f87aea418c None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:38.363930 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 148/291] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:49:38 2022] PUT /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4/users/81792c0a5eb145268a4d8b04b1b539d2/roles/8a5dc4dc644046d487fb9977cd999599 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:49:38.438635 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f8281-3301-42a8-8cbd-0f28f299f9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:38.440262 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f8281-3301-42a8-8cbd-0f28f299f9e5 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:38.441028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f8281-3301-42a8-8cbd-0f28f299f9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:38.441801 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f8281-3301-42a8-8cbd-0f28f299f9e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:38.607054 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f8281-3301-42a8-8cbd-0f28f299f9e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:38.608531 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f8281-3301-42a8-8cbd-0f28f299f9e5 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:38.722344 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 144/292] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:49:38.728175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652af54e-3ca2-467f-82a7-db13923528b1 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:38.845152 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652af54e-3ca2-467f-82a7-db13923528b1 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:38.886788 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc45b5e-7d4f-41fa-b46a-40695918c147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:38.887727 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc45b5e-7d4f-41fa-b46a-40695918c147 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:38.888105 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc45b5e-7d4f-41fa-b46a-40695918c147 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:38.888464 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc45b5e-7d4f-41fa-b46a-40695918c147 None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:38.894852 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc45b5e-7d4f-41fa-b46a-40695918c147 None admin] RBAC: Authorizing `identity:get_project(project_id=5f5a44d5fda44f2586666bd534a896a4)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:38.894852 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc45b5e-7d4f-41fa-b46a-40695918c147 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:38.894852 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 149/293] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:38 2022] GET /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:38.900232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f8281-3301-42a8-8cbd-0f28f299f9e5 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:39.069702 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f8281-3301-42a8-8cbd-0f28f299f9e5 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:39.116103 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588a5d5-2b68-408e-b94a-d8ebe2d10664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:39.116771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588a5d5-2b68-408e-b94a-d8ebe2d10664 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:39.117044 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588a5d5-2b68-408e-b94a-d8ebe2d10664 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:39.117364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588a5d5-2b68-408e-b94a-d8ebe2d10664 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:39.118260 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588a5d5-2b68-408e-b94a-d8ebe2d10664 None admin] RBAC: Adding query filter params (role.id=0268e6ac6fb649eb89da825c5ae328ab, scope.project.id=5f5a44d5fda44f2586666bd534a896a4, user.id=c2f3e8af5cea4849b942cdf9f0752698) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:39.118566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588a5d5-2b68-408e-b94a-d8ebe2d10664 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:39.120041 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588a5d5-2b68-408e-b94a-d8ebe2d10664 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:39.132085 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 145/294] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:49:38 2022] GET /identity/v3/role_assignments?user.id=c2f3e8af5cea4849b942cdf9f0752698&scope.project.id=5f5a44d5fda44f2586666bd534a896a4&role.id=0268e6ac6fb649eb89da825c5ae328ab => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:39.564612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170d6ad-6ead-4503-b08f-7da64e8a4976 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:39.564612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170d6ad-6ead-4503-b08f-7da64e8a4976 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:39.566722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170d6ad-6ead-4503-b08f-7da64e8a4976 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:39.566722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 150/295] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:39.573732 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec65da9-a847-4f84-887d-d6cc0c2065e8 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:39.574225 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec65da9-a847-4f84-887d-d6cc0c2065e8 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:39.574328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec65da9-a847-4f84-887d-d6cc0c2065e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:39.595813 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-fec65da9-a847-4f84-887d-d6cc0c2065e8 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:39.597003 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-fec65da9-a847-4f84-887d-d6cc0c2065e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:39.705754 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 146/296] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:39.738697 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170d6ad-6ead-4503-b08f-7da64e8a4976 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:39.856047 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170d6ad-6ead-4503-b08f-7da64e8a4976 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:39.916753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd2959-d319-486b-9023-70704973ff27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:39.918563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd2959-d319-486b-9023-70704973ff27 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:39.919346 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd2959-d319-486b-9023-70704973ff27 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:39.920059 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd2959-d319-486b-9023-70704973ff27 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:39.940055 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd2959-d319-486b-9023-70704973ff27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:39.955887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-54bd2959-d319-486b-9023-70704973ff27 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:49:39.955887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:39.955887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:39.955887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:39.955887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:39.955887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:39.955887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:39.955887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:39.955887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:39.955887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:39.955887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:39.955887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:39.955887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:39.955887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:39.955887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:39.955887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:39.956853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:39.956853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:39.956853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:39.956853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:39.956853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:39.956853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:39.956853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:39.956853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:39.956853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:39.956853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:39.956853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:39.956853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:39.956853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:39.956853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:39.956853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:39.956853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:39.957662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:39.957662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:39.957662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:39.957662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:39.957662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:39.957662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:39.957662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:39.957662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:39.957662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:39.957662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:39.957662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:49:39.957662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:39.958278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 151/297] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:39.965868 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec65da9-a847-4f84-887d-d6cc0c2065e8 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:40.081143 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec65da9-a847-4f84-887d-d6cc0c2065e8 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:40.116621 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbf769-3f1c-410b-ac1f-c247ce4fb295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:40.117277 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbf769-3f1c-410b-ac1f-c247ce4fb295 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:40.117632 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbf769-3f1c-410b-ac1f-c247ce4fb295 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:40.117961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbf769-3f1c-410b-ac1f-c247ce4fb295 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:40.118660 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbf769-3f1c-410b-ac1f-c247ce4fb295 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:40.118998 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbf769-3f1c-410b-ac1f-c247ce4fb295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:40.120421 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbf769-3f1c-410b-ac1f-c247ce4fb295 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:40.129895 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 147/298] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:40.136932 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd2959-d319-486b-9023-70704973ff27 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:40.294210 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd2959-d319-486b-9023-70704973ff27 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:40.332570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23faff-edec-4147-8a9a-999aace24327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:40.333483 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23faff-edec-4147-8a9a-999aace24327 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:40.333765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23faff-edec-4147-8a9a-999aace24327 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:40.334041 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23faff-edec-4147-8a9a-999aace24327 None admin] PATH_INFO: `/v3/users/9a1572f1c58b421c8daee34e128283a9` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:40.349844 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23faff-edec-4147-8a9a-999aace24327 None admin] RBAC: Authorizing `identity:get_user(user_id=9a1572f1c58b421c8daee34e128283a9)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:40.351375 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23faff-edec-4147-8a9a-999aace24327 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:40.353642 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 152/299] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:40 2022] GET /identity/v3/users/9a1572f1c58b421c8daee34e128283a9 => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:40.359600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbf769-3f1c-410b-ac1f-c247ce4fb295 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:40.476020 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbf769-3f1c-410b-ac1f-c247ce4fb295 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:40.512809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44a0f0-6800-45e8-b1cf-5db0a4f2c981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:40.513844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44a0f0-6800-45e8-b1cf-5db0a4f2c981 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:40.514326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44a0f0-6800-45e8-b1cf-5db0a4f2c981 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:40.514792 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44a0f0-6800-45e8-b1cf-5db0a4f2c981 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:40.515883 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44a0f0-6800-45e8-b1cf-5db0a4f2c981 None admin] RBAC: Adding query filter params (role.id=8a5dc4dc644046d487fb9977cd999599, user.id=9a1572f1c58b421c8daee34e128283a9, scope.system=all) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:40.516423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44a0f0-6800-45e8-b1cf-5db0a4f2c981 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:40.518147 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44a0f0-6800-45e8-b1cf-5db0a4f2c981 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:40.524778 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 148/300] 10.222.0.73 () {56 vars in 1308 bytes} [Fri May 13 14:49:40 2022] GET /identity/v3/role_assignments?user.id=9a1572f1c58b421c8daee34e128283a9&scope.system=all&role.id=8a5dc4dc644046d487fb9977cd999599 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:40.700034 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f60f2-0f3c-4f61-be3f-e7d88c0e4400 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:40.700543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f60f2-0f3c-4f61-be3f-e7d88c0e4400 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:40.701034 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f60f2-0f3c-4f61-be3f-e7d88c0e4400 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:40.704192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 153/301] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:40.714037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad559f9b-a69a-4212-9ffb-4268466f9941 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:40.714562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad559f9b-a69a-4212-9ffb-4268466f9941 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:40.715121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad559f9b-a69a-4212-9ffb-4268466f9941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:40.746239 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-ad559f9b-a69a-4212-9ffb-4268466f9941 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:40.748830 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ad559f9b-a69a-4212-9ffb-4268466f9941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:40.882264 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 149/302] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:40.940789 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f60f2-0f3c-4f61-be3f-e7d88c0e4400 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:41.129733 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f60f2-0f3c-4f61-be3f-e7d88c0e4400 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:41.169342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcd23b-d671-47e3-9b37-fd02e056a0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:41.170162 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcd23b-d671-47e3-9b37-fd02e056a0c8 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:41.170448 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcd23b-d671-47e3-9b37-fd02e056a0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:41.170741 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcd23b-d671-47e3-9b37-fd02e056a0c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:41.172016 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcd23b-d671-47e3-9b37-fd02e056a0c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:41.174450 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcd23b-d671-47e3-9b37-fd02e056a0c8 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:41.176448 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 154/303] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:49:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:41.182355 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad559f9b-a69a-4212-9ffb-4268466f9941 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:41.357173 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad559f9b-a69a-4212-9ffb-4268466f9941 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:41.424816 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db9a3c-7f03-4cc7-b79f-567b05de47e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:41.426317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db9a3c-7f03-4cc7-b79f-567b05de47e4 None admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:41.427184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db9a3c-7f03-4cc7-b79f-567b05de47e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:41.427944 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db9a3c-7f03-4cc7-b79f-567b05de47e4 None admin] PATH_INFO: `/v3/groups` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:41.429530 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db9a3c-7f03-4cc7-b79f-567b05de47e4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:41.432444 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db9a3c-7f03-4cc7-b79f-567b05de47e4 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:41.456736 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbccbf5-d87a-4377-9924-d267a26595c4 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:41.457395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbccbf5-d87a-4377-9924-d267a26595c4 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:41.457910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbccbf5-d87a-4377-9924-d267a26595c4 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:41.459035 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 150/304] 10.222.0.73 () {60 vars in 1134 bytes} [Fri May 13 14:49:41 2022] POST /identity/v3/groups => generated 229 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:49:41.460227 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 155/305] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:49:41.470179 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c80dfc-7b24-4577-93bf-c9b449b91e3d None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:41.471080 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c80dfc-7b24-4577-93bf-c9b449b91e3d None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:41.471763 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c80dfc-7b24-4577-93bf-c9b449b91e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:41.505829 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-78c80dfc-7b24-4577-93bf-c9b449b91e3d None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:41.509534 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-78c80dfc-7b24-4577-93bf-c9b449b91e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:41.626289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 151/306] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:41.668286 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5172fd-cbdf-4db0-97ee-2e1738c74348 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:41.669226 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5172fd-cbdf-4db0-97ee-2e1738c74348 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:41.669700 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5172fd-cbdf-4db0-97ee-2e1738c74348 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:41.670246 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c80dfc-7b24-4577-93bf-c9b449b91e3d None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:41.672765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 156/307] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:41.681206 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce85562-e4b8-4ab9-ba71-777e9b7e706d None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:41.681621 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce85562-e4b8-4ab9-ba71-777e9b7e706d None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:41.682100 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce85562-e4b8-4ab9-ba71-777e9b7e706d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:41.706335 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-8ce85562-e4b8-4ab9-ba71-777e9b7e706d None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:41.707845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-8ce85562-e4b8-4ab9-ba71-777e9b7e706d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:41.800924 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 157/308] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:41.812969 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c80dfc-7b24-4577-93bf-c9b449b91e3d None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:41.824076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce85562-e4b8-4ab9-ba71-777e9b7e706d None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:41.855155 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ee9e1-4770-48b7-98f5-0ba802d2e519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:41.856413 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ee9e1-4770-48b7-98f5-0ba802d2e519 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:41.856687 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ee9e1-4770-48b7-98f5-0ba802d2e519 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:41.856953 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ee9e1-4770-48b7-98f5-0ba802d2e519 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:41.876922 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ee9e1-4770-48b7-98f5-0ba802d2e519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:41.894904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-924ee9e1-4770-48b7-98f5-0ba802d2e519 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:49:41.894904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:41.894904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:41.894904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:41.894904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:41.894904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:41.894904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:41.894904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:41.894904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:41.894904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:41.894904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:41.894904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:41.894904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:41.894904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:41.894904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:41.894904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:41.896700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:41.896700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:41.896700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:41.896700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:41.896700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:41.896700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:41.896700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:41.896700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:41.896700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:41.896700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:41.896700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:41.896700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:49:41.896700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:41.896700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:41.896700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:41.896700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:41.898326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:41.898326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:41.898326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:41.898326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:41.898326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:41.898326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:41.898326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:41.898326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:41.898326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:41.898326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:41.898326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:49:41.898326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:49:41.901265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 152/309] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:49:41.910767 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ee9e1-4770-48b7-98f5-0ba802d2e519 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:41.943882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce85562-e4b8-4ab9-ba71-777e9b7e706d None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:41.982056 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e685d-5d4d-420c-b946-9595ec756a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:41.982878 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e685d-5d4d-420c-b946-9595ec756a6c None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:41.983161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e685d-5d4d-420c-b946-9595ec756a6c None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:41.983430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e685d-5d4d-420c-b946-9595ec756a6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:41.995300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e685d-5d4d-420c-b946-9595ec756a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:42.003270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-7f6e685d-5d4d-420c-b946-9595ec756a6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:42.003270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:42.003270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:42.003270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:42.003270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:42.003270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:42.003270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:42.003270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:42.003270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:42.003270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:42.003270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:42.003270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:42.003270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:42.003270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:42.003270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:42.003270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:42.004995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:42.004995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:42.004995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:42.004995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:42.004995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:42.004995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:42.004995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:42.004995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:42.004995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:42.004995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:42.004995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:42.004995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:42.004995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:42.004995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:42.004995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:42.004995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:42.006569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:42.006569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:42.006569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:42.006569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:42.006569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:42.006569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:42.006569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:42.006569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:42.006569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:42.006569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:42.006569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:42.006569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:42.010016 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 158/310] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:49:42.014897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e685d-5d4d-420c-b946-9595ec756a6c None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:42.099770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ee9e1-4770-48b7-98f5-0ba802d2e519 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:42.121492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e685d-5d4d-420c-b946-9595ec756a6c None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:42.161269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82aa7d-a874-4d3f-a614-4ebde0354ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:42.161863 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6e693-823b-452d-b2af-f3c71eed487c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:42.162180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82aa7d-a874-4d3f-a614-4ebde0354ecc None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:42.162421 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82aa7d-a874-4d3f-a614-4ebde0354ecc None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:42.162655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82aa7d-a874-4d3f-a614-4ebde0354ecc None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:42.162922 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6e693-823b-452d-b2af-f3c71eed487c None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:42.166863 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6e693-823b-452d-b2af-f3c71eed487c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:42.167250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82aa7d-a874-4d3f-a614-4ebde0354ecc None admin] RBAC: Adding query filter params (name=member) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:42.167250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82aa7d-a874-4d3f-a614-4ebde0354ecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:42.167737 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6e693-823b-452d-b2af-f3c71eed487c None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:42.167737 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6e693-823b-452d-b2af-f3c71eed487c None admin] RBAC: Adding query filter params (name=reader) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:42.168214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82aa7d-a874-4d3f-a614-4ebde0354ecc None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:42.168443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6e693-823b-452d-b2af-f3c71eed487c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:42.168443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6e693-823b-452d-b2af-f3c71eed487c None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:42.179797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 159/311] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:42.180865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82aa7d-a874-4d3f-a614-4ebde0354ecc None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:42.184543 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 153/312] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:42.194293 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6e693-823b-452d-b2af-f3c71eed487c None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:42.383969 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6e693-823b-452d-b2af-f3c71eed487c None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:42.402851 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82aa7d-a874-4d3f-a614-4ebde0354ecc None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:42.446789 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98135b58-d1d3-4ac8-b9b8-f2d5cb37c518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:42.447633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98135b58-d1d3-4ac8-b9b8-f2d5cb37c518 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:42.447914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98135b58-d1d3-4ac8-b9b8-f2d5cb37c518 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:42.448198 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98135b58-d1d3-4ac8-b9b8-f2d5cb37c518 None admin] PATH_INFO: `/v3/users/81792c0a5eb145268a4d8b04b1b539d2` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:42.449484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98135b58-d1d3-4ac8-b9b8-f2d5cb37c518 None admin] RBAC: Authorizing `identity:get_user(user_id=81792c0a5eb145268a4d8b04b1b539d2)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:42.451009 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98135b58-d1d3-4ac8-b9b8-f2d5cb37c518 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:42.458861 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 154/313] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:42 2022] GET /identity/v3/users/81792c0a5eb145268a4d8b04b1b539d2 => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:42.462725 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98135b58-d1d3-4ac8-b9b8-f2d5cb37c518 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:42.513232 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f48018-508c-4586-9fb8-665f04de8fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:42.514482 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f48018-508c-4586-9fb8-665f04de8fd3 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:42.514867 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f48018-508c-4586-9fb8-665f04de8fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:42.515100 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f48018-508c-4586-9fb8-665f04de8fd3 None admin] PATH_INFO: `/v3/users/47fba3d547df4b4eb02f45ffe817a223` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:42.519908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f48018-508c-4586-9fb8-665f04de8fd3 None admin] RBAC: Authorizing `identity:get_user(user_id=47fba3d547df4b4eb02f45ffe817a223)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:42.521428 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f48018-508c-4586-9fb8-665f04de8fd3 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:42.524236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 160/314] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:42 2022] GET /identity/v3/users/47fba3d547df4b4eb02f45ffe817a223 => generated 293 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:42.530667 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f48018-508c-4586-9fb8-665f04de8fd3 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:42.675749 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98135b58-d1d3-4ac8-b9b8-f2d5cb37c518 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:42.727197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5c6f1-bc60-4eea-a9ef-68bbc21bd532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:42.728926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5c6f1-bc60-4eea-a9ef-68bbc21bd532 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:42.729923 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5c6f1-bc60-4eea-a9ef-68bbc21bd532 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:42.730221 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5c6f1-bc60-4eea-a9ef-68bbc21bd532 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:42.753766 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f48018-508c-4586-9fb8-665f04de8fd3 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:42.811508 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be844f8-491c-4622-8c49-5d88d4e0146c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:42.811508 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be844f8-491c-4622-8c49-5d88d4e0146c None admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:42.811508 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be844f8-491c-4622-8c49-5d88d4e0146c None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:42.811508 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be844f8-491c-4622-8c49-5d88d4e0146c None admin] PATH_INFO: `/v3/system/users/47fba3d547df4b4eb02f45ffe817a223/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:42.817890 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be844f8-491c-4622-8c49-5d88d4e0146c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=47fba3d547df4b4eb02f45ffe817a223, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:42.817890 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be844f8-491c-4622-8c49-5d88d4e0146c None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:42.850982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 161/315] 10.222.0.73 () {58 vars in 1334 bytes} [Fri May 13 14:49:42 2022] PUT /identity/v3/system/users/47fba3d547df4b4eb02f45ffe817a223/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:49:42.898058 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5c6f1-bc60-4eea-a9ef-68bbc21bd532 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:42.901143 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5c6f1-bc60-4eea-a9ef-68bbc21bd532 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:42.996566 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd35c6f-55c2-4b73-b5dc-293c7a8a8079 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:42.997100 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd35c6f-55c2-4b73-b5dc-293c7a8a8079 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:42.997100 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd35c6f-55c2-4b73-b5dc-293c7a8a8079 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:42.998598 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 162/316] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:43.005063 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15f28a-fe01-4bca-a34a-b2e6da56e05a None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:43.005321 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15f28a-fe01-4bca-a34a-b2e6da56e05a None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:43.006128 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15f28a-fe01-4bca-a34a-b2e6da56e05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:43.028729 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-0a15f28a-fe01-4bca-a34a-b2e6da56e05a None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:43.030129 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-0a15f28a-fe01-4bca-a34a-b2e6da56e05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:43.113045 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 163/317] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:49:43.129602 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 155/318] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:49:43.137274 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15f28a-fe01-4bca-a34a-b2e6da56e05a None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:43.138845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5c6f1-bc60-4eea-a9ef-68bbc21bd532 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:43.265944 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5c6f1-bc60-4eea-a9ef-68bbc21bd532 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:43.294920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15f28a-fe01-4bca-a34a-b2e6da56e05a None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:43.311583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b35766-fb44-4a8b-9919-b6c78b7eb4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:43.312663 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b35766-fb44-4a8b-9919-b6c78b7eb4bd None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:43.313424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b35766-fb44-4a8b-9919-b6c78b7eb4bd None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:43.313704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b35766-fb44-4a8b-9919-b6c78b7eb4bd None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:43.315341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b35766-fb44-4a8b-9919-b6c78b7eb4bd None admin] RBAC: Authorizing `identity:get_project(project_id=5f5a44d5fda44f2586666bd534a896a4)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:43.317398 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b35766-fb44-4a8b-9919-b6c78b7eb4bd None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:43.319920 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 156/319] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:43 2022] GET /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:43.330266 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b35766-fb44-4a8b-9919-b6c78b7eb4bd None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:43.347349 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137097f-fab3-444e-a62a-f16710e41dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:43.349125 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137097f-fab3-444e-a62a-f16710e41dbe None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:43.349956 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137097f-fab3-444e-a62a-f16710e41dbe None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:43.350724 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137097f-fab3-444e-a62a-f16710e41dbe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:43.372298 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137097f-fab3-444e-a62a-f16710e41dbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:43.388509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-b137097f-fab3-444e-a62a-f16710e41dbe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:49:43.388509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:43.388509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:43.388509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:43.388509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:43.388509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:43.388509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:43.388509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:43.388509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:43.388509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:43.388509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:43.388509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:43.388509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:43.388509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:43.388509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:43.388509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:43.390192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:43.390192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:43.390192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:43.390192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:43.390192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:43.390192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:43.390192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:43.390192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:43.390192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:43.390192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:43.390192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:43.390192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:43.390192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:43.390192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:43.390192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:43.390192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:43.391955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:43.391955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:43.391955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:43.391955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:43.391955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:43.391955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:43.391955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:43.391955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:43.391955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:43.391955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:43.391955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:49:43.391955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:43.396418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 164/320] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:43.404916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137097f-fab3-444e-a62a-f16710e41dbe None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:43.449338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b35766-fb44-4a8b-9919-b6c78b7eb4bd None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:43.486545 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63b5bb-d352-434f-a712-780d9f53abbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:43.487351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63b5bb-d352-434f-a712-780d9f53abbc None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:43.487697 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63b5bb-d352-434f-a712-780d9f53abbc None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:43.488086 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63b5bb-d352-434f-a712-780d9f53abbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:43.489052 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63b5bb-d352-434f-a712-780d9f53abbc None admin] RBAC: Adding query filter params (role.id=8a5dc4dc644046d487fb9977cd999599, scope.project.id=5f5a44d5fda44f2586666bd534a896a4, user.id=81792c0a5eb145268a4d8b04b1b539d2) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:43.489428 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63b5bb-d352-434f-a712-780d9f53abbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:43.491506 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63b5bb-d352-434f-a712-780d9f53abbc None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:43.498748 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 157/321] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:49:43 2022] GET /identity/v3/role_assignments?user.id=81792c0a5eb145268a4d8b04b1b539d2&scope.project.id=5f5a44d5fda44f2586666bd534a896a4&role.id=8a5dc4dc644046d487fb9977cd999599 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:43.586586 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137097f-fab3-444e-a62a-f16710e41dbe None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:43.628178 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244d2dc-1d1d-4c1a-b882-f016b72827db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:43.629185 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244d2dc-1d1d-4c1a-b882-f016b72827db None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:43.629651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244d2dc-1d1d-4c1a-b882-f016b72827db None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:43.630131 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244d2dc-1d1d-4c1a-b882-f016b72827db None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:43.631117 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244d2dc-1d1d-4c1a-b882-f016b72827db None admin] RBAC: Adding query filter params (name=reader) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:43.631613 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244d2dc-1d1d-4c1a-b882-f016b72827db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:43.633307 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244d2dc-1d1d-4c1a-b882-f016b72827db None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:43.643532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 165/322] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:43.650473 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63b5bb-d352-434f-a712-780d9f53abbc None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:43.834190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63b5bb-d352-434f-a712-780d9f53abbc None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:43.889893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1eea8-c2d4-455e-a59d-871a37bf9e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:43.890796 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1eea8-c2d4-455e-a59d-871a37bf9e1f None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:43.891366 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1eea8-c2d4-455e-a59d-871a37bf9e1f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:43.891831 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1eea8-c2d4-455e-a59d-871a37bf9e1f None admin] PATH_INFO: `/v3/users/9a1572f1c58b421c8daee34e128283a9` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:43.894075 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1eea8-c2d4-455e-a59d-871a37bf9e1f None admin] RBAC: Authorizing `identity:get_user(user_id=9a1572f1c58b421c8daee34e128283a9)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:43.895958 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1eea8-c2d4-455e-a59d-871a37bf9e1f None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:43.897900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 158/323] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:43 2022] GET /identity/v3/users/9a1572f1c58b421c8daee34e128283a9 => generated 293 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:43.904217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244d2dc-1d1d-4c1a-b882-f016b72827db None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:44.090658 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244d2dc-1d1d-4c1a-b882-f016b72827db None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:44.156056 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546287d3-e37e-4fee-a4bd-0f9322b63321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:44.157504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546287d3-e37e-4fee-a4bd-0f9322b63321 None admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:44.158017 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546287d3-e37e-4fee-a4bd-0f9322b63321 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:44.158517 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546287d3-e37e-4fee-a4bd-0f9322b63321 None admin] PATH_INFO: `/v3/system/users/9a1572f1c58b421c8daee34e128283a9/roles/8a5dc4dc644046d487fb9977cd999599` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:44.161312 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546287d3-e37e-4fee-a4bd-0f9322b63321 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9a1572f1c58b421c8daee34e128283a9, role_id=8a5dc4dc644046d487fb9977cd999599)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:44.164056 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546287d3-e37e-4fee-a4bd-0f9322b63321 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:44.179867 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 166/324] 10.222.0.73 () {58 vars in 1334 bytes} [Fri May 13 14:49:43 2022] PUT /identity/v3/system/users/9a1572f1c58b421c8daee34e128283a9/roles/8a5dc4dc644046d487fb9977cd999599 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:49:44.578745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c9a69-e7c6-4084-b073-ff35a8c0285f None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:44.579533 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c9a69-e7c6-4084-b073-ff35a8c0285f None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:44.579533 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c9a69-e7c6-4084-b073-ff35a8c0285f None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:44.580861 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 159/325] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:49:44.587939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5704bdb-7a3e-498f-9761-5d47896ff029 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:44.588553 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5704bdb-7a3e-498f-9761-5d47896ff029 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:44.589145 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5704bdb-7a3e-498f-9761-5d47896ff029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:44.612375 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-c5704bdb-7a3e-498f-9761-5d47896ff029 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:44.613816 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c5704bdb-7a3e-498f-9761-5d47896ff029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:44.691509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 167/326] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:49:44.715619 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c9a69-e7c6-4084-b073-ff35a8c0285f None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:44.875255 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c9a69-e7c6-4084-b073-ff35a8c0285f None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:44.921600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00952f6b-9f42-4d6e-b594-c8a25f2fc29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:44.922425 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00952f6b-9f42-4d6e-b594-c8a25f2fc29d None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:44.922705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00952f6b-9f42-4d6e-b594-c8a25f2fc29d None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:44.923010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00952f6b-9f42-4d6e-b594-c8a25f2fc29d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:44.924347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00952f6b-9f42-4d6e-b594-c8a25f2fc29d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:44.926011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00952f6b-9f42-4d6e-b594-c8a25f2fc29d None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:44.928072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 160/327] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:49:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:44.935129 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5704bdb-7a3e-498f-9761-5d47896ff029 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:45.120799 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5704bdb-7a3e-498f-9761-5d47896ff029 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:45.183438 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be8cdc-03d3-4f82-8c0c-4976e7f95e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:45.184450 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be8cdc-03d3-4f82-8c0c-4976e7f95e26 None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:45.184930 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be8cdc-03d3-4f82-8c0c-4976e7f95e26 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:45.185413 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be8cdc-03d3-4f82-8c0c-4976e7f95e26 None admin] PATH_INFO: `/v3/groups` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:45.186501 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be8cdc-03d3-4f82-8c0c-4976e7f95e26 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:45.189076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be8cdc-03d3-4f82-8c0c-4976e7f95e26 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:45.219154 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 168/328] 10.222.0.73 () {60 vars in 1134 bytes} [Fri May 13 14:49:44 2022] POST /identity/v3/groups => generated 226 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:49:45.563952 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79221a-dc50-4e72-8af9-a202108069de None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:45.564304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79221a-dc50-4e72-8af9-a202108069de None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:45.564761 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79221a-dc50-4e72-8af9-a202108069de None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:45.566581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 161/329] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:45.574899 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd13c3c-2690-4859-8a21-e56b2e4ce12a None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:45.575365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd13c3c-2690-4859-8a21-e56b2e4ce12a None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:45.575825 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd13c3c-2690-4859-8a21-e56b2e4ce12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:45.597920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-dbd13c3c-2690-4859-8a21-e56b2e4ce12a None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:45.599374 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-dbd13c3c-2690-4859-8a21-e56b2e4ce12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:45.729027 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 169/330] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:45.772665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79221a-dc50-4e72-8af9-a202108069de None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:45.977696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79221a-dc50-4e72-8af9-a202108069de None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:46.059992 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdad70-6dea-414d-a77b-ad1b197dca1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:46.061355 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdad70-6dea-414d-a77b-ad1b197dca1b None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:46.061826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdad70-6dea-414d-a77b-ad1b197dca1b None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:46.062324 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdad70-6dea-414d-a77b-ad1b197dca1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:46.084616 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdad70-6dea-414d-a77b-ad1b197dca1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:46.100807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-43cdad70-6dea-414d-a77b-ad1b197dca1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:46.100807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:46.100807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:46.100807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:46.100807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:46.100807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:46.100807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:46.100807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:46.100807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:46.100807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:46.100807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:46.100807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:46.100807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:46.100807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:46.100807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:46.100807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:46.103112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:46.103112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:46.103112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:46.103112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:46.103112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:46.103112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:46.103112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:46.103112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:46.103112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:46.103112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:46.103112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:46.103112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:49:46.103112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:46.103112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:46.103112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:46.103112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:46.104694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:46.104694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:46.104694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:46.104694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:46.104694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:46.104694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:46.104694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:46.104694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:46.104694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:46.104694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:46.104694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:46.104694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:49:46.110888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 162/331] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:46.116452 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd13c3c-2690-4859-8a21-e56b2e4ce12a None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:46.337782 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd13c3c-2690-4859-8a21-e56b2e4ce12a None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:46.409588 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd5eb0-8a58-4b5b-b259-0030fd4cc902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:46.411155 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd5eb0-8a58-4b5b-b259-0030fd4cc902 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:46.411883 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd5eb0-8a58-4b5b-b259-0030fd4cc902 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:46.412627 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd5eb0-8a58-4b5b-b259-0030fd4cc902 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:46.415040 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd5eb0-8a58-4b5b-b259-0030fd4cc902 None admin] RBAC: Adding query filter params (name=member) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:46.415807 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd5eb0-8a58-4b5b-b259-0030fd4cc902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:46.418744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd5eb0-8a58-4b5b-b259-0030fd4cc902 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:46.436239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 170/332] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:46.442287 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdad70-6dea-414d-a77b-ad1b197dca1b None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:46.696197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdad70-6dea-414d-a77b-ad1b197dca1b None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:46.776482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f3f6f-6b25-4dcd-9973-aa88f31c4cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:46.777993 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f3f6f-6b25-4dcd-9973-aa88f31c4cee None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:46.778481 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f3f6f-6b25-4dcd-9973-aa88f31c4cee None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:46.779006 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f3f6f-6b25-4dcd-9973-aa88f31c4cee None admin] PATH_INFO: `/v3/users/47fba3d547df4b4eb02f45ffe817a223` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:46.784295 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f3f6f-6b25-4dcd-9973-aa88f31c4cee None admin] RBAC: Authorizing `identity:get_user(user_id=47fba3d547df4b4eb02f45ffe817a223)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:46.787114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f3f6f-6b25-4dcd-9973-aa88f31c4cee None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:46.790724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 163/333] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:46 2022] GET /identity/v3/users/47fba3d547df4b4eb02f45ffe817a223 => generated 293 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:46.797046 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd5eb0-8a58-4b5b-b259-0030fd4cc902 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:46.974684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd5eb0-8a58-4b5b-b259-0030fd4cc902 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:47.010859 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc88e43-cd32-46a3-88a3-22cd2503f94b None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:47.010859 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc88e43-cd32-46a3-88a3-22cd2503f94b None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:47.010859 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc88e43-cd32-46a3-88a3-22cd2503f94b None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:47.012181 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 164/334] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:47.019958 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0fd4c-009c-4642-909f-e3ac7bb95b9c None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:47.020561 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0fd4c-009c-4642-909f-e3ac7bb95b9c None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:47.021031 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0fd4c-009c-4642-909f-e3ac7bb95b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:47.028942 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407f6f9-2993-45c8-806e-f0a5eab51b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:47.030056 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407f6f9-2993-45c8-806e-f0a5eab51b46 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:47.030550 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407f6f9-2993-45c8-806e-f0a5eab51b46 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:47.031044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407f6f9-2993-45c8-806e-f0a5eab51b46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:47.032075 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407f6f9-2993-45c8-806e-f0a5eab51b46 None admin] RBAC: Adding query filter params (role.id=0268e6ac6fb649eb89da825c5ae328ab, user.id=47fba3d547df4b4eb02f45ffe817a223, scope.system=all) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:47.032575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407f6f9-2993-45c8-806e-f0a5eab51b46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:47.034455 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407f6f9-2993-45c8-806e-f0a5eab51b46 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:47.048075 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 171/335] 10.222.0.73 () {56 vars in 1308 bytes} [Fri May 13 14:49:46 2022] GET /identity/v3/role_assignments?user.id=47fba3d547df4b4eb02f45ffe817a223&scope.system=all&role.id=0268e6ac6fb649eb89da825c5ae328ab => generated 510 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:47.069073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-6af0fd4c-009c-4642-909f-e3ac7bb95b9c None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:47.071954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-6af0fd4c-009c-4642-909f-e3ac7bb95b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:47.234579 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 165/336] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:49:47.279019 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407f6f9-2993-45c8-806e-f0a5eab51b46 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:47.414673 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407f6f9-2993-45c8-806e-f0a5eab51b46 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:47.453531 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fd990-0b83-46bb-a36c-70f57a168cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:47.454708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fd990-0b83-46bb-a36c-70f57a168cb7 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:47.455233 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fd990-0b83-46bb-a36c-70f57a168cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:47.455733 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fd990-0b83-46bb-a36c-70f57a168cb7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:47.469785 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5fd990-0b83-46bb-a36c-70f57a168cb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:47.478499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-cc5fd990-0b83-46bb-a36c-70f57a168cb7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:49:47.478499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:47.478499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:47.478499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:47.478499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:47.478499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:47.478499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:47.478499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:47.478499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:47.478499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:47.478499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:47.478499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:47.478499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:47.478499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:47.478499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:47.478499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:47.479529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:47.479529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:47.479529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:47.479529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:47.479529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:47.479529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:47.479529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:47.479529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:47.479529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:47.479529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:47.479529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:47.479529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:47.479529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:47.479529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:47.479529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:47.479529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:47.480325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:47.480325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:47.480325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:47.480325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:47.480325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:47.480325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:47.480325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:47.480325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:47.480325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:47.480325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:47.480325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 14:49:47.480325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:47.482938 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 172/337] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:47.489529 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0fd4c-009c-4642-909f-e3ac7bb95b9c None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:47.618972 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0fd4c-009c-4642-909f-e3ac7bb95b9c None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:47.661104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d43768-2a53-494e-8cbb-25bffd50aa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:47.662150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d43768-2a53-494e-8cbb-25bffd50aa07 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:47.662623 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d43768-2a53-494e-8cbb-25bffd50aa07 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:47.663155 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d43768-2a53-494e-8cbb-25bffd50aa07 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:47.664176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d43768-2a53-494e-8cbb-25bffd50aa07 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:47.664761 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d43768-2a53-494e-8cbb-25bffd50aa07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:47.666435 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d43768-2a53-494e-8cbb-25bffd50aa07 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:47.679350 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 166/338] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:47.686551 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fd990-0b83-46bb-a36c-70f57a168cb7 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:47.944614 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fd990-0b83-46bb-a36c-70f57a168cb7 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:48.016047 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858cc0d-9b2f-4f12-93bd-36771becafa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:48.017459 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858cc0d-9b2f-4f12-93bd-36771becafa3 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:48.017895 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858cc0d-9b2f-4f12-93bd-36771becafa3 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:48.018330 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858cc0d-9b2f-4f12-93bd-36771becafa3 None admin] PATH_INFO: `/v3/users/9a1572f1c58b421c8daee34e128283a9` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:48.020459 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858cc0d-9b2f-4f12-93bd-36771becafa3 None admin] RBAC: Authorizing `identity:get_user(user_id=9a1572f1c58b421c8daee34e128283a9)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:48.022204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858cc0d-9b2f-4f12-93bd-36771becafa3 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:48.024656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 173/339] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:49:47 2022] GET /identity/v3/users/9a1572f1c58b421c8daee34e128283a9 => generated 293 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:48.031065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d43768-2a53-494e-8cbb-25bffd50aa07 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:48.175503 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d43768-2a53-494e-8cbb-25bffd50aa07 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:48.214108 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8930609-121e-455a-af83-280e0ceba1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:48.215165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8930609-121e-455a-af83-280e0ceba1bc None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:48.215644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8930609-121e-455a-af83-280e0ceba1bc None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:48.216135 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8930609-121e-455a-af83-280e0ceba1bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:48.217170 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8930609-121e-455a-af83-280e0ceba1bc None admin] RBAC: Adding query filter params (role.id=8a5dc4dc644046d487fb9977cd999599, user.id=9a1572f1c58b421c8daee34e128283a9, scope.system=all) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:48.217701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8930609-121e-455a-af83-280e0ceba1bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:48.219577 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8930609-121e-455a-af83-280e0ceba1bc None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:48.233282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 167/340] 10.222.0.73 () {56 vars in 1308 bytes} [Fri May 13 14:49:48 2022] GET /identity/v3/role_assignments?user.id=9a1572f1c58b421c8daee34e128283a9&scope.system=all&role.id=8a5dc4dc644046d487fb9977cd999599 => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:49.037993 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cae91-78c7-40a9-869c-3d68464224f5 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:49.039527 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cae91-78c7-40a9-869c-3d68464224f5 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:49.040003 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cae91-78c7-40a9-869c-3d68464224f5 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:49.041906 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 174/341] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:49.047333 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbf9b2-4b01-43bd-8e76-a0b737e7ca9b None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:49.048236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbf9b2-4b01-43bd-8e76-a0b737e7ca9b None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:49.048704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbf9b2-4b01-43bd-8e76-a0b737e7ca9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:49.071188 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-86bbf9b2-4b01-43bd-8e76-a0b737e7ca9b None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:49.072740 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-86bbf9b2-4b01-43bd-8e76-a0b737e7ca9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:49.165138 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 168/342] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:49.203293 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cae91-78c7-40a9-869c-3d68464224f5 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:49.340042 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cae91-78c7-40a9-869c-3d68464224f5 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:49.380148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0d7b3-6b6b-4dc3-a6b8-ea5ec0d70e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:49.381341 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0d7b3-6b6b-4dc3-a6b8-ea5ec0d70e08 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:49.381920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0d7b3-6b6b-4dc3-a6b8-ea5ec0d70e08 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:49.382401 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0d7b3-6b6b-4dc3-a6b8-ea5ec0d70e08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:49.394693 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0d7b3-6b6b-4dc3-a6b8-ea5ec0d70e08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:49.403952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-6ca0d7b3-6b6b-4dc3-a6b8-ea5ec0d70e08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:49:49.403952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:49.403952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:49.403952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:49.403952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:49.403952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:49.403952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:49.403952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:49.403952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:49.403952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:49.403952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:49.403952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:49.403952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:49.403952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:49.403952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:49.403952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:49.404888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:49.404888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:49.404888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:49.404888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:49.404888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:49.404888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:49.404888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:49.404888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:49.404888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:49.404888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:49.404888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:49.404888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:49.404888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:49.404888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:49.404888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:49.404888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:49.405658 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:49.405658 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:49.405658 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:49.405658 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:49.405658 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:49.405658 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:49.405658 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:49.405658 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:49.405658 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:49.405658 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:49.405658 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:49:49.405658 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:49.408504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 175/343] 10.222.0.73 () {56 vars in 1114 bytes} [Fri May 13 14:49:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:49.415483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbf9b2-4b01-43bd-8e76-a0b737e7ca9b None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:49.528615 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a87b1a-4c37-4b96-ad73-29bea9f24d0c None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:49.529218 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a87b1a-4c37-4b96-ad73-29bea9f24d0c None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:49.529801 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a87b1a-4c37-4b96-ad73-29bea9f24d0c None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:49.531511 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 176/344] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:49:49.545583 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd409f-e0a9-44da-a9cd-4926fd79829e None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:49.546223 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd409f-e0a9-44da-a9cd-4926fd79829e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:49.546710 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd409f-e0a9-44da-a9cd-4926fd79829e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:49.576633 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-6ebd409f-e0a9-44da-a9cd-4926fd79829e None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:49.578263 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6ebd409f-e0a9-44da-a9cd-4926fd79829e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:49.584645 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbf9b2-4b01-43bd-8e76-a0b737e7ca9b None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:49.627134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f991d-a728-463d-96e4-ad4ebf0019ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:49.628774 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f991d-a728-463d-96e4-ad4ebf0019ae None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:49.629289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f991d-a728-463d-96e4-ad4ebf0019ae None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:49.629737 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f991d-a728-463d-96e4-ad4ebf0019ae None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:49.630703 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f991d-a728-463d-96e4-ad4ebf0019ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:49.631176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f991d-a728-463d-96e4-ad4ebf0019ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:49.634567 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f991d-a728-463d-96e4-ad4ebf0019ae None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:49.645828 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 169/345] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:49:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:49.653082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f991d-a728-463d-96e4-ad4ebf0019ae None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:49.813766 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 177/346] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:49.845883 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f991d-a728-463d-96e4-ad4ebf0019ae None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:49.884544 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd409f-e0a9-44da-a9cd-4926fd79829e None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:49.892848 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433adbf-36e9-4bdb-b82c-0447ce9aac04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:49.893540 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433adbf-36e9-4bdb-b82c-0447ce9aac04 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:49.893808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433adbf-36e9-4bdb-b82c-0447ce9aac04 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:49.894134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433adbf-36e9-4bdb-b82c-0447ce9aac04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:50.081731 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433adbf-36e9-4bdb-b82c-0447ce9aac04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:50.090285 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433adbf-36e9-4bdb-b82c-0447ce9aac04 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:50.092582 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd409f-e0a9-44da-a9cd-4926fd79829e None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:50.136899 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092df42d-3384-4056-9bbd-868d7c324ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:50.137972 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092df42d-3384-4056-9bbd-868d7c324ae9 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:50.138401 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092df42d-3384-4056-9bbd-868d7c324ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:50.138870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092df42d-3384-4056-9bbd-868d7c324ae9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:50.151084 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092df42d-3384-4056-9bbd-868d7c324ae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:50.159241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-092df42d-3384-4056-9bbd-868d7c324ae9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:50.159241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:50.159241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:50.159241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:50.159241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:50.159241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:50.159241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:50.159241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:50.159241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:50.159241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:50.159241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:50.159241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:50.159241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:50.159241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:50.159241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:50.159241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:50.160423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:50.160423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:50.160423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:50.160423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:50.160423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:50.160423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:50.160423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:50.160423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:50.160423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:50.160423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:50.160423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:50.160423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:50.160423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:50.160423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:50.160423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:50.160423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:50.161442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:50.161442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:50.161442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:50.161442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:50.161442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:50.161442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:50.161442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:50.161442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:50.161442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:50.161442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:50.161442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:50.161442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:50.163499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 178/347] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:49:50.170602 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092df42d-3384-4056-9bbd-868d7c324ae9 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:50.320989 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092df42d-3384-4056-9bbd-868d7c324ae9 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:50.330161 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 170/348] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 14:49:50.334235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b1ec8-6985-4bee-ad19-9151e78fda4b None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:50.334867 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b1ec8-6985-4bee-ad19-9151e78fda4b None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:50.335325 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b1ec8-6985-4bee-ad19-9151e78fda4b None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:50.337288 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 171/349] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:50.348338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71d225-9735-4bbd-bdf4-834612dc8b9b None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:50.348966 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71d225-9735-4bbd-bdf4-834612dc8b9b None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:50.349254 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71d225-9735-4bbd-bdf4-834612dc8b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:50.384052 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-7b71d225-9735-4bbd-bdf4-834612dc8b9b None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:50.385269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-7b71d225-9735-4bbd-bdf4-834612dc8b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:50.416642 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dc5e2-03d6-479c-a206-3d718692f743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:50.417819 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dc5e2-03d6-479c-a206-3d718692f743 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:50.419078 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dc5e2-03d6-479c-a206-3d718692f743 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:50.419583 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dc5e2-03d6-479c-a206-3d718692f743 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:50.421152 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dc5e2-03d6-479c-a206-3d718692f743 None admin] RBAC: Adding query filter params (name=member) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:50.421820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dc5e2-03d6-479c-a206-3d718692f743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:50.426199 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dc5e2-03d6-479c-a206-3d718692f743 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:50.445169 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 179/350] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:50.450923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dc5e2-03d6-479c-a206-3d718692f743 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:50.488173 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 172/351] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:50.489192 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71d225-9735-4bbd-bdf4-834612dc8b9b None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:50.620873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71d225-9735-4bbd-bdf4-834612dc8b9b None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:50.662183 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc3b3f-4cd9-4a7e-b68a-328ce1f0eeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:50.666228 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc3b3f-4cd9-4a7e-b68a-328ce1f0eeaf None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:50.666742 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc3b3f-4cd9-4a7e-b68a-328ce1f0eeaf None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:50.667204 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc3b3f-4cd9-4a7e-b68a-328ce1f0eeaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:50.696281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dc5e2-03d6-479c-a206-3d718692f743 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:50.759209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc3b3f-4cd9-4a7e-b68a-328ce1f0eeaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:50.760714 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc3b3f-4cd9-4a7e-b68a-328ce1f0eeaf None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:50.781969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfc6f6-7935-46c2-848d-92215bbadbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:50.783085 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfc6f6-7935-46c2-848d-92215bbadbea None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:50.783427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfc6f6-7935-46c2-848d-92215bbadbea None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:50.783771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfc6f6-7935-46c2-848d-92215bbadbea None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:50.785983 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfc6f6-7935-46c2-848d-92215bbadbea None admin] RBAC: Authorizing `identity:get_project(project_id=04114986615247c2bbac8845c3c3a8e7)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:50.787761 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfc6f6-7935-46c2-848d-92215bbadbea None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:50.790853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 180/352] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:50 2022] GET /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7 => generated 298 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:50.791980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfc6f6-7935-46c2-848d-92215bbadbea None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:50.871566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 173/353] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:49:50.872365 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc3b3f-4cd9-4a7e-b68a-328ce1f0eeaf None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:50.983069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfc6f6-7935-46c2-848d-92215bbadbea None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:50.992055 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc3b3f-4cd9-4a7e-b68a-328ce1f0eeaf None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:51.043697 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd624834-2d76-4183-8ecb-f194862e2a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:51.044602 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd624834-2d76-4183-8ecb-f194862e2a50 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:51.044887 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd624834-2d76-4183-8ecb-f194862e2a50 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:51.045160 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd624834-2d76-4183-8ecb-f194862e2a50 None admin] PATH_INFO: `/v3/groups/e613d19d9c5443f18dd31035d9c46b7c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:51.051391 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f128d-c225-43b2-8cc6-b748785ccefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:51.052602 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f128d-c225-43b2-8cc6-b748785ccefd None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:51.053121 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f128d-c225-43b2-8cc6-b748785ccefd None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:51.053724 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f128d-c225-43b2-8cc6-b748785ccefd None admin] PATH_INFO: `/v3/roles/member` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:51.054066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd624834-2d76-4183-8ecb-f194862e2a50 None admin] RBAC: Authorizing `identity:get_group(group_id=e613d19d9c5443f18dd31035d9c46b7c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:51.055798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd624834-2d76-4183-8ecb-f194862e2a50 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:51.057870 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 174/354] 10.222.0.73 () {56 vars in 1180 bytes} [Fri May 13 14:49:50 2022] GET /identity/v3/groups/e613d19d9c5443f18dd31035d9c46b7c => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:51.058923 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd624834-2d76-4183-8ecb-f194862e2a50 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:51.074018 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f128d-c225-43b2-8cc6-b748785ccefd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:51.083225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-1c8f128d-c225-43b2-8cc6-b748785ccefd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:51.083225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:51.083225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:51.083225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:51.083225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:51.083225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:51.083225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:51.083225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:51.083225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:51.083225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:51.083225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:51.083225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:51.083225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:51.083225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:51.083225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:51.083225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:51.084186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:51.084186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:51.084186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:51.084186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:51.084186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:51.084186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:51.084186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:51.084186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:51.084186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:51.084186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:51.084186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:51.084186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:51.084186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:51.084186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:51.084186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:51.084186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:51.084991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:51.084991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:51.084991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:51.084991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:51.084991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:51.084991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:51.084991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:51.084991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:51.084991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:51.084991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:51.084991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:51.084991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:51.088646 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 181/355] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:51.089945 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f128d-c225-43b2-8cc6-b748785ccefd None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:51.213580 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd624834-2d76-4183-8ecb-f194862e2a50 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:51.226437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f128d-c225-43b2-8cc6-b748785ccefd None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:51.259268 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea9412-7664-4d97-b56c-f2bee0f3a165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:51.260560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea9412-7664-4d97-b56c-f2bee0f3a165 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:51.261065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea9412-7664-4d97-b56c-f2bee0f3a165 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:51.261545 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea9412-7664-4d97-b56c-f2bee0f3a165 None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:51.263112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea9412-7664-4d97-b56c-f2bee0f3a165 None admin] RBAC: Authorizing `identity:get_project(project_id=04114986615247c2bbac8845c3c3a8e7)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:51.264878 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea9412-7664-4d97-b56c-f2bee0f3a165 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:51.267007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 175/356] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:51 2022] GET /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:51.268327 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea9412-7664-4d97-b56c-f2bee0f3a165 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:51.274349 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25afcd-7de9-4d1c-a5d2-c230e63c8c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:51.275068 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25afcd-7de9-4d1c-a5d2-c230e63c8c02 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:51.275359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25afcd-7de9-4d1c-a5d2-c230e63c8c02 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:51.275642 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25afcd-7de9-4d1c-a5d2-c230e63c8c02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:51.276507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25afcd-7de9-4d1c-a5d2-c230e63c8c02 None admin] RBAC: Adding query filter params (group.id=e613d19d9c5443f18dd31035d9c46b7c, role.id=0a8d21e5149c42a8b85ca3c0258538d4, scope.project.id=04114986615247c2bbac8845c3c3a8e7) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:51.276829 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25afcd-7de9-4d1c-a5d2-c230e63c8c02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:51.278323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25afcd-7de9-4d1c-a5d2-c230e63c8c02 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:51.287649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 182/357] 10.222.0.73 () {56 vars in 1376 bytes} [Fri May 13 14:49:51 2022] GET /identity/v3/role_assignments?group.id=e613d19d9c5443f18dd31035d9c46b7c&scope.project.id=04114986615247c2bbac8845c3c3a8e7&role.id=0a8d21e5149c42a8b85ca3c0258538d4 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:51.289069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b4730-3b1d-4b20-8d3f-c358f024bf65 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:51.289423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b4730-3b1d-4b20-8d3f-c358f024bf65 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:51.289698 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b4730-3b1d-4b20-8d3f-c358f024bf65 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:51.291601 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 183/358] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:51.292671 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b4730-3b1d-4b20-8d3f-c358f024bf65 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:51.437413 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea9412-7664-4d97-b56c-f2bee0f3a165 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:51.460627 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b4730-3b1d-4b20-8d3f-c358f024bf65 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:51.519447 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd859629-b099-494e-9a6a-71346b966c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:51.519447 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd859629-b099-494e-9a6a-71346b966c0c None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:51.519780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59c04a-2c0a-4119-a05f-8a1a85cdd155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:51.519872 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd859629-b099-494e-9a6a-71346b966c0c None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:51.519872 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd859629-b099-494e-9a6a-71346b966c0c None admin] PATH_INFO: `/v3/groups/e613d19d9c5443f18dd31035d9c46b7c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:51.520008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59c04a-2c0a-4119-a05f-8a1a85cdd155 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:51.520008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59c04a-2c0a-4119-a05f-8a1a85cdd155 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:51.520008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59c04a-2c0a-4119-a05f-8a1a85cdd155 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:51.520008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59c04a-2c0a-4119-a05f-8a1a85cdd155 None admin] RBAC: Adding query filter params (name=member) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:51.520008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59c04a-2c0a-4119-a05f-8a1a85cdd155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:51.520298 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd859629-b099-494e-9a6a-71346b966c0c None admin] RBAC: Authorizing `identity:get_group(group_id=e613d19d9c5443f18dd31035d9c46b7c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:51.520886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59c04a-2c0a-4119-a05f-8a1a85cdd155 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:51.522771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd859629-b099-494e-9a6a-71346b966c0c None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:51.526395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 184/359] 10.222.0.73 () {56 vars in 1180 bytes} [Fri May 13 14:49:51 2022] GET /identity/v3/groups/e613d19d9c5443f18dd31035d9c46b7c => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:51.530226 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61bbd3-1850-41af-8d0c-c48f09e203a1 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:51.530703 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61bbd3-1850-41af-8d0c-c48f09e203a1 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:51.531546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61bbd3-1850-41af-8d0c-c48f09e203a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:51.536538 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 176/360] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:51.537856 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb30e2-98ae-4aa9-8bed-c140f7529951 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:51.538051 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb30e2-98ae-4aa9-8bed-c140f7529951 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:51.538272 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb30e2-98ae-4aa9-8bed-c140f7529951 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:51.540166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 177/361] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:51.541530 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb30e2-98ae-4aa9-8bed-c140f7529951 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:51.561573 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-6c61bbd3-1850-41af-8d0c-c48f09e203a1 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:51.562521 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6c61bbd3-1850-41af-8d0c-c48f09e203a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:51.669889 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 185/362] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:51.670994 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61bbd3-1850-41af-8d0c-c48f09e203a1 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:51.731022 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb30e2-98ae-4aa9-8bed-c140f7529951 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:51.798640 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb62f19-17b8-4903-81ce-043e97fcbadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:51.799273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb62f19-17b8-4903-81ce-043e97fcbadb None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:51.799551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb62f19-17b8-4903-81ce-043e97fcbadb None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:51.799828 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb62f19-17b8-4903-81ce-043e97fcbadb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:51.800680 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb62f19-17b8-4903-81ce-043e97fcbadb None admin] RBAC: Adding query filter params (group.id=e613d19d9c5443f18dd31035d9c46b7c, role.id=0268e6ac6fb649eb89da825c5ae328ab, scope.project.id=04114986615247c2bbac8845c3c3a8e7) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:51.800998 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb62f19-17b8-4903-81ce-043e97fcbadb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:51.802511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb62f19-17b8-4903-81ce-043e97fcbadb None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:51.809912 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 178/363] 10.222.0.73 () {56 vars in 1376 bytes} [Fri May 13 14:49:51 2022] GET /identity/v3/role_assignments?group.id=e613d19d9c5443f18dd31035d9c46b7c&scope.project.id=04114986615247c2bbac8845c3c3a8e7&role.id=0268e6ac6fb649eb89da825c5ae328ab => generated 260 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:51.812016 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184f4ce-e9e8-4beb-9101-949418d9491b None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:51.812365 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184f4ce-e9e8-4beb-9101-949418d9491b None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:51.812652 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184f4ce-e9e8-4beb-9101-949418d9491b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:51.833598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-d184f4ce-e9e8-4beb-9101-949418d9491b None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:51.834852 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-d184f4ce-e9e8-4beb-9101-949418d9491b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:51.880738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61bbd3-1850-41af-8d0c-c48f09e203a1 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:51.930865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbb60c-9ec4-444a-a844-ae160b2b3bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:51.930865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbb60c-9ec4-444a-a844-ae160b2b3bb7 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:51.930865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbb60c-9ec4-444a-a844-ae160b2b3bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:51.930865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbb60c-9ec4-444a-a844-ae160b2b3bb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:51.966735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 179/364] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:51.972603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184f4ce-e9e8-4beb-9101-949418d9491b None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:52.013124 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbb60c-9ec4-444a-a844-ae160b2b3bb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:52.014684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbb60c-9ec4-444a-a844-ae160b2b3bb7 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:52.133124 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 186/365] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:49:52.133858 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbb60c-9ec4-444a-a844-ae160b2b3bb7 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:52.193020 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184f4ce-e9e8-4beb-9101-949418d9491b None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:52.239974 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020ec6c-4674-4d33-8bdc-82a6d1b17061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:52.241081 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020ec6c-4674-4d33-8bdc-82a6d1b17061 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:52.241373 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020ec6c-4674-4d33-8bdc-82a6d1b17061 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:52.241649 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020ec6c-4674-4d33-8bdc-82a6d1b17061 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:52.256744 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020ec6c-4674-4d33-8bdc-82a6d1b17061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:52.265924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-8020ec6c-4674-4d33-8bdc-82a6d1b17061 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:49:52.265924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:52.265924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:52.265924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:52.265924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:52.265924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:52.265924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:52.265924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:52.265924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:52.265924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:52.265924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:52.265924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:52.265924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:52.265924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:52.265924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:52.265924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:52.266924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:52.266924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:52.266924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:52.266924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:52.266924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:52.266924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:52.266924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:52.266924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:52.266924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:52.266924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:52.266924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:52.266924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:49:52.266924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:52.266924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:52.266924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:52.266924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:52.267735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:52.267735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:52.267735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:52.267735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:52.267735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:52.267735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:52.267735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:52.267735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:52.267735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:52.267735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:52.267735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:49:52.267735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:49:52.268348 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 180/366] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:49:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:52.274858 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020ec6c-4674-4d33-8bdc-82a6d1b17061 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:52.323848 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbb60c-9ec4-444a-a844-ae160b2b3bb7 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:52.379635 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd4555-23f1-41a2-8c53-977bdaa35217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:52.380753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd4555-23f1-41a2-8c53-977bdaa35217 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:52.381241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd4555-23f1-41a2-8c53-977bdaa35217 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:52.381955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd4555-23f1-41a2-8c53-977bdaa35217 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:52.402384 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd4555-23f1-41a2-8c53-977bdaa35217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:52.414879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-34fd4555-23f1-41a2-8c53-977bdaa35217 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:49:52.414879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:52.414879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:52.414879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:52.414879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:52.414879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:52.414879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:52.414879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:52.414879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:52.414879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:52.414879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:52.414879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:52.414879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:52.414879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:52.414879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:52.414879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:52.415920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:52.415920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:52.415920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:52.415920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:52.415920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:52.415920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:52.415920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:52.415920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:52.415920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:52.415920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:52.415920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:52.415920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:52.415920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:52.415920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:52.415920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:52.415920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:52.416714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:52.416714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:52.416714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:52.416714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:52.416714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:52.416714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:52.416714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:52.416714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:52.416714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:52.416714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:52.416714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:49:52.416714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:52.416714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 187/367] 10.222.0.73 () {56 vars in 1114 bytes} [Fri May 13 14:49:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:52.416714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd4555-23f1-41a2-8c53-977bdaa35217 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:52.431431 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020ec6c-4674-4d33-8bdc-82a6d1b17061 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:52.472815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01398018-f420-4b72-8a44-9fbda0917782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:52.474203 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01398018-f420-4b72-8a44-9fbda0917782 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:52.474632 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01398018-f420-4b72-8a44-9fbda0917782 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:52.475092 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01398018-f420-4b72-8a44-9fbda0917782 None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:52.476672 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01398018-f420-4b72-8a44-9fbda0917782 None admin] RBAC: Authorizing `identity:get_project(project_id=5f5a44d5fda44f2586666bd534a896a4)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:52.478328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01398018-f420-4b72-8a44-9fbda0917782 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:52.481140 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 181/368] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:52 2022] GET /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:52.482261 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01398018-f420-4b72-8a44-9fbda0917782 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:52.558209 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd4555-23f1-41a2-8c53-977bdaa35217 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:52.600569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bab75-3bc2-486b-ac8c-1ff0aa9117ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:52.602201 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bab75-3bc2-486b-ac8c-1ff0aa9117ba None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:52.602711 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bab75-3bc2-486b-ac8c-1ff0aa9117ba None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:52.603214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bab75-3bc2-486b-ac8c-1ff0aa9117ba None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:52.604213 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bab75-3bc2-486b-ac8c-1ff0aa9117ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:52.604742 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bab75-3bc2-486b-ac8c-1ff0aa9117ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:52.606360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bab75-3bc2-486b-ac8c-1ff0aa9117ba None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:52.615775 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 188/369] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:52.617548 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bab75-3bc2-486b-ac8c-1ff0aa9117ba None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:52.619012 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01398018-f420-4b72-8a44-9fbda0917782 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:52.667733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bff904-36e1-4c6d-9e03-a2608c65f691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:52.669134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bff904-36e1-4c6d-9e03-a2608c65f691 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:52.669626 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bff904-36e1-4c6d-9e03-a2608c65f691 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:52.669922 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bff904-36e1-4c6d-9e03-a2608c65f691 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:52.670694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bff904-36e1-4c6d-9e03-a2608c65f691 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:52.671030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bff904-36e1-4c6d-9e03-a2608c65f691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:52.672985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bff904-36e1-4c6d-9e03-a2608c65f691 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:52.685046 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 182/370] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:49:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:52.687083 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bff904-36e1-4c6d-9e03-a2608c65f691 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:52.756048 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bab75-3bc2-486b-ac8c-1ff0aa9117ba None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:52.823481 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d9bcd-d5a1-45b8-8f0d-f26ccf366def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:52.825572 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d9bcd-d5a1-45b8-8f0d-f26ccf366def None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:52.826506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d9bcd-d5a1-45b8-8f0d-f26ccf366def None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:52.829153 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d9bcd-d5a1-45b8-8f0d-f26ccf366def None admin] PATH_INFO: `/v3/groups/e613d19d9c5443f18dd31035d9c46b7c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:52.832145 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d9bcd-d5a1-45b8-8f0d-f26ccf366def None admin] RBAC: Authorizing `identity:get_group(group_id=e613d19d9c5443f18dd31035d9c46b7c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:52.835527 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d9bcd-d5a1-45b8-8f0d-f26ccf366def None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:52.839077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bff904-36e1-4c6d-9e03-a2608c65f691 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:52.839810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 189/371] 10.222.0.73 () {56 vars in 1180 bytes} [Fri May 13 14:49:52 2022] GET /identity/v3/groups/e613d19d9c5443f18dd31035d9c46b7c => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:52.841516 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d9bcd-d5a1-45b8-8f0d-f26ccf366def None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:52.898560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349de047-a129-4ed2-8330-77c546d218c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:52.898560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349de047-a129-4ed2-8330-77c546d218c5 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:52.898560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349de047-a129-4ed2-8330-77c546d218c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:52.898560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349de047-a129-4ed2-8330-77c546d218c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:53.014058 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349de047-a129-4ed2-8330-77c546d218c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:53.017345 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349de047-a129-4ed2-8330-77c546d218c5 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:53.064236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d9bcd-d5a1-45b8-8f0d-f26ccf366def None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:53.133611 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213424e-a2b4-4f0f-9aec-61715e200045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:53.135092 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213424e-a2b4-4f0f-9aec-61715e200045 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:53.135915 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213424e-a2b4-4f0f-9aec-61715e200045 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:53.136661 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213424e-a2b4-4f0f-9aec-61715e200045 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:53.145886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 183/372] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:49:53.146874 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349de047-a129-4ed2-8330-77c546d218c5 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:53.260441 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349de047-a129-4ed2-8330-77c546d218c5 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:53.283977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213424e-a2b4-4f0f-9aec-61715e200045 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:53.287247 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213424e-a2b4-4f0f-9aec-61715e200045 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:53.299012 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73df8da-c1f6-4120-8c66-110528e15d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:53.299697 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73df8da-c1f6-4120-8c66-110528e15d32 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:53.299983 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73df8da-c1f6-4120-8c66-110528e15d32 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:53.300263 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73df8da-c1f6-4120-8c66-110528e15d32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:53.301115 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73df8da-c1f6-4120-8c66-110528e15d32 None admin] RBAC: Adding query filter params (group.id=e613d19d9c5443f18dd31035d9c46b7c, role.id=0268e6ac6fb649eb89da825c5ae328ab, scope.project.id=5f5a44d5fda44f2586666bd534a896a4) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:53.301492 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73df8da-c1f6-4120-8c66-110528e15d32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:53.303028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73df8da-c1f6-4120-8c66-110528e15d32 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:53.309682 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 184/373] 10.222.0.73 () {56 vars in 1376 bytes} [Fri May 13 14:49:53 2022] GET /identity/v3/role_assignments?group.id=e613d19d9c5443f18dd31035d9c46b7c&scope.project.id=5f5a44d5fda44f2586666bd534a896a4&role.id=0268e6ac6fb649eb89da825c5ae328ab => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:53.310399 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73df8da-c1f6-4120-8c66-110528e15d32 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:53.423880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73df8da-c1f6-4120-8c66-110528e15d32 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:53.462599 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610fe10-1ea6-4f9e-8ad7-11d4333e60c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:53.463540 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610fe10-1ea6-4f9e-8ad7-11d4333e60c0 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:53.463819 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610fe10-1ea6-4f9e-8ad7-11d4333e60c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:53.464095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610fe10-1ea6-4f9e-8ad7-11d4333e60c0 None admin] PATH_INFO: `/v3/projects/3f1a37e489724b9ca1990a3febe2d22a` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:53.465472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610fe10-1ea6-4f9e-8ad7-11d4333e60c0 None admin] RBAC: Authorizing `identity:get_project(project_id=3f1a37e489724b9ca1990a3febe2d22a)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:53.467053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610fe10-1ea6-4f9e-8ad7-11d4333e60c0 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:53.469127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 185/374] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:53 2022] GET /identity/v3/projects/3f1a37e489724b9ca1990a3febe2d22a => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:53.477525 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610fe10-1ea6-4f9e-8ad7-11d4333e60c0 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:53.495460 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 190/375] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:49:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:49:53.503908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213424e-a2b4-4f0f-9aec-61715e200045 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:53.691149 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610fe10-1ea6-4f9e-8ad7-11d4333e60c0 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:53.721749 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213424e-a2b4-4f0f-9aec-61715e200045 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:53.753900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f106a1-8c01-4b4c-af8f-5fba08aa5572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:53.756443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f106a1-8c01-4b4c-af8f-5fba08aa5572 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:53.757146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f106a1-8c01-4b4c-af8f-5fba08aa5572 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:53.758406 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f106a1-8c01-4b4c-af8f-5fba08aa5572 None admin] PATH_INFO: `/v3/groups/13b931504d3c4717bacee006528855ba` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:53.770991 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f106a1-8c01-4b4c-af8f-5fba08aa5572 None admin] RBAC: Authorizing `identity:get_group(group_id=13b931504d3c4717bacee006528855ba)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:53.774807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f106a1-8c01-4b4c-af8f-5fba08aa5572 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:53.779680 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 186/376] 10.222.0.73 () {56 vars in 1180 bytes} [Fri May 13 14:49:53 2022] GET /identity/v3/groups/13b931504d3c4717bacee006528855ba => generated 229 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:53.793240 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f106a1-8c01-4b4c-af8f-5fba08aa5572 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:53.798672 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6b2ca-ef5b-4d30-a82d-9b55b1dd1878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:53.800172 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6b2ca-ef5b-4d30-a82d-9b55b1dd1878 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:53.800648 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6b2ca-ef5b-4d30-a82d-9b55b1dd1878 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:53.801110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6b2ca-ef5b-4d30-a82d-9b55b1dd1878 None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:53.803310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6b2ca-ef5b-4d30-a82d-9b55b1dd1878 None admin] RBAC: Authorizing `identity:get_project(project_id=5f5a44d5fda44f2586666bd534a896a4)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:53.807025 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6b2ca-ef5b-4d30-a82d-9b55b1dd1878 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:53.818892 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 191/377] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:53 2022] GET /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4 => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:53.819261 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6b2ca-ef5b-4d30-a82d-9b55b1dd1878 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:54.047933 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6b2ca-ef5b-4d30-a82d-9b55b1dd1878 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:54.048585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f106a1-8c01-4b4c-af8f-5fba08aa5572 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:54.119002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d890aea-763f-4f0c-8ecf-52af9d9ab827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:54.119686 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d890aea-763f-4f0c-8ecf-52af9d9ab827 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:54.119969 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d890aea-763f-4f0c-8ecf-52af9d9ab827 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:54.120246 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d890aea-763f-4f0c-8ecf-52af9d9ab827 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:54.121114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d890aea-763f-4f0c-8ecf-52af9d9ab827 None admin] RBAC: Adding query filter params (group.id=13b931504d3c4717bacee006528855ba, role.id=b6fbf976763d4795afbfb53a09ec6f6c, scope.project.id=3f1a37e489724b9ca1990a3febe2d22a) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:54.121424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d890aea-763f-4f0c-8ecf-52af9d9ab827 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:54.122931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d890aea-763f-4f0c-8ecf-52af9d9ab827 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:54.128509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a4f64-36a6-42a3-8e50-03458f9744fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:54.129406 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a4f64-36a6-42a3-8e50-03458f9744fb None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:54.129703 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a4f64-36a6-42a3-8e50-03458f9744fb None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:54.129946 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a4f64-36a6-42a3-8e50-03458f9744fb None admin] PATH_INFO: `/v3/groups/e613d19d9c5443f18dd31035d9c46b7c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:54.132837 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a4f64-36a6-42a3-8e50-03458f9744fb None admin] RBAC: Authorizing `identity:get_group(group_id=e613d19d9c5443f18dd31035d9c46b7c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:54.134257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a4f64-36a6-42a3-8e50-03458f9744fb None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:54.136041 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 192/378] 10.222.0.73 () {56 vars in 1180 bytes} [Fri May 13 14:49:53 2022] GET /identity/v3/groups/e613d19d9c5443f18dd31035d9c46b7c => generated 226 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:54.139508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 187/379] 10.222.0.73 () {56 vars in 1376 bytes} [Fri May 13 14:49:53 2022] GET /identity/v3/role_assignments?group.id=13b931504d3c4717bacee006528855ba&scope.project.id=3f1a37e489724b9ca1990a3febe2d22a&role.id=b6fbf976763d4795afbfb53a09ec6f6c => generated 260 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:54.153273 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a4f64-36a6-42a3-8e50-03458f9744fb None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:54.372545 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a4f64-36a6-42a3-8e50-03458f9744fb None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:54.448991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e1283-4d5e-41b7-b7d2-a0e9badd655c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:54.450702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e1283-4d5e-41b7-b7d2-a0e9badd655c None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:54.451593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e1283-4d5e-41b7-b7d2-a0e9badd655c None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:54.452400 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e1283-4d5e-41b7-b7d2-a0e9badd655c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:54.454467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e1283-4d5e-41b7-b7d2-a0e9badd655c None admin] RBAC: Adding query filter params (group.id=e613d19d9c5443f18dd31035d9c46b7c, role.id=0a8d21e5149c42a8b85ca3c0258538d4, scope.project.id=5f5a44d5fda44f2586666bd534a896a4) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:54.455448 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e1283-4d5e-41b7-b7d2-a0e9badd655c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:54.458604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e1283-4d5e-41b7-b7d2-a0e9badd655c None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:54.475831 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 193/380] 10.222.0.73 () {56 vars in 1376 bytes} [Fri May 13 14:49:54 2022] GET /identity/v3/role_assignments?group.id=e613d19d9c5443f18dd31035d9c46b7c&scope.project.id=5f5a44d5fda44f2586666bd534a896a4&role.id=0a8d21e5149c42a8b85ca3c0258538d4 => generated 260 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:55.821830 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f5413-b2c3-48f4-aa6d-d0227282ed09 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:55.822391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f5413-b2c3-48f4-aa6d-d0227282ed09 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:55.822391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f5413-b2c3-48f4-aa6d-d0227282ed09 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:55.824162 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 188/381] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:55.831670 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e3466-7494-48cb-879a-c5e8c41f2d2a None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:55.832613 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e3466-7494-48cb-879a-c5e8c41f2d2a None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:55.833075 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e3466-7494-48cb-879a-c5e8c41f2d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:55.855983 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-0a3e3466-7494-48cb-879a-c5e8c41f2d2a None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:55.857666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-0a3e3466-7494-48cb-879a-c5e8c41f2d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:55.951460 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 194/382] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:56.014523 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f5413-b2c3-48f4-aa6d-d0227282ed09 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:56.071482 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d1932-205d-4502-944b-57b3ef5ce02d None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:56.072500 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d1932-205d-4502-944b-57b3ef5ce02d None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:56.073274 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d1932-205d-4502-944b-57b3ef5ce02d None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:56.077521 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 195/383] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:56.093581 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879bdfd-bb0a-4291-a436-6370b2bce30b None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:56.094470 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879bdfd-bb0a-4291-a436-6370b2bce30b None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:56.099560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879bdfd-bb0a-4291-a436-6370b2bce30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:56.156062 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f5413-b2c3-48f4-aa6d-d0227282ed09 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:56.161022 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-5879bdfd-bb0a-4291-a436-6370b2bce30b None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:56.163588 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-5879bdfd-bb0a-4291-a436-6370b2bce30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:56.232578 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7967f-1a87-4bdf-ae36-821cf71f723e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:56.233450 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7967f-1a87-4bdf-ae36-821cf71f723e None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:56.233733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7967f-1a87-4bdf-ae36-821cf71f723e None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:56.234006 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7967f-1a87-4bdf-ae36-821cf71f723e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:56.255457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7967f-1a87-4bdf-ae36-821cf71f723e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:56.275937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-22c7967f-1a87-4bdf-ae36-821cf71f723e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:56.275937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:56.275937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:56.275937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:56.275937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:56.275937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:56.275937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:56.275937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:56.275937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:56.275937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:56.275937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:56.275937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:56.275937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:56.275937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:56.275937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:56.275937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:56.277644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:56.277644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:56.277644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:56.277644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:56.277644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:56.277644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:56.277644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:56.277644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:56.277644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:56.277644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:56.277644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:56.277644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:49:56.277644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:56.277644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:56.277644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:56.277644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:56.280244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:56.280244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:56.280244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:56.280244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:56.280244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:56.280244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:56.280244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:56.280244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:56.280244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:56.280244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:56.280244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:56.280244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:49:56.280244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 189/384] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:56.287911 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7967f-1a87-4bdf-ae36-821cf71f723e None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:56.330804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 196/385] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:49:56.394118 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879bdfd-bb0a-4291-a436-6370b2bce30b None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:56.508720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7967f-1a87-4bdf-ae36-821cf71f723e None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:56.581581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6aedb3-0280-4d8a-ac3c-af6240cde57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:56.582976 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6aedb3-0280-4d8a-ac3c-af6240cde57d None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:56.583647 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6aedb3-0280-4d8a-ac3c-af6240cde57d None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:56.584295 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6aedb3-0280-4d8a-ac3c-af6240cde57d None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:56.586386 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6aedb3-0280-4d8a-ac3c-af6240cde57d None admin] RBAC: Adding query filter params (name=member) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:56.587145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6aedb3-0280-4d8a-ac3c-af6240cde57d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:56.589896 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6aedb3-0280-4d8a-ac3c-af6240cde57d None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:56.605515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 190/386] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:56.614597 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6aedb3-0280-4d8a-ac3c-af6240cde57d None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:56.683872 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879bdfd-bb0a-4291-a436-6370b2bce30b None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:56.750503 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996be3a-0f0d-40c5-92c5-53390ef2d2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:56.751496 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996be3a-0f0d-40c5-92c5-53390ef2d2e4 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:56.751694 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996be3a-0f0d-40c5-92c5-53390ef2d2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:56.751924 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996be3a-0f0d-40c5-92c5-53390ef2d2e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:56.761926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6aedb3-0280-4d8a-ac3c-af6240cde57d None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:56.767991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996be3a-0f0d-40c5-92c5-53390ef2d2e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:56.784561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-3996be3a-0f0d-40c5-92c5-53390ef2d2e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:49:56.784561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:56.784561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:56.784561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:56.784561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:56.784561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:56.784561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:56.784561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:56.784561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:56.784561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:56.784561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:56.784561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:56.784561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:56.784561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:56.784561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:56.784561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:56.785563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:56.785563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:56.785563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:56.785563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:56.785563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:56.785563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:56.785563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:56.785563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:56.785563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:56.785563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:56.785563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:56.785563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:56.785563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:56.785563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:56.785563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:56.785563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:56.786393 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:56.786393 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:56.786393 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:56.786393 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:56.786393 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:56.786393 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:56.786393 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:56.786393 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:56.786393 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:56.786393 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:56.786393 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:49:56.786393 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:56.786393 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 197/387] 10.222.0.73 () {56 vars in 1114 bytes} [Fri May 13 14:49:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:49:56.792087 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996be3a-0f0d-40c5-92c5-53390ef2d2e4 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:56.802645 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3ee1f-d8df-4e6e-9e11-31d05db67c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:56.804504 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3ee1f-d8df-4e6e-9e11-31d05db67c33 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:56.805025 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3ee1f-d8df-4e6e-9e11-31d05db67c33 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:56.805502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3ee1f-d8df-4e6e-9e11-31d05db67c33 None admin] PATH_INFO: `/v3/groups/e613d19d9c5443f18dd31035d9c46b7c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:56.807111 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3ee1f-d8df-4e6e-9e11-31d05db67c33 None admin] RBAC: Authorizing `identity:get_group(group_id=e613d19d9c5443f18dd31035d9c46b7c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:56.808804 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3ee1f-d8df-4e6e-9e11-31d05db67c33 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:56.815284 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 191/388] 10.222.0.73 () {56 vars in 1180 bytes} [Fri May 13 14:49:56 2022] GET /identity/v3/groups/e613d19d9c5443f18dd31035d9c46b7c => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:56.817947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3ee1f-d8df-4e6e-9e11-31d05db67c33 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:56.932244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3ee1f-d8df-4e6e-9e11-31d05db67c33 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:56.969824 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977d613-919a-4c1a-a86e-4c2721b6dadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:56.971113 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977d613-919a-4c1a-a86e-4c2721b6dadc None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:56.971608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977d613-919a-4c1a-a86e-4c2721b6dadc None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:56.972097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977d613-919a-4c1a-a86e-4c2721b6dadc None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:56.973581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977d613-919a-4c1a-a86e-4c2721b6dadc None admin] RBAC: Authorizing `identity:get_project(project_id=04114986615247c2bbac8845c3c3a8e7)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:56.975331 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977d613-919a-4c1a-a86e-4c2721b6dadc None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:56.978250 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 192/389] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:56 2022] GET /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:56.984163 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996be3a-0f0d-40c5-92c5-53390ef2d2e4 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:56.985050 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d47c9-ebc6-4cbd-b350-6cf3ddf6c69e None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:56.985645 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d47c9-ebc6-4cbd-b350-6cf3ddf6c69e None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:56.986004 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d47c9-ebc6-4cbd-b350-6cf3ddf6c69e None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:56.987755 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 193/390] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:56.988640 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d47c9-ebc6-4cbd-b350-6cf3ddf6c69e None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:57.016638 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d293084-6002-45e1-bb7b-db377a6f90fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:57.017676 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d293084-6002-45e1-bb7b-db377a6f90fe None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:57.018147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d293084-6002-45e1-bb7b-db377a6f90fe None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:57.018596 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d293084-6002-45e1-bb7b-db377a6f90fe None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:57.019587 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d293084-6002-45e1-bb7b-db377a6f90fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:57.020092 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d293084-6002-45e1-bb7b-db377a6f90fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:57.021696 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d293084-6002-45e1-bb7b-db377a6f90fe None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:57.031652 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 198/391] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:49:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:57.033263 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf75a4a-1d24-49ba-9427-061a4b6da72b None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:57.033792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf75a4a-1d24-49ba-9427-061a4b6da72b None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:57.034249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf75a4a-1d24-49ba-9427-061a4b6da72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:57.052625 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-9cf75a4a-1d24-49ba-9427-061a4b6da72b None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:57.054187 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-9cf75a4a-1d24-49ba-9427-061a4b6da72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:57.123186 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d47c9-ebc6-4cbd-b350-6cf3ddf6c69e None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:57.140944 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 199/392] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:57.147019 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf75a4a-1d24-49ba-9427-061a4b6da72b None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:57.183232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e0644-4760-431c-9e1d-52c992c7838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:57.184542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e0644-4760-431c-9e1d-52c992c7838c None admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:57.185062 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e0644-4760-431c-9e1d-52c992c7838c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:57.185563 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e0644-4760-431c-9e1d-52c992c7838c None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7/groups/e613d19d9c5443f18dd31035d9c46b7c/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:57.188330 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e0644-4760-431c-9e1d-52c992c7838c None admin] RBAC: Authorizing `identity:create_grant(project_id=04114986615247c2bbac8845c3c3a8e7, group_id=e613d19d9c5443f18dd31035d9c46b7c, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:57.190432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e0644-4760-431c-9e1d-52c992c7838c None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:57.221557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 194/393] 10.222.0.73 () {58 vars in 1442 bytes} [Fri May 13 14:49:56 2022] PUT /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7/groups/e613d19d9c5443f18dd31035d9c46b7c/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:49:57.224059 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e0644-4760-431c-9e1d-52c992c7838c None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:57.303473 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf75a4a-1d24-49ba-9427-061a4b6da72b None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:57.364440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0988437-718e-4958-b020-d4f80344424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:57.365245 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0988437-718e-4958-b020-d4f80344424b None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:57.365812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0988437-718e-4958-b020-d4f80344424b None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:57.366350 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0988437-718e-4958-b020-d4f80344424b None admin] PATH_INFO: `/v3/groups/e613d19d9c5443f18dd31035d9c46b7c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:57.368677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0988437-718e-4958-b020-d4f80344424b None admin] RBAC: Authorizing `identity:get_group(group_id=e613d19d9c5443f18dd31035d9c46b7c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:57.371742 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0988437-718e-4958-b020-d4f80344424b None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:57.382921 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 200/394] 10.222.0.73 () {56 vars in 1180 bytes} [Fri May 13 14:49:57 2022] GET /identity/v3/groups/e613d19d9c5443f18dd31035d9c46b7c => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:57.384902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0988437-718e-4958-b020-d4f80344424b None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:57.429711 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e0644-4760-431c-9e1d-52c992c7838c None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:57.504187 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429abb23-b23e-4757-8d9f-dd55a136b4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:57.506214 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429abb23-b23e-4757-8d9f-dd55a136b4c3 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:57.507032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429abb23-b23e-4757-8d9f-dd55a136b4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:57.508319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429abb23-b23e-4757-8d9f-dd55a136b4c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:57.542858 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429abb23-b23e-4757-8d9f-dd55a136b4c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:57.564479 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0988437-718e-4958-b020-d4f80344424b None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:57.566328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-429abb23-b23e-4757-8d9f-dd55a136b4c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:57.566328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:57.566328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:57.566328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:57.566328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:57.566328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:57.566328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:57.566328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:57.566328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:57.566328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:57.566328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:57.566328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:57.566328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:57.566328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:57.566328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:57.566328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:57.568177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:57.568177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:57.568177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:57.568177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:57.568177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:57.568177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:57.568177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:57.568177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:57.568177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:57.568177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:57.568177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:57.568177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:49:57.568177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:57.568177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:57.568177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:57.568177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:57.569659 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:57.569659 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:57.569659 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:57.569659 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:57.569659 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:57.569659 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:57.569659 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:57.569659 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:57.569659 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:57.569659 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:57.569659 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:49:57.569659 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:49:57.574204 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 195/395] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:57.580747 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429abb23-b23e-4757-8d9f-dd55a136b4c3 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:57.610551 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c543a2-adbf-4e32-a99c-569953d79feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:57.612150 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c543a2-adbf-4e32-a99c-569953d79feb None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:57.612611 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c543a2-adbf-4e32-a99c-569953d79feb None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:57.613063 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c543a2-adbf-4e32-a99c-569953d79feb None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:57.615346 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c543a2-adbf-4e32-a99c-569953d79feb None admin] RBAC: Authorizing `identity:get_project(project_id=04114986615247c2bbac8845c3c3a8e7)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:57.618503 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c543a2-adbf-4e32-a99c-569953d79feb None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:57.626641 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 201/396] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:57 2022] GET /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:57.633273 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c543a2-adbf-4e32-a99c-569953d79feb None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:57.767310 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429abb23-b23e-4757-8d9f-dd55a136b4c3 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:57.825495 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45063d6-3496-4428-9dd4-3a6904c8d05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:57.826570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45063d6-3496-4428-9dd4-3a6904c8d05a None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:57.827076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45063d6-3496-4428-9dd4-3a6904c8d05a None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:57.827538 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45063d6-3496-4428-9dd4-3a6904c8d05a None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:57.828912 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45063d6-3496-4428-9dd4-3a6904c8d05a None admin] RBAC: Adding query filter params (name=member) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:57.829414 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45063d6-3496-4428-9dd4-3a6904c8d05a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:57.832007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45063d6-3496-4428-9dd4-3a6904c8d05a None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:57.835373 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c543a2-adbf-4e32-a99c-569953d79feb None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:57.846948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 196/397] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:49:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:49:57.849268 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595dc44-be45-473c-a166-5785a36ce692 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:57.849789 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595dc44-be45-473c-a166-5785a36ce692 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:57.850236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595dc44-be45-473c-a166-5785a36ce692 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:57.853995 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 197/398] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:57.855398 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595dc44-be45-473c-a166-5785a36ce692 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:57.905743 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b30c6-b7bc-459d-93aa-0c726d81ced6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:57.907524 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b30c6-b7bc-459d-93aa-0c726d81ced6 None admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:57.907977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b30c6-b7bc-459d-93aa-0c726d81ced6 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:57.908421 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b30c6-b7bc-459d-93aa-0c726d81ced6 None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7/groups/e613d19d9c5443f18dd31035d9c46b7c/roles/0a8d21e5149c42a8b85ca3c0258538d4` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:57.913282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b30c6-b7bc-459d-93aa-0c726d81ced6 None admin] RBAC: Authorizing `identity:create_grant(project_id=04114986615247c2bbac8845c3c3a8e7, group_id=e613d19d9c5443f18dd31035d9c46b7c, role_id=0a8d21e5149c42a8b85ca3c0258538d4)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:57.916077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b30c6-b7bc-459d-93aa-0c726d81ced6 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:57.955184 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 202/399] 10.222.0.73 () {58 vars in 1442 bytes} [Fri May 13 14:49:57 2022] PUT /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7/groups/e613d19d9c5443f18dd31035d9c46b7c/roles/0a8d21e5149c42a8b85ca3c0258538d4 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:49:57.955184 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d83efc-1ec2-4cd7-afe2-aa6e0fa59153 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:57.955184 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d83efc-1ec2-4cd7-afe2-aa6e0fa59153 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:57.955184 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d83efc-1ec2-4cd7-afe2-aa6e0fa59153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:58.012049 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-41d83efc-1ec2-4cd7-afe2-aa6e0fa59153 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:58.013288 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-41d83efc-1ec2-4cd7-afe2-aa6e0fa59153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:58.086937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595dc44-be45-473c-a166-5785a36ce692 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:58.154085 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43d568-a95a-4d54-a8ec-48a981593beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:58.156444 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43d568-a95a-4d54-a8ec-48a981593beb None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:58.156911 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43d568-a95a-4d54-a8ec-48a981593beb None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:58.157381 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43d568-a95a-4d54-a8ec-48a981593beb None admin] PATH_INFO: `/v3/groups/e613d19d9c5443f18dd31035d9c46b7c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:58.159987 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43d568-a95a-4d54-a8ec-48a981593beb None admin] RBAC: Authorizing `identity:get_group(group_id=e613d19d9c5443f18dd31035d9c46b7c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:58.164867 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43d568-a95a-4d54-a8ec-48a981593beb None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:58.168808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 198/400] 10.222.0.73 () {56 vars in 1180 bytes} [Fri May 13 14:49:57 2022] GET /identity/v3/groups/e613d19d9c5443f18dd31035d9c46b7c => generated 226 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:58.178426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43d568-a95a-4d54-a8ec-48a981593beb None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:58.193872 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 203/401] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:49:58.229342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d83efc-1ec2-4cd7-afe2-aa6e0fa59153 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:58.369358 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43d568-a95a-4d54-a8ec-48a981593beb None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:58.383015 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d83efc-1ec2-4cd7-afe2-aa6e0fa59153 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:58.429998 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066b847-bd38-4a41-af30-8dbda660a400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:58.431314 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066b847-bd38-4a41-af30-8dbda660a400 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:58.431607 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066b847-bd38-4a41-af30-8dbda660a400 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:58.431887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066b847-bd38-4a41-af30-8dbda660a400 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:58.445604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066b847-bd38-4a41-af30-8dbda660a400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:58.446091 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3a3fa-2cb1-4257-87ed-85571d065dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:58.447747 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3a3fa-2cb1-4257-87ed-85571d065dd2 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:58.448402 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3a3fa-2cb1-4257-87ed-85571d065dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:58.449042 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3a3fa-2cb1-4257-87ed-85571d065dd2 None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:58.451633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3a3fa-2cb1-4257-87ed-85571d065dd2 None admin] RBAC: Authorizing `identity:get_project(project_id=5f5a44d5fda44f2586666bd534a896a4)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:58.453610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-0066b847-bd38-4a41-af30-8dbda660a400 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:49:58.453610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:58.453610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:58.453610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:58.453610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:58.453610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:58.453610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:58.453610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:58.453610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:58.453610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:58.453610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:58.453610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:58.453610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:58.453610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:58.453610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:58.453610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:58.455653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:58.455653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:58.455653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:58.455653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:58.455653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:58.455653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:58.455653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:58.455653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:58.455653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:58.455653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:58.455653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:58.455653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:58.455653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:58.455653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:58.455653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:58.455653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:58.457530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:58.457530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:58.457530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:58.457530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:58.457530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:58.457530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:58.457530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:58.457530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:58.457530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:58.457530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:58.457530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:49:58.457530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:58.457530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 204/402] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:49:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:58.457530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e0c4a-49ae-4c6e-8165-aa16f7cf436e None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:58.459734 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e0c4a-49ae-4c6e-8165-aa16f7cf436e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:58.459734 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e0c4a-49ae-4c6e-8165-aa16f7cf436e None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:58.459734 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 205/403] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:49:58.460905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3a3fa-2cb1-4257-87ed-85571d065dd2 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:58.469647 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 199/404] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:58 2022] GET /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:58.470029 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e1163-b913-46f3-a9d6-cccf12e9af86 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:58.470029 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e1163-b913-46f3-a9d6-cccf12e9af86 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:58.470029 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e1163-b913-46f3-a9d6-cccf12e9af86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:58.470711 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3a3fa-2cb1-4257-87ed-85571d065dd2 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:58.491033 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-f47e1163-b913-46f3-a9d6-cccf12e9af86 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:49:58.493621 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-f47e1163-b913-46f3-a9d6-cccf12e9af86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:49:58.610140 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3a3fa-2cb1-4257-87ed-85571d065dd2 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:58.627029 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 206/405] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:49:58.629025 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e1163-b913-46f3-a9d6-cccf12e9af86 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:58.649277 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fa22b-bdc1-45ad-a693-ee8d7da78e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:58.649710 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fa22b-bdc1-45ad-a693-ee8d7da78e2e None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:58.649959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fa22b-bdc1-45ad-a693-ee8d7da78e2e None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:58.650286 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fa22b-bdc1-45ad-a693-ee8d7da78e2e None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:58.651645 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7fa22b-bdc1-45ad-a693-ee8d7da78e2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:58.651959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7fa22b-bdc1-45ad-a693-ee8d7da78e2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:58.653400 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7fa22b-bdc1-45ad-a693-ee8d7da78e2e None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:58.663312 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 200/406] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:49:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:58.672672 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fa22b-bdc1-45ad-a693-ee8d7da78e2e None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:58.777197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e1163-b913-46f3-a9d6-cccf12e9af86 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:58.815621 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1197807-266e-4839-af0f-312cad7d999b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:58.816905 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1197807-266e-4839-af0f-312cad7d999b None admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:58.817657 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1197807-266e-4839-af0f-312cad7d999b None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:58.818144 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1197807-266e-4839-af0f-312cad7d999b None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4/groups/e613d19d9c5443f18dd31035d9c46b7c/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:58.820612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1197807-266e-4839-af0f-312cad7d999b None admin] RBAC: Authorizing `identity:create_grant(project_id=5f5a44d5fda44f2586666bd534a896a4, group_id=e613d19d9c5443f18dd31035d9c46b7c, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:58.822348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1197807-266e-4839-af0f-312cad7d999b None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:58.838812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 207/407] 10.222.0.73 () {58 vars in 1442 bytes} [Fri May 13 14:49:58 2022] PUT /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4/groups/e613d19d9c5443f18dd31035d9c46b7c/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:49:58.840124 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1197807-266e-4839-af0f-312cad7d999b None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:58.907484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fa22b-bdc1-45ad-a693-ee8d7da78e2e None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:58.965000 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1197807-266e-4839-af0f-312cad7d999b None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:59.006806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2386686-f9e3-4260-b3b9-b5e0a69f5369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:59.008182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2386686-f9e3-4260-b3b9-b5e0a69f5369 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:59.008738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2386686-f9e3-4260-b3b9-b5e0a69f5369 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:59.009266 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2386686-f9e3-4260-b3b9-b5e0a69f5369 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:59.022361 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2386686-f9e3-4260-b3b9-b5e0a69f5369 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:49:59.024474 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18cae5-b2cf-4b95-9737-5295ee8551a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:59.025996 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18cae5-b2cf-4b95-9737-5295ee8551a2 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:59.026475 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18cae5-b2cf-4b95-9737-5295ee8551a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:59.027004 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18cae5-b2cf-4b95-9737-5295ee8551a2 None admin] PATH_INFO: `/v3/groups/13b931504d3c4717bacee006528855ba` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:59.029316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18cae5-b2cf-4b95-9737-5295ee8551a2 None admin] RBAC: Authorizing `identity:get_group(group_id=13b931504d3c4717bacee006528855ba)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:59.032067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18cae5-b2cf-4b95-9737-5295ee8551a2 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:59.034881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-b2386686-f9e3-4260-b3b9-b5e0a69f5369 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:49:59.034881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:49:59.034881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:49:59.034881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:49:59.034881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:49:59.034881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:49:59.034881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:49:59.034881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:49:59.034881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:49:59.034881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:49:59.034881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:49:59.034881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:49:59.034881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:49:59.034881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:49:59.034881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:49:59.034881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:49:59.035826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:49:59.035826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:49:59.035826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:49:59.035826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:49:59.035826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:49:59.035826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:49:59.035826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:49:59.035826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:49:59.035826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:49:59.035826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:49:59.035826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:49:59.035826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:49:59.035826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:49:59.035826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:49:59.035826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:49:59.035826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:49:59.036647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:49:59.036647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:49:59.036647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:49:59.036647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:49:59.036647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:49:59.036647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:49:59.036647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:49:59.036647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:49:59.036647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:49:59.036647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:49:59.036647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:49:59.036647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:49:59.040211 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 201/409] 10.222.0.73 () {56 vars in 1180 bytes} [Fri May 13 14:49:58 2022] GET /identity/v3/groups/13b931504d3c4717bacee006528855ba => generated 229 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:59.040560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 208/409] 10.222.0.73 () {56 vars in 1114 bytes} [Fri May 13 14:49:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:49:59.045484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18cae5-b2cf-4b95-9737-5295ee8551a2 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:59.046914 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2386686-f9e3-4260-b3b9-b5e0a69f5369 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:59.167324 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2386686-f9e3-4260-b3b9-b5e0a69f5369 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:59.206351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff5501-9d3b-4023-8c19-25360856d205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:59.207486 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff5501-9d3b-4023-8c19-25360856d205 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:59.207988 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff5501-9d3b-4023-8c19-25360856d205 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:59.208486 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff5501-9d3b-4023-8c19-25360856d205 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:59.209465 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff5501-9d3b-4023-8c19-25360856d205 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:49:59.210061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff5501-9d3b-4023-8c19-25360856d205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:59.212417 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff5501-9d3b-4023-8c19-25360856d205 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:59.223192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 209/410] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:49:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:59.232979 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff5501-9d3b-4023-8c19-25360856d205 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:59.345357 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18cae5-b2cf-4b95-9737-5295ee8551a2 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:59.372292 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff5501-9d3b-4023-8c19-25360856d205 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:59.410907 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d24451-7853-4972-9347-f14c1440c0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:59.412570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d24451-7853-4972-9347-f14c1440c0a1 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:59.414128 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d24451-7853-4972-9347-f14c1440c0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:59.414990 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d24451-7853-4972-9347-f14c1440c0a1 None admin] PATH_INFO: `/v3/projects/3f1a37e489724b9ca1990a3febe2d22a` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:59.416959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d24451-7853-4972-9347-f14c1440c0a1 None admin] RBAC: Authorizing `identity:get_project(project_id=3f1a37e489724b9ca1990a3febe2d22a)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:59.418514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d24451-7853-4972-9347-f14c1440c0a1 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:59.420595 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 202/411] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:59 2022] GET /identity/v3/projects/3f1a37e489724b9ca1990a3febe2d22a => generated 344 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:59.425826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d2b15-ccac-46af-93ef-7e461571013c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:59.425826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d2b15-ccac-46af-93ef-7e461571013c None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:59.425826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d2b15-ccac-46af-93ef-7e461571013c None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:59.426175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d2b15-ccac-46af-93ef-7e461571013c None admin] PATH_INFO: `/v3/groups/e613d19d9c5443f18dd31035d9c46b7c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:59.426245 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d24451-7853-4972-9347-f14c1440c0a1 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:59.428392 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d2b15-ccac-46af-93ef-7e461571013c None admin] RBAC: Authorizing `identity:get_group(group_id=e613d19d9c5443f18dd31035d9c46b7c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:59.431543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d2b15-ccac-46af-93ef-7e461571013c None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:59.435332 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 210/412] 10.222.0.73 () {56 vars in 1180 bytes} [Fri May 13 14:49:59 2022] GET /identity/v3/groups/e613d19d9c5443f18dd31035d9c46b7c => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:59.449240 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d2b15-ccac-46af-93ef-7e461571013c None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:59.550063 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d24451-7853-4972-9347-f14c1440c0a1 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:59.590163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5b497-669e-4dc1-885b-bd11f67f2e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:59.591474 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5b497-669e-4dc1-885b-bd11f67f2e3b None admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:59.592006 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5b497-669e-4dc1-885b-bd11f67f2e3b None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:59.592483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5b497-669e-4dc1-885b-bd11f67f2e3b None admin] PATH_INFO: `/v3/projects/3f1a37e489724b9ca1990a3febe2d22a/groups/13b931504d3c4717bacee006528855ba/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:59.595038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5b497-669e-4dc1-885b-bd11f67f2e3b None admin] RBAC: Authorizing `identity:create_grant(project_id=3f1a37e489724b9ca1990a3febe2d22a, group_id=13b931504d3c4717bacee006528855ba, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:59.597954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5b497-669e-4dc1-885b-bd11f67f2e3b None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:59.614064 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 203/413] 10.222.0.73 () {58 vars in 1442 bytes} [Fri May 13 14:49:59 2022] PUT /identity/v3/projects/3f1a37e489724b9ca1990a3febe2d22a/groups/13b931504d3c4717bacee006528855ba/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:49:59.658624 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d2b15-ccac-46af-93ef-7e461571013c None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:59.717616 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f951d64-31ee-42fb-9ca8-ea64b4220499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:59.718941 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f951d64-31ee-42fb-9ca8-ea64b4220499 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:59.719480 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f951d64-31ee-42fb-9ca8-ea64b4220499 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:59.719987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f951d64-31ee-42fb-9ca8-ea64b4220499 None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:59.728087 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f951d64-31ee-42fb-9ca8-ea64b4220499 None admin] RBAC: Authorizing `identity:get_project(project_id=5f5a44d5fda44f2586666bd534a896a4)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:59.729948 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f951d64-31ee-42fb-9ca8-ea64b4220499 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:59.732093 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 211/414] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:49:59 2022] GET /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:49:59.738304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5b497-669e-4dc1-885b-bd11f67f2e3b None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:49:59.878838 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5b497-669e-4dc1-885b-bd11f67f2e3b None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:49:59.933122 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0abdb-b569-4e38-8352-36d89bfcc01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:49:59.934425 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0abdb-b569-4e38-8352-36d89bfcc01d None admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:49:59.934709 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0abdb-b569-4e38-8352-36d89bfcc01d None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:49:59.935005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0abdb-b569-4e38-8352-36d89bfcc01d None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4/groups/e613d19d9c5443f18dd31035d9c46b7c/roles/0a8d21e5149c42a8b85ca3c0258538d4` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:49:59.941161 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0abdb-b569-4e38-8352-36d89bfcc01d None admin] RBAC: Authorizing `identity:create_grant(project_id=5f5a44d5fda44f2586666bd534a896a4, group_id=e613d19d9c5443f18dd31035d9c46b7c, role_id=0a8d21e5149c42a8b85ca3c0258538d4)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:49:59.942924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0abdb-b569-4e38-8352-36d89bfcc01d None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:49:59.971271 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 204/415] 10.222.0.73 () {58 vars in 1442 bytes} [Fri May 13 14:49:59 2022] PUT /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4/groups/e613d19d9c5443f18dd31035d9c46b7c/roles/0a8d21e5149c42a8b85ca3c0258538d4 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:50:00.840431 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3caf51-d235-4fca-890b-edab0ff1360a None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:00.842174 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3caf51-d235-4fca-890b-edab0ff1360a None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:00.843051 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3caf51-d235-4fca-890b-edab0ff1360a None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:00.847428 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 212/416] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:00.857770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7efaee-800b-4032-a243-23220272b3c9 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:00.859279 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7efaee-800b-4032-a243-23220272b3c9 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:00.860018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7efaee-800b-4032-a243-23220272b3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:00.890409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-fd7efaee-800b-4032-a243-23220272b3c9 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:00.892939 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-fd7efaee-800b-4032-a243-23220272b3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:01.023500 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 205/417] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:01.063140 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3caf51-d235-4fca-890b-edab0ff1360a None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:01.110497 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81426d8-466f-4979-83ee-30fd9053dd4d None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:01.110941 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81426d8-466f-4979-83ee-30fd9053dd4d None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:01.111449 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81426d8-466f-4979-83ee-30fd9053dd4d None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:01.114659 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 206/418] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:01.121412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea003afd-e981-40ba-abd6-206e633b726b None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:01.122096 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea003afd-e981-40ba-abd6-206e633b726b None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:01.122702 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea003afd-e981-40ba-abd6-206e633b726b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:01.157290 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-ea003afd-e981-40ba-abd6-206e633b726b None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:01.161239 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ea003afd-e981-40ba-abd6-206e633b726b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:01.328837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 207/419] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:01.350106 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3caf51-d235-4fca-890b-edab0ff1360a None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:01.375824 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea003afd-e981-40ba-abd6-206e633b726b None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:01.457084 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf83381-37fc-4eca-a1e5-8d944e9189f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:01.458491 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf83381-37fc-4eca-a1e5-8d944e9189f8 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:01.459076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf83381-37fc-4eca-a1e5-8d944e9189f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:01.459588 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf83381-37fc-4eca-a1e5-8d944e9189f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:01.486445 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf83381-37fc-4eca-a1e5-8d944e9189f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:01.502026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-aaf83381-37fc-4eca-a1e5-8d944e9189f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:50:01.502026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:01.502026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:01.502026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:01.502026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:01.502026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:01.502026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:01.502026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:01.502026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:01.502026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:01.502026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:01.502026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:01.502026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:01.502026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:01.502026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:01.502026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:01.503044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:01.503044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:01.503044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:01.503044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:01.503044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:01.503044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:01.503044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:01.503044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:01.503044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:01.503044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:01.503044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:01.503044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:01.503044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:01.503044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:01.503044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:01.503044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:01.503858 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:01.503858 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:01.503858 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:01.503858 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:01.503858 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:01.503858 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:01.503858 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:01.503858 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:01.503858 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:01.503858 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:01.503858 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:50:01.503858 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:01.511099 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 213/420] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:50:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 443 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:01.515143 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf83381-37fc-4eca-a1e5-8d944e9189f8 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:01.669962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea003afd-e981-40ba-abd6-206e633b726b None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:01.713317 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf83381-37fc-4eca-a1e5-8d944e9189f8 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:01.759769 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992668e-fc5e-41a0-812b-cc2b2987d488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:01.761127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992668e-fc5e-41a0-812b-cc2b2987d488 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:01.761602 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992668e-fc5e-41a0-812b-cc2b2987d488 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:01.762055 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992668e-fc5e-41a0-812b-cc2b2987d488 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:01.779242 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2415c-fa64-48d7-b9e6-814e01781f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:01.780417 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2415c-fa64-48d7-b9e6-814e01781f0a None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:01.780912 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2415c-fa64-48d7-b9e6-814e01781f0a None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:01.781401 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2415c-fa64-48d7-b9e6-814e01781f0a None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:01.782874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2415c-fa64-48d7-b9e6-814e01781f0a None admin] RBAC: Adding query filter params (name=member) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:01.783425 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2415c-fa64-48d7-b9e6-814e01781f0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:01.786177 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2415c-fa64-48d7-b9e6-814e01781f0a None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:01.806968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 214/421] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:50:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:01.808414 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992668e-fc5e-41a0-812b-cc2b2987d488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:01.812359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2415c-fa64-48d7-b9e6-814e01781f0a None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:01.826233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-9992668e-fc5e-41a0-812b-cc2b2987d488 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:50:01.826233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:01.826233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:01.826233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:01.826233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:01.826233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:01.826233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:01.826233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:01.826233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:01.826233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:01.826233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:01.826233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:01.826233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:01.826233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:01.826233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:01.826233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:01.827280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:01.827280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:01.827280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:01.827280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:01.827280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:01.827280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:01.827280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:01.827280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:01.827280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:01.827280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:01.827280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:01.827280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:01.827280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:01.827280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:01.827280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:01.827280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:01.828104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:01.828104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:01.828104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:01.828104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:01.828104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:01.828104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:01.828104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:01.828104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:01.828104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:01.828104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:01.828104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:50:01.828104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:01.831995 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 208/422] 10.222.0.73 () {56 vars in 1114 bytes} [Fri May 13 14:50:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 457 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:50:01.840570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992668e-fc5e-41a0-812b-cc2b2987d488 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:01.972014 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992668e-fc5e-41a0-812b-cc2b2987d488 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:02.005628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2415c-fa64-48d7-b9e6-814e01781f0a None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:02.024459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097748ba-d83d-4a97-9bba-883c4e2d85e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:02.025523 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097748ba-d83d-4a97-9bba-883c4e2d85e4 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:02.026012 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097748ba-d83d-4a97-9bba-883c4e2d85e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:02.026588 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097748ba-d83d-4a97-9bba-883c4e2d85e4 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:02.027595 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097748ba-d83d-4a97-9bba-883c4e2d85e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:02.028108 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097748ba-d83d-4a97-9bba-883c4e2d85e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:02.029721 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097748ba-d83d-4a97-9bba-883c4e2d85e4 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:02.047777 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 209/423] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:50:02.055750 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097748ba-d83d-4a97-9bba-883c4e2d85e4 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:02.074748 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd15203-5021-41ed-8a9b-fc1daabe0291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:02.076392 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd15203-5021-41ed-8a9b-fc1daabe0291 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:02.077191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd15203-5021-41ed-8a9b-fc1daabe0291 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:02.077955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd15203-5021-41ed-8a9b-fc1daabe0291 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:02.217712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd15203-5021-41ed-8a9b-fc1daabe0291 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:02.221044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd15203-5021-41ed-8a9b-fc1daabe0291 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:02.399664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097748ba-d83d-4a97-9bba-883c4e2d85e4 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:02.487096 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29ea89-788c-4fe1-b227-d1264e32940b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:02.488143 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29ea89-788c-4fe1-b227-d1264e32940b None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:02.488671 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29ea89-788c-4fe1-b227-d1264e32940b None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:02.489143 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29ea89-788c-4fe1-b227-d1264e32940b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:02.520102 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 215/424] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:50:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 709 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:50:02.537978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd15203-5021-41ed-8a9b-fc1daabe0291 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:02.729691 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29ea89-788c-4fe1-b227-d1264e32940b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:02.731463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29ea89-788c-4fe1-b227-d1264e32940b None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:02.820711 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd15203-5021-41ed-8a9b-fc1daabe0291 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:02.850066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 210/425] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:50:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 794 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 14:50:02.851338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfcae5-77d2-440e-a71b-f1f734992beb None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:02.851647 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfcae5-77d2-440e-a71b-f1f734992beb None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:02.851931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfcae5-77d2-440e-a71b-f1f734992beb None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:02.857648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 211/426] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:02.859018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfcae5-77d2-440e-a71b-f1f734992beb None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:02.885535 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9759366-4607-4f13-a45f-7742ec7e01dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:02.886429 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9759366-4607-4f13-a45f-7742ec7e01dd None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:02.886736 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9759366-4607-4f13-a45f-7742ec7e01dd None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:02.887016 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9759366-4607-4f13-a45f-7742ec7e01dd None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:02.891840 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9759366-4607-4f13-a45f-7742ec7e01dd None admin] RBAC: Authorizing `identity:get_project(project_id=04114986615247c2bbac8845c3c3a8e7)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:02.893354 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9759366-4607-4f13-a45f-7742ec7e01dd None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:02.902877 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 216/427] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:50:02 2022] GET /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7 => generated 298 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:02.902877 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8228dfa-7076-42ff-abc1-f57fe6e3cce1 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:02.902877 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8228dfa-7076-42ff-abc1-f57fe6e3cce1 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:02.902877 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8228dfa-7076-42ff-abc1-f57fe6e3cce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:02.935219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-a8228dfa-7076-42ff-abc1-f57fe6e3cce1 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:02.938629 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-a8228dfa-7076-42ff-abc1-f57fe6e3cce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:03.042428 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfcae5-77d2-440e-a71b-f1f734992beb None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:03.045405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 217/428] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:03.046284 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8228dfa-7076-42ff-abc1-f57fe6e3cce1 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:03.110750 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4e08f-3e11-4833-9ead-5324789160cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:03.111653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4e08f-3e11-4833-9ead-5324789160cc None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:03.111923 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4e08f-3e11-4833-9ead-5324789160cc None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:03.112188 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4e08f-3e11-4833-9ead-5324789160cc None admin] PATH_INFO: `/v3/projects/04114986615247c2bbac8845c3c3a8e7` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:03.113477 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4e08f-3e11-4833-9ead-5324789160cc None admin] RBAC: Authorizing `identity:get_project(project_id=04114986615247c2bbac8845c3c3a8e7)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:03.115036 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4e08f-3e11-4833-9ead-5324789160cc None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:03.117853 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 212/429] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:50:02 2022] GET /identity/v3/projects/04114986615247c2bbac8845c3c3a8e7 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:03.120156 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28205ef4-5518-409e-ad8f-a9f4411c283a None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:03.120846 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28205ef4-5518-409e-ad8f-a9f4411c283a None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:03.121329 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28205ef4-5518-409e-ad8f-a9f4411c283a None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:03.130491 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 213/430] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:03 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:03.132633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28205ef4-5518-409e-ad8f-a9f4411c283a None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:03.214814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8228dfa-7076-42ff-abc1-f57fe6e3cce1 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:03.292097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28205ef4-5518-409e-ad8f-a9f4411c283a None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:03.297722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89940b-4588-434a-b38b-f7d674871fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:03.299289 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89940b-4588-434a-b38b-f7d674871fba None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:03.299802 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89940b-4588-434a-b38b-f7d674871fba None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:03.300279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89940b-4588-434a-b38b-f7d674871fba None admin] PATH_INFO: `/v3/groups/e613d19d9c5443f18dd31035d9c46b7c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:03.302625 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89940b-4588-434a-b38b-f7d674871fba None admin] RBAC: Authorizing `identity:get_group(group_id=e613d19d9c5443f18dd31035d9c46b7c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:03.305919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89940b-4588-434a-b38b-f7d674871fba None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:03.314645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 218/431] 10.222.0.73 () {56 vars in 1180 bytes} [Fri May 13 14:50:03 2022] GET /identity/v3/groups/e613d19d9c5443f18dd31035d9c46b7c => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:03.314645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89940b-4588-434a-b38b-f7d674871fba None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:03.354892 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87acb9b-f1c4-4253-abc1-b7635113109f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:03.355727 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87acb9b-f1c4-4253-abc1-b7635113109f None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:03.356007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87acb9b-f1c4-4253-abc1-b7635113109f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:03.356276 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87acb9b-f1c4-4253-abc1-b7635113109f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:03.373566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87acb9b-f1c4-4253-abc1-b7635113109f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:03.394423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-b87acb9b-f1c4-4253-abc1-b7635113109f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:50:03.394423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:03.394423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:03.394423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:03.394423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:03.394423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:03.394423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:03.394423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:03.394423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:03.394423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:03.394423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:03.394423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:03.394423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:03.394423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:03.394423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:03.394423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:03.396194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:03.396194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:03.396194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:03.396194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:03.396194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:03.396194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:03.396194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:03.396194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:03.396194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:03.396194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:03.396194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:03.396194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:03.396194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:03.396194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:03.396194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:03.396194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:03.397844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:03.397844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:03.397844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:03.397844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:03.397844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:03.397844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:03.397844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:03.397844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:03.397844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:03.397844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:03.397844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:50:03.397844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:03.397844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 214/432] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:50:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:03.400712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d587d0-28a0-469f-88c1-a919ed7e3fd7 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:03.400712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d587d0-28a0-469f-88c1-a919ed7e3fd7 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:03.400712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d587d0-28a0-469f-88c1-a919ed7e3fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:03.423289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-e7d587d0-28a0-469f-88c1-a919ed7e3fd7 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:03.424900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e7d587d0-28a0-469f-88c1-a919ed7e3fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:03.478112 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89940b-4588-434a-b38b-f7d674871fba None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:03.527866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c9a72-88c3-4d8d-89fe-c95a300cb7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:03.529065 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c9a72-88c3-4d8d-89fe-c95a300cb7b9 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:03.529486 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c9a72-88c3-4d8d-89fe-c95a300cb7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:03.530049 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c9a72-88c3-4d8d-89fe-c95a300cb7b9 None admin] PATH_INFO: `/v3/groups/e613d19d9c5443f18dd31035d9c46b7c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:03.531889 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c9a72-88c3-4d8d-89fe-c95a300cb7b9 None admin] RBAC: Authorizing `identity:get_group(group_id=e613d19d9c5443f18dd31035d9c46b7c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:03.533698 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c9a72-88c3-4d8d-89fe-c95a300cb7b9 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:03.541137 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 219/433] 10.222.0.73 () {56 vars in 1180 bytes} [Fri May 13 14:50:03 2022] GET /identity/v3/groups/e613d19d9c5443f18dd31035d9c46b7c => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:03.541137 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c9a72-88c3-4d8d-89fe-c95a300cb7b9 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:03.551060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 215/434] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:03.555628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d587d0-28a0-469f-88c1-a919ed7e3fd7 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:03.667896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c9a72-88c3-4d8d-89fe-c95a300cb7b9 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:03.679947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d587d0-28a0-469f-88c1-a919ed7e3fd7 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:03.708563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e6f76-4cad-4e9a-b7cd-ad0c9773f11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:03.709556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e6f76-4cad-4e9a-b7cd-ad0c9773f11e None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:03.710047 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e6f76-4cad-4e9a-b7cd-ad0c9773f11e None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:03.711030 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e6f76-4cad-4e9a-b7cd-ad0c9773f11e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:03.712136 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e6f76-4cad-4e9a-b7cd-ad0c9773f11e None admin] RBAC: Adding query filter params (group.id=e613d19d9c5443f18dd31035d9c46b7c, role.id=0268e6ac6fb649eb89da825c5ae328ab, scope.project.id=04114986615247c2bbac8845c3c3a8e7) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:03.712579 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e6f76-4cad-4e9a-b7cd-ad0c9773f11e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:03.714393 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e6f76-4cad-4e9a-b7cd-ad0c9773f11e None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:03.723920 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e31155-a0ba-4353-8efa-6064d58ff7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:03.724235 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 220/435] 10.222.0.73 () {56 vars in 1376 bytes} [Fri May 13 14:50:03 2022] GET /identity/v3/role_assignments?group.id=e613d19d9c5443f18dd31035d9c46b7c&scope.project.id=04114986615247c2bbac8845c3c3a8e7&role.id=0268e6ac6fb649eb89da825c5ae328ab => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:03.725488 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e6f76-4cad-4e9a-b7cd-ad0c9773f11e None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:03.726648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e31155-a0ba-4353-8efa-6064d58ff7f3 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:03.727248 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e31155-a0ba-4353-8efa-6064d58ff7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:03.727687 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e31155-a0ba-4353-8efa-6064d58ff7f3 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:03.729230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e31155-a0ba-4353-8efa-6064d58ff7f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:03.730052 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e31155-a0ba-4353-8efa-6064d58ff7f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:03.732566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e31155-a0ba-4353-8efa-6064d58ff7f3 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:03.747160 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 216/436] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:50:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:03.749065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839e8d3-2461-4ba9-a39a-f6fb11ef4214 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:03.750035 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839e8d3-2461-4ba9-a39a-f6fb11ef4214 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:03.750035 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839e8d3-2461-4ba9-a39a-f6fb11ef4214 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:03.752505 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 217/437] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:03.753938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839e8d3-2461-4ba9-a39a-f6fb11ef4214 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:03.891248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e6f76-4cad-4e9a-b7cd-ad0c9773f11e None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:03.911464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839e8d3-2461-4ba9-a39a-f6fb11ef4214 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:03.951943 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e498703-fe3b-4643-a556-05fb5d50a086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:03.953297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e498703-fe3b-4643-a556-05fb5d50a086 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:03.954202 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e498703-fe3b-4643-a556-05fb5d50a086 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:03.954846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e498703-fe3b-4643-a556-05fb5d50a086 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:03.956402 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e498703-fe3b-4643-a556-05fb5d50a086 None admin] RBAC: Adding query filter params (group.id=e613d19d9c5443f18dd31035d9c46b7c, role.id=0a8d21e5149c42a8b85ca3c0258538d4, scope.project.id=04114986615247c2bbac8845c3c3a8e7) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:03.957198 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e498703-fe3b-4643-a556-05fb5d50a086 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:03.959259 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e80273-1243-4b48-b0d6-f53a9480aadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:03.960640 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e498703-fe3b-4643-a556-05fb5d50a086 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:03.960904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e80273-1243-4b48-b0d6-f53a9480aadf None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:03.961346 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e80273-1243-4b48-b0d6-f53a9480aadf None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:03.961780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e80273-1243-4b48-b0d6-f53a9480aadf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:03.971466 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 221/438] 10.222.0.73 () {56 vars in 1376 bytes} [Fri May 13 14:50:03 2022] GET /identity/v3/role_assignments?group.id=e613d19d9c5443f18dd31035d9c46b7c&scope.project.id=04114986615247c2bbac8845c3c3a8e7&role.id=0a8d21e5149c42a8b85ca3c0258538d4 => generated 611 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:03.972819 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e498703-fe3b-4643-a556-05fb5d50a086 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:03.979386 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e80273-1243-4b48-b0d6-f53a9480aadf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:03.987947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-d2e80273-1243-4b48-b0d6-f53a9480aadf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:50:03.987947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:03.987947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:03.987947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:03.987947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:03.987947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:03.987947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:03.987947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:03.987947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:03.987947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:03.987947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:03.987947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:03.987947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:03.987947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:03.987947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:03.987947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:03.989885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:03.989885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:03.989885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:03.989885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:03.989885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:03.989885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:03.989885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:03.989885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:03.989885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:03.989885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:03.989885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:03.989885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:03.989885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:03.989885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:03.989885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:03.989885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:03.991949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:03.991949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:03.991949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:03.991949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:03.991949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:03.991949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:03.991949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:03.991949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:03.991949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:03.991949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:03.991949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:50:03.991949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:03.991949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 218/439] 10.222.0.73 () {56 vars in 1114 bytes} [Fri May 13 14:50:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:03.991949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabd4bc-50c0-4771-b009-9038de35f2dc None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:03.993333 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabd4bc-50c0-4771-b009-9038de35f2dc None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:03.993333 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabd4bc-50c0-4771-b009-9038de35f2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:04.011451 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-3aabd4bc-50c0-4771-b009-9038de35f2dc None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:04.012975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-3aabd4bc-50c0-4771-b009-9038de35f2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:04.138531 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e498703-fe3b-4643-a556-05fb5d50a086 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:04.152333 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 219/440] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:04.153873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabd4bc-50c0-4771-b009-9038de35f2dc None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:04.209457 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765d584-9658-49c8-84c2-0c807cdbe170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:04.211555 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765d584-9658-49c8-84c2-0c807cdbe170 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:04.212323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765d584-9658-49c8-84c2-0c807cdbe170 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:04.212760 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765d584-9658-49c8-84c2-0c807cdbe170 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:04.348395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765d584-9658-49c8-84c2-0c807cdbe170 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:04.349559 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabd4bc-50c0-4771-b009-9038de35f2dc None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:04.350067 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765d584-9658-49c8-84c2-0c807cdbe170 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:04.411679 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165241e2-af36-498c-8eb7-3e4aeaeec520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:04.412817 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165241e2-af36-498c-8eb7-3e4aeaeec520 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:04.413339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165241e2-af36-498c-8eb7-3e4aeaeec520 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:04.413827 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165241e2-af36-498c-8eb7-3e4aeaeec520 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:04.415244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165241e2-af36-498c-8eb7-3e4aeaeec520 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:04.415844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165241e2-af36-498c-8eb7-3e4aeaeec520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:04.418151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165241e2-af36-498c-8eb7-3e4aeaeec520 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:04.433646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 220/441] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:04.435338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165241e2-af36-498c-8eb7-3e4aeaeec520 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:04.521632 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 222/442] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:50:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:50:04.523571 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765d584-9658-49c8-84c2-0c807cdbe170 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:04.585919 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165241e2-af36-498c-8eb7-3e4aeaeec520 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:04.626486 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a813e-b5c9-45e1-b98b-bebd6ca0db3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:04.627582 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a813e-b5c9-45e1-b98b-bebd6ca0db3e None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:04.627949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a813e-b5c9-45e1-b98b-bebd6ca0db3e None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:04.628326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a813e-b5c9-45e1-b98b-bebd6ca0db3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:04.641107 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a813e-b5c9-45e1-b98b-bebd6ca0db3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:04.649609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-9e5a813e-b5c9-45e1-b98b-bebd6ca0db3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 14:50:04.649609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:04.649609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:04.649609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:04.649609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:04.649609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:04.649609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:04.649609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:04.649609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:04.649609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:04.649609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:04.649609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:04.649609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:04.649609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:04.649609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:04.649609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:04.651464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:04.651464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:04.651464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:04.651464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:04.651464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:04.651464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:04.651464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:04.651464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:04.651464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:04.651464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:04.651464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:04.651464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:04.651464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:04.651464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:04.651464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:04.651464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:04.653015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:04.653015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:04.653015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:04.653015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:04.653015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:04.653015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:04.653015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:04.653015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:04.653015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:04.653015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:04.653015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 14:50:04.653015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:04.653015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 221/443] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:50:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:04.653015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a813e-b5c9-45e1-b98b-bebd6ca0db3e None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:04.668127 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765d584-9658-49c8-84c2-0c807cdbe170 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:04.708276 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84af4c0-edd1-47ab-83f0-1fa2653a6f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:04.709225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84af4c0-edd1-47ab-83f0-1fa2653a6f35 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:04.709643 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84af4c0-edd1-47ab-83f0-1fa2653a6f35 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:04.710476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84af4c0-edd1-47ab-83f0-1fa2653a6f35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:04.777723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a813e-b5c9-45e1-b98b-bebd6ca0db3e None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:04.789580 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84af4c0-edd1-47ab-83f0-1fa2653a6f35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:04.791088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84af4c0-edd1-47ab-83f0-1fa2653a6f35 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:04.840091 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57787f6d-205c-445b-8ab1-753f301f3017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:04.840967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57787f6d-205c-445b-8ab1-753f301f3017 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:04.841250 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57787f6d-205c-445b-8ab1-753f301f3017 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:04.841529 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57787f6d-205c-445b-8ab1-753f301f3017 None admin] PATH_INFO: `/v3/projects/3f1a37e489724b9ca1990a3febe2d22a` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:04.842835 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57787f6d-205c-445b-8ab1-753f301f3017 None admin] RBAC: Authorizing `identity:get_project(project_id=3f1a37e489724b9ca1990a3febe2d22a)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:04.844353 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57787f6d-205c-445b-8ab1-753f301f3017 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:04.846141 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 222/444] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:50:04 2022] GET /identity/v3/projects/3f1a37e489724b9ca1990a3febe2d22a => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:04.847145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57787f6d-205c-445b-8ab1-753f301f3017 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:04.910034 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 223/445] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:50:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:50:04.911165 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84af4c0-edd1-47ab-83f0-1fa2653a6f35 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:04.996316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57787f6d-205c-445b-8ab1-753f301f3017 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:05.021422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84af4c0-edd1-47ab-83f0-1fa2653a6f35 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:05.050297 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f983d3-ff25-4f3b-bf46-3c53cfdde8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:05.051132 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f983d3-ff25-4f3b-bf46-3c53cfdde8ce None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:05.051494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f983d3-ff25-4f3b-bf46-3c53cfdde8ce None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:05.051890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f983d3-ff25-4f3b-bf46-3c53cfdde8ce None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:05.052752 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f983d3-ff25-4f3b-bf46-3c53cfdde8ce None admin] RBAC: Adding query filter params (name=member) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:05.053141 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f983d3-ff25-4f3b-bf46-3c53cfdde8ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:05.054706 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f983d3-ff25-4f3b-bf46-3c53cfdde8ce None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:05.059260 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb42bab-959a-4eba-8d1a-77704df12b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:05.060131 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb42bab-959a-4eba-8d1a-77704df12b22 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:05.060407 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb42bab-959a-4eba-8d1a-77704df12b22 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:05.060677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb42bab-959a-4eba-8d1a-77704df12b22 None admin] PATH_INFO: `/v3/groups/13b931504d3c4717bacee006528855ba` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:05.062009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb42bab-959a-4eba-8d1a-77704df12b22 None admin] RBAC: Authorizing `identity:get_group(group_id=13b931504d3c4717bacee006528855ba)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:05.063536 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb42bab-959a-4eba-8d1a-77704df12b22 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:05.065519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 224/446] 10.222.0.73 () {56 vars in 1180 bytes} [Fri May 13 14:50:04 2022] GET /identity/v3/groups/13b931504d3c4717bacee006528855ba => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:05.065703 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 223/447] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:50:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:05.066088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb42bab-959a-4eba-8d1a-77704df12b22 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:05.072673 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f983d3-ff25-4f3b-bf46-3c53cfdde8ce None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:05.213841 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb42bab-959a-4eba-8d1a-77704df12b22 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:05.214504 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f983d3-ff25-4f3b-bf46-3c53cfdde8ce None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:05.255771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dca3f-c581-4f63-9700-50cc05a97391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:05.257283 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dca3f-c581-4f63-9700-50cc05a97391 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:05.257654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4710397-b950-4e0f-971f-bd946a89cd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:05.257854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dca3f-c581-4f63-9700-50cc05a97391 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:05.258090 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dca3f-c581-4f63-9700-50cc05a97391 None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:05.258473 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4710397-b950-4e0f-971f-bd946a89cd8a None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:05.258926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4710397-b950-4e0f-971f-bd946a89cd8a None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:05.259194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4710397-b950-4e0f-971f-bd946a89cd8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:05.259751 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636dca3f-c581-4f63-9700-50cc05a97391 None admin] RBAC: Authorizing `identity:get_project(project_id=5f5a44d5fda44f2586666bd534a896a4)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:05.260164 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4710397-b950-4e0f-971f-bd946a89cd8a None admin] RBAC: Adding query filter params (group.id=13b931504d3c4717bacee006528855ba, role.id=b6fbf976763d4795afbfb53a09ec6f6c, scope.project.id=3f1a37e489724b9ca1990a3febe2d22a) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:05.260545 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4710397-b950-4e0f-971f-bd946a89cd8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:05.261659 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636dca3f-c581-4f63-9700-50cc05a97391 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:05.262084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4710397-b950-4e0f-971f-bd946a89cd8a None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:05.266089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 225/448] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:50:05 2022] GET /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:05.266089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dca3f-c581-4f63-9700-50cc05a97391 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:05.272953 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 224/449] 10.222.0.73 () {56 vars in 1376 bytes} [Fri May 13 14:50:05 2022] GET /identity/v3/role_assignments?group.id=13b931504d3c4717bacee006528855ba&scope.project.id=3f1a37e489724b9ca1990a3febe2d22a&role.id=b6fbf976763d4795afbfb53a09ec6f6c => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:50:05.275658 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4710397-b950-4e0f-971f-bd946a89cd8a None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:05.402801 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dca3f-c581-4f63-9700-50cc05a97391 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:05.445914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4710397-b950-4e0f-971f-bd946a89cd8a None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:05.458444 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11462aa-ff5a-450f-b362-4e17f0a7bec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:05.459591 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11462aa-ff5a-450f-b362-4e17f0a7bec0 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:05.460133 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11462aa-ff5a-450f-b362-4e17f0a7bec0 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:05.460604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11462aa-ff5a-450f-b362-4e17f0a7bec0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:05.502507 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3b7fa-50be-4fe0-8119-769c13e1b598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:05.503939 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3b7fa-50be-4fe0-8119-769c13e1b598 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:05.504361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3b7fa-50be-4fe0-8119-769c13e1b598 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:05.504784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3b7fa-50be-4fe0-8119-769c13e1b598 None admin] PATH_INFO: `/v3/groups/e613d19d9c5443f18dd31035d9c46b7c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:05.506802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3b7fa-50be-4fe0-8119-769c13e1b598 None admin] RBAC: Authorizing `identity:get_group(group_id=e613d19d9c5443f18dd31035d9c46b7c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:05.509336 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3b7fa-50be-4fe0-8119-769c13e1b598 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:05.517258 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 225/450] 10.222.0.73 () {56 vars in 1180 bytes} [Fri May 13 14:50:05 2022] GET /identity/v3/groups/e613d19d9c5443f18dd31035d9c46b7c => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:05.519979 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3b7fa-50be-4fe0-8119-769c13e1b598 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:05.599130 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11462aa-ff5a-450f-b362-4e17f0a7bec0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:05.602582 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11462aa-ff5a-450f-b362-4e17f0a7bec0 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:05.657513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3b7fa-50be-4fe0-8119-769c13e1b598 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:05.693811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814930f5-b917-475d-b996-90ef30fc22ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:05.694542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814930f5-b917-475d-b996-90ef30fc22ca None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:05.694852 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814930f5-b917-475d-b996-90ef30fc22ca None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:05.695121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814930f5-b917-475d-b996-90ef30fc22ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:05.695978 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814930f5-b917-475d-b996-90ef30fc22ca None admin] RBAC: Adding query filter params (group.id=e613d19d9c5443f18dd31035d9c46b7c, role.id=0a8d21e5149c42a8b85ca3c0258538d4, scope.project.id=5f5a44d5fda44f2586666bd534a896a4) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:05.696281 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814930f5-b917-475d-b996-90ef30fc22ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:05.697727 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814930f5-b917-475d-b996-90ef30fc22ca None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:05.704336 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 226/451] 10.222.0.73 () {56 vars in 1376 bytes} [Fri May 13 14:50:05 2022] GET /identity/v3/role_assignments?group.id=e613d19d9c5443f18dd31035d9c46b7c&scope.project.id=5f5a44d5fda44f2586666bd534a896a4&role.id=0a8d21e5149c42a8b85ca3c0258538d4 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:50:05.790244 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 226/452] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:50:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:50:05.797180 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814930f5-b917-475d-b996-90ef30fc22ca None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:05.983841 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814930f5-b917-475d-b996-90ef30fc22ca None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:06.042582 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cca6d-da30-4a79-90c4-bf63c6ca1721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:06.044059 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cca6d-da30-4a79-90c4-bf63c6ca1721 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:06.044547 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cca6d-da30-4a79-90c4-bf63c6ca1721 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:06.045026 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cca6d-da30-4a79-90c4-bf63c6ca1721 None admin] PATH_INFO: `/v3/projects/5f5a44d5fda44f2586666bd534a896a4` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:06.047252 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022cca6d-da30-4a79-90c4-bf63c6ca1721 None admin] RBAC: Authorizing `identity:get_project(project_id=5f5a44d5fda44f2586666bd534a896a4)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:06.049957 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022cca6d-da30-4a79-90c4-bf63c6ca1721 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:06.053357 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 227/453] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:50:05 2022] GET /identity/v3/projects/5f5a44d5fda44f2586666bd534a896a4 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:06.062944 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11462aa-ff5a-450f-b362-4e17f0a7bec0 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:06.233795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11462aa-ff5a-450f-b362-4e17f0a7bec0 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:06.292536 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6992a3-2ec7-4ee9-9cf4-4e29435454e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:06.293955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6992a3-2ec7-4ee9-9cf4-4e29435454e7 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:06.294454 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6992a3-2ec7-4ee9-9cf4-4e29435454e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:06.294992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6992a3-2ec7-4ee9-9cf4-4e29435454e7 None admin] PATH_INFO: `/v3/groups/e613d19d9c5443f18dd31035d9c46b7c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:06.297242 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6992a3-2ec7-4ee9-9cf4-4e29435454e7 None admin] RBAC: Authorizing `identity:get_group(group_id=e613d19d9c5443f18dd31035d9c46b7c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:06.299988 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6992a3-2ec7-4ee9-9cf4-4e29435454e7 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:06.303024 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 227/454] 10.222.0.73 () {56 vars in 1180 bytes} [Fri May 13 14:50:06 2022] GET /identity/v3/groups/e613d19d9c5443f18dd31035d9c46b7c => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:06.309141 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cca6d-da30-4a79-90c4-bf63c6ca1721 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:06.415549 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cca6d-da30-4a79-90c4-bf63c6ca1721 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:06.449430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51affde9-cb56-42b8-b342-d63ad69a503f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:06.450080 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51affde9-cb56-42b8-b342-d63ad69a503f None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:06.450356 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51affde9-cb56-42b8-b342-d63ad69a503f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:06.450627 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51affde9-cb56-42b8-b342-d63ad69a503f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:06.451515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51affde9-cb56-42b8-b342-d63ad69a503f None admin] RBAC: Adding query filter params (group.id=e613d19d9c5443f18dd31035d9c46b7c, role.id=0268e6ac6fb649eb89da825c5ae328ab, scope.project.id=5f5a44d5fda44f2586666bd534a896a4) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:06.451824 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51affde9-cb56-42b8-b342-d63ad69a503f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:06.453494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51affde9-cb56-42b8-b342-d63ad69a503f None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:06.460704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 228/455] 10.222.0.73 () {56 vars in 1376 bytes} [Fri May 13 14:50:06 2022] GET /identity/v3/role_assignments?group.id=e613d19d9c5443f18dd31035d9c46b7c&scope.project.id=5f5a44d5fda44f2586666bd534a896a4&role.id=0268e6ac6fb649eb89da825c5ae328ab => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:50:09.974021 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416798c-318b-47d7-9e66-fc17aa69e22f None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:09.974893 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416798c-318b-47d7-9e66-fc17aa69e22f None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:09.975043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416798c-318b-47d7-9e66-fc17aa69e22f None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:09.977785 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 228/456] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:09.985897 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b508e1-2d67-491c-9ef6-58c11faca90d None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:09.986712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b508e1-2d67-491c-9ef6-58c11faca90d None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:09.986712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b508e1-2d67-491c-9ef6-58c11faca90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:10.011410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-29b508e1-2d67-491c-9ef6-58c11faca90d None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:10.012639 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-29b508e1-2d67-491c-9ef6-58c11faca90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:10.141076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 229/457] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:10.182641 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416798c-318b-47d7-9e66-fc17aa69e22f None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:10.329429 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416798c-318b-47d7-9e66-fc17aa69e22f None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:10.385907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1a551-2068-4d6b-b5f5-b71b4efdf954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:10.386721 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1a551-2068-4d6b-b5f5-b71b4efdf954 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:10.387023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1a551-2068-4d6b-b5f5-b71b4efdf954 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:10.387292 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1a551-2068-4d6b-b5f5-b71b4efdf954 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:10.402790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1a551-2068-4d6b-b5f5-b71b4efdf954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:10.404318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1a551-2068-4d6b-b5f5-b71b4efdf954 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:10.448351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-dcb1a551-2068-4d6b-b5f5-b71b4efdf954 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:10.448351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:10.448351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:10.448351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:10.448351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:10.448351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:10.448351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:10.448351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:10.448351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:10.448351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:10.448351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:10.448351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:10.448351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:10.448351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:10.448351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:10.450035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:10.450035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:10.450035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:10.450035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:10.450035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:10.450035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:10.450035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:10.450035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:10.450035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:10.450035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:10.450035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:10.450035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:10.450035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:10.450035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:10.450035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:10.450035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:10.450035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:10.452531 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:10.452531 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:10.452531 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:10.452531 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:10.456456 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 229/458] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:10.465202 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b508e1-2d67-491c-9ef6-58c11faca90d None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:10.577398 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d0fd6-04fa-4cfd-aaf4-662c5da3c2b8 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:10.577848 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d0fd6-04fa-4cfd-aaf4-662c5da3c2b8 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:10.578283 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d0fd6-04fa-4cfd-aaf4-662c5da3c2b8 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:10.581089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 230/459] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:10.601754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b950370-b3a6-4ed6-806f-2c688466a30e None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:10.602019 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b950370-b3a6-4ed6-806f-2c688466a30e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:10.602306 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b950370-b3a6-4ed6-806f-2c688466a30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:10.640124 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-8b950370-b3a6-4ed6-806f-2c688466a30e None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:10.641414 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-8b950370-b3a6-4ed6-806f-2c688466a30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:10.651491 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b508e1-2d67-491c-9ef6-58c11faca90d None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:10.748932 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2b551-1bd1-4c25-9b0a-1ff6574531fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:10.750560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2b551-1bd1-4c25-9b0a-1ff6574531fc None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:10.751373 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2b551-1bd1-4c25-9b0a-1ff6574531fc None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:10.752123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2b551-1bd1-4c25-9b0a-1ff6574531fc None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:10.762875 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2b551-1bd1-4c25-9b0a-1ff6574531fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:10.764127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2b551-1bd1-4c25-9b0a-1ff6574531fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:10.767182 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2b551-1bd1-4c25-9b0a-1ff6574531fc None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:10.799433 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 230/460] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:10.808214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 231/461] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:10.808923 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2b551-1bd1-4c25-9b0a-1ff6574531fc None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:10.943066 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b950370-b3a6-4ed6-806f-2c688466a30e None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:11.037400 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2b551-1bd1-4c25-9b0a-1ff6574531fc None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:11.112731 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dab471-c901-43ec-8b70-5d7a73454d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:11.113438 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dab471-c901-43ec-8b70-5d7a73454d6f None admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:11.113765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dab471-c901-43ec-8b70-5d7a73454d6f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:11.114053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dab471-c901-43ec-8b70-5d7a73454d6f None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:11.114790 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dab471-c901-43ec-8b70-5d7a73454d6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:11.116470 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dab471-c901-43ec-8b70-5d7a73454d6f None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:11.155012 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 231/462] 10.222.0.73 () {60 vars in 1132 bytes} [Fri May 13 14:50:10 2022] POST /identity/v3/users => generated 248 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:50:11.211858 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b950370-b3a6-4ed6-806f-2c688466a30e None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:11.284275 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f6250-88d6-402a-a3f4-5cf9f6ce7fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:11.285637 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f6250-88d6-402a-a3f4-5cf9f6ce7fa8 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:11.286115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f6250-88d6-402a-a3f4-5cf9f6ce7fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:11.286601 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f6250-88d6-402a-a3f4-5cf9f6ce7fa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:11.310691 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f6250-88d6-402a-a3f4-5cf9f6ce7fa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:11.313057 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f6250-88d6-402a-a3f4-5cf9f6ce7fa8 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:11.353014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-4c6f6250-88d6-402a-a3f4-5cf9f6ce7fa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:11.353014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:11.353014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:11.353014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:11.353014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:11.353014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:11.353014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:11.353014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:11.353014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:11.353014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:11.353014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:11.353014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:11.353014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:11.353014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:11.353014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:11.354656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:11.354656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:11.354656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:11.354656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:11.354656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:11.354656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:11.354656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:11.354656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:11.354656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:11.354656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:11.354656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:11.354656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:11.354656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:11.354656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:11.354656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:11.354656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:11.354656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:11.356306 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:11.356306 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:11.356306 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:11.356306 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:11.359000 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 232/463] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:50:11.367328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dab471-c901-43ec-8b70-5d7a73454d6f None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:11.523218 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dab471-c901-43ec-8b70-5d7a73454d6f None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:11.565228 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79b673-4dab-41ee-8cd2-2f5fc5729e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:11.565806 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79b673-4dab-41ee-8cd2-2f5fc5729e0d None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:11.566076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79b673-4dab-41ee-8cd2-2f5fc5729e0d None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:11.566349 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79b673-4dab-41ee-8cd2-2f5fc5729e0d None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:11.567369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79b673-4dab-41ee-8cd2-2f5fc5729e0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:11.567685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79b673-4dab-41ee-8cd2-2f5fc5729e0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:11.569207 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79b673-4dab-41ee-8cd2-2f5fc5729e0d None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:11.582572 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 232/464] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:11.591944 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f6250-88d6-402a-a3f4-5cf9f6ce7fa8 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:11.623730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0da634-4a82-446e-84fb-42afef1d7076 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:11.624145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0da634-4a82-446e-84fb-42afef1d7076 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:11.624407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0da634-4a82-446e-84fb-42afef1d7076 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:11.626066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 233/465] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:50:11.632909 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155a8bc-c19e-4b1d-8fb3-62213598f22d None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:11.633579 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155a8bc-c19e-4b1d-8fb3-62213598f22d None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:11.634066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155a8bc-c19e-4b1d-8fb3-62213598f22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:11.653851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-b155a8bc-c19e-4b1d-8fb3-62213598f22d None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:11.655556 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-b155a8bc-c19e-4b1d-8fb3-62213598f22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:11.782666 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 234/466] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:50:11.812001 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f6250-88d6-402a-a3f4-5cf9f6ce7fa8 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:11.813688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155a8bc-c19e-4b1d-8fb3-62213598f22d None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:11.880660 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fd042-8831-4d42-8761-48ff8f2c713d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:11.881873 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fd042-8831-4d42-8761-48ff8f2c713d None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:11.882372 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fd042-8831-4d42-8761-48ff8f2c713d None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:11.882848 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fd042-8831-4d42-8761-48ff8f2c713d None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:11.884239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fd042-8831-4d42-8761-48ff8f2c713d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:11.886976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fd042-8831-4d42-8761-48ff8f2c713d None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:11.938468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155a8bc-c19e-4b1d-8fb3-62213598f22d None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:11.950766 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 233/467] 10.222.0.73 () {60 vars in 1132 bytes} [Fri May 13 14:50:11 2022] POST /identity/v3/users => generated 246 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:50:11.998685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c65524-f8ac-40b4-8918-5fa44a05714f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:11.999536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c65524-f8ac-40b4-8918-5fa44a05714f None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:11.999835 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c65524-f8ac-40b4-8918-5fa44a05714f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:12.000077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c65524-f8ac-40b4-8918-5fa44a05714f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:12.016849 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c65524-f8ac-40b4-8918-5fa44a05714f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:12.018401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c65524-f8ac-40b4-8918-5fa44a05714f None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:12.046771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-22c65524-f8ac-40b4-8918-5fa44a05714f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:12.046771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:12.046771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:12.046771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:12.046771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:12.046771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:12.046771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:12.046771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:12.046771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:12.046771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:12.046771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:12.046771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:12.046771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:12.046771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:12.046771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:12.049482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:12.049482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:12.049482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:12.049482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:12.049482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:12.049482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:12.049482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:12.049482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:12.049482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:12.049482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:12.049482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:12.049482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:12.049482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:12.049482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:12.049482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:12.049482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:12.049482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:12.051299 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:12.051299 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:12.051299 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:12.051299 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:12.051299 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 235/468] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:50:12.055471 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fd042-8831-4d42-8761-48ff8f2c713d None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:12.084382 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037240d6-2a43-4361-a6ef-9298bbb92179 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:12.084912 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037240d6-2a43-4361-a6ef-9298bbb92179 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:12.085154 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037240d6-2a43-4361-a6ef-9298bbb92179 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:12.086984 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 236/469] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:50:12.105911 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cad2ba-d6d9-4e85-be7e-dda44625807b None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:12.105911 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cad2ba-d6d9-4e85-be7e-dda44625807b None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:12.105911 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cad2ba-d6d9-4e85-be7e-dda44625807b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:12.148338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-40cad2ba-d6d9-4e85-be7e-dda44625807b None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:12.150231 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-40cad2ba-d6d9-4e85-be7e-dda44625807b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:12.285359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fd042-8831-4d42-8761-48ff8f2c713d None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:12.359843 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 237/470] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:50:12.373442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bb46c-dd3a-4918-b9eb-21b7db8bcfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:12.374631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bb46c-dd3a-4918-b9eb-21b7db8bcfc7 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:12.375174 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bb46c-dd3a-4918-b9eb-21b7db8bcfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:12.375680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bb46c-dd3a-4918-b9eb-21b7db8bcfc7 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:12.377090 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bb46c-dd3a-4918-b9eb-21b7db8bcfc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:12.377658 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bb46c-dd3a-4918-b9eb-21b7db8bcfc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:12.380419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bb46c-dd3a-4918-b9eb-21b7db8bcfc7 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:12.406389 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cad2ba-d6d9-4e85-be7e-dda44625807b None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:12.428984 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 234/471] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:50:12.439414 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bb46c-dd3a-4918-b9eb-21b7db8bcfc7 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:12.626469 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cad2ba-d6d9-4e85-be7e-dda44625807b None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:12.656581 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bb46c-dd3a-4918-b9eb-21b7db8bcfc7 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:12.684845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd79f1-6c75-41d2-91ae-97e16efd6be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:12.686136 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd79f1-6c75-41d2-91ae-97e16efd6be4 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:12.686601 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd79f1-6c75-41d2-91ae-97e16efd6be4 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:12.687389 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd79f1-6c75-41d2-91ae-97e16efd6be4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:12.705569 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd79f1-6c75-41d2-91ae-97e16efd6be4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:12.708251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd79f1-6c75-41d2-91ae-97e16efd6be4 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:12.724992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b3101-7a2f-4ff3-949e-3627bbd3935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:12.726924 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b3101-7a2f-4ff3-949e-3627bbd3935e None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:12.727377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b3101-7a2f-4ff3-949e-3627bbd3935e None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:12.727821 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b3101-7a2f-4ff3-949e-3627bbd3935e None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:12.729025 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b3101-7a2f-4ff3-949e-3627bbd3935e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:12.731636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b3101-7a2f-4ff3-949e-3627bbd3935e None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:12.740464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-94fd79f1-6c75-41d2-91ae-97e16efd6be4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:12.740464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:12.740464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:12.740464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:12.740464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:12.740464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:12.740464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:12.740464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:12.740464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:12.740464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:12.740464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:12.740464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:12.740464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:12.740464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:12.740464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:12.742684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:12.742684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:12.742684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:12.742684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:12.742684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:12.742684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:12.742684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:12.742684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:12.742684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:12.742684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:12.742684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:12.742684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:12.742684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:12.742684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:12.742684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:12.742684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:12.742684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:12.751190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:12.751190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:12.751190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:12.751190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:12.751190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 238/472] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:12.751190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b980a4b-2418-4ae2-a790-5f2c1c111725 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:12.751190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b980a4b-2418-4ae2-a790-5f2c1c111725 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:12.751190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b980a4b-2418-4ae2-a790-5f2c1c111725 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:12.751190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 239/473] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:12.758529 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73269939-9144-4098-b5e6-e2d394bedd0c None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:12.759098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73269939-9144-4098-b5e6-e2d394bedd0c None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:12.759666 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73269939-9144-4098-b5e6-e2d394bedd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:12.775576 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 235/474] 10.222.0.73 () {60 vars in 1132 bytes} [Fri May 13 14:50:12 2022] POST /identity/v3/users => generated 248 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:50:12.777480 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b3101-7a2f-4ff3-949e-3627bbd3935e None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:12.807359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-73269939-9144-4098-b5e6-e2d394bedd0c None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:12.809506 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-73269939-9144-4098-b5e6-e2d394bedd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:12.990595 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b3101-7a2f-4ff3-949e-3627bbd3935e None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:13.066077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 240/475] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:50:13.090756 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73269939-9144-4098-b5e6-e2d394bedd0c None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:13.110133 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8e0ff-5e6a-443d-a623-8c9aa2cb88f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:13.112027 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8e0ff-5e6a-443d-a623-8c9aa2cb88f4 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:13.112909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8e0ff-5e6a-443d-a623-8c9aa2cb88f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:13.113691 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8e0ff-5e6a-443d-a623-8c9aa2cb88f4 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:13.115447 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8e0ff-5e6a-443d-a623-8c9aa2cb88f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:13.116876 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8e0ff-5e6a-443d-a623-8c9aa2cb88f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:13.124363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8e0ff-5e6a-443d-a623-8c9aa2cb88f4 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:13.163470 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 236/476] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:13.169789 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8e0ff-5e6a-443d-a623-8c9aa2cb88f4 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:13.336958 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73269939-9144-4098-b5e6-e2d394bedd0c None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:13.364730 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8e0ff-5e6a-443d-a623-8c9aa2cb88f4 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:13.404000 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1761356-d6e3-4936-9ba8-eba95e6aef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:13.405707 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1761356-d6e3-4936-9ba8-eba95e6aef03 None admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:13.406468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1761356-d6e3-4936-9ba8-eba95e6aef03 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:13.407280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1761356-d6e3-4936-9ba8-eba95e6aef03 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:13.409080 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1761356-d6e3-4936-9ba8-eba95e6aef03 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:13.412068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1761356-d6e3-4936-9ba8-eba95e6aef03 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:13.423916 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.sql.core [None req-f1761356-d6e3-4936-9ba8-eba95e6aef03 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 13 14:50:13.423916 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 13 14:50:13.423916 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [parameters: {'id': '8fc80439011d40b8a8bf2a554fc36c0a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 13 14:50:13.423916 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79915) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 13 14:50:13.433636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c8d1c-65da-4db1-b006-6b70b27c5bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:13.435115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c8d1c-65da-4db1-b006-6b70b27c5bd6 None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:13.435701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c8d1c-65da-4db1-b006-6b70b27c5bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:13.436287 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c8d1c-65da-4db1-b006-6b70b27c5bd6 None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:13.437797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c8d1c-65da-4db1-b006-6b70b27c5bd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:13.440963 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c8d1c-65da-4db1-b006-6b70b27c5bd6 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:13.462620 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-f1761356-d6e3-4936-9ba8-eba95e6aef03 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 13 14:50:13.462620 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:13.462620 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 14:50:13.462620 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 14:50:13.462620 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 14:50:13.462620 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 14:50:13.462620 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 14:50:13.462620 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application result = self._query(query) May 13 14:50:13.462620 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 14:50:13.462620 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application conn.query(q) May 13 14:50:13.462620 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 14:50:13.462620 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 14:50:13.462620 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 14:50:13.462620 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application result.read() May 13 14:50:13.462620 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 14:50:13.464466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 14:50:13.464466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 14:50:13.464466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 14:50:13.464466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 14:50:13.464466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 14:50:13.464466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 14:50:13.464466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 14:50:13.464466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 13 14:50:13.464466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:13.464466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 13 14:50:13.464466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:13.464466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:13.464466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 13 14:50:13.464466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 13 14:50:13.464466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 13 14:50:13.464466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return ref.to_dict() May 13 14:50:13.464466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 14:50:13.464466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application next(self.gen) May 13 14:50:13.466360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 13 14:50:13.466360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application yield resource May 13 14:50:13.466360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 14:50:13.466360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application next(self.gen) May 13 14:50:13.466360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 13 14:50:13.466360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self.session.rollback() May 13 14:50:13.466360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 13 14:50:13.466360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self.force_reraise() May 13 14:50:13.466360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 13 14:50:13.466360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise self.value May 13 14:50:13.466360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 13 14:50:13.466360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 13 14:50:13.466360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 13 14:50:13.466360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application session.commit() May 13 14:50:13.466360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 13 14:50:13.466360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 13 14:50:13.466360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 13 14:50:13.469550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._prepare_impl() May 13 14:50:13.469550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 13 14:50:13.469550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self.session.flush() May 13 14:50:13.469550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 13 14:50:13.469550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._flush(objects) May 13 14:50:13.469550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 13 14:50:13.469550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 13 14:50:13.469550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 13 14:50:13.469550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application compat.raise_( May 13 14:50:13.469550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 14:50:13.469550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception May 13 14:50:13.469550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 13 14:50:13.469550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application flush_context.execute() May 13 14:50:13.469550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 13 14:50:13.469550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rec.execute(self) May 13 14:50:13.469550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 13 14:50:13.469550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 13 14:50:13.472594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 13 14:50:13.472594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application _emit_insert_statements( May 13 14:50:13.472594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 13 14:50:13.472594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application c = connection._execute_20( May 13 14:50:13.472594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 13 14:50:13.472594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 13 14:50:13.472594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 13 14:50:13.472594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 13 14:50:13.472594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 13 14:50:13.472594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ret = self._execute_context( May 13 14:50:13.472594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 13 14:50:13.472594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 13 14:50:13.472594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 13 14:50:13.472594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 13 14:50:13.472594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 14:50:13.472594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception May 13 14:50:13.478482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 14:50:13.478482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 14:50:13.478482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 14:50:13.478482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 14:50:13.478482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 14:50:13.478482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application result = self._query(query) May 13 14:50:13.478482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 14:50:13.478482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application conn.query(q) May 13 14:50:13.478482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 14:50:13.478482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 14:50:13.478482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 14:50:13.478482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application result.read() May 13 14:50:13.478482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 14:50:13.478482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 14:50:13.478482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 14:50:13.478482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 14:50:13.481802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 14:50:13.481802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 14:50:13.481802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 14:50:13.481802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 14:50:13.481802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 13 14:50:13.481802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 13 14:50:13.481802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [parameters: {'id': '8fc80439011d40b8a8bf2a554fc36c0a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 13 14:50:13.481802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 13 14:50:13.481802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:13.481802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:50:13.481802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:13.481802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:13.481802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:13.481802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:13.481802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:13.481802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:13.486257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:13.486257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:13.486257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:13.486257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:13.486257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:13.486257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:13.486257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 13 14:50:13.486257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 13 14:50:13.486257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:13.486257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:13.486257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 13 14:50:13.486257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 13 14:50:13.486257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 13 14:50:13.486257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 13 14:50:13.486257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 13 14:50:13.486257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:13.494070 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 241/477] 10.222.0.73 () {60 vars in 1131 bytes} [Fri May 13 14:50:13 2022] POST /identity/v3/roles => generated 144 bytes in 376 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 13 14:50:13.494070 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1761356-d6e3-4936-9ba8-eba95e6aef03 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:13.494539 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 237/478] 10.222.0.73 () {60 vars in 1132 bytes} [Fri May 13 14:50:13 2022] POST /identity/v3/users => generated 249 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:50:13.694565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1761356-d6e3-4936-9ba8-eba95e6aef03 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:13.764134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08c990-cc83-499a-a183-0b1a5e78c44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:13.765627 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08c990-cc83-499a-a183-0b1a5e78c44e None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:13.766132 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08c990-cc83-499a-a183-0b1a5e78c44e None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:13.766682 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08c990-cc83-499a-a183-0b1a5e78c44e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:13.788835 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08c990-cc83-499a-a183-0b1a5e78c44e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:13.805581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-1e08c990-cc83-499a-a183-0b1a5e78c44e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:50:13.805581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:13.805581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:13.805581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:13.805581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:13.805581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:13.805581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:13.805581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:13.805581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:13.805581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:13.805581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:13.805581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:13.805581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:13.805581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:13.805581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:13.805581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:13.807457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:13.807457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:13.807457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:13.807457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:13.807457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:13.807457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:13.807457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:13.807457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:13.807457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:13.807457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:13.807457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:13.807457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:13.807457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:13.807457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:13.807457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:13.807457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:13.809073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:13.809073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:13.809073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:13.809073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:13.809073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:13.809073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:13.809073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:13.809073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:13.809073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:13.809073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:13.809073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 14:50:13.809073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:13.809073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 242/479] 10.222.0.73 () {56 vars in 1114 bytes} [Fri May 13 14:50:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:13.814422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c8d1c-65da-4db1-b006-6b70b27c5bd6 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:13.995242 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c8d1c-65da-4db1-b006-6b70b27c5bd6 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:14.039363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f48b4-979a-48e7-ad27-fd08c951a94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:14.040053 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f48b4-979a-48e7-ad27-fd08c951a94e None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:14.040445 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f48b4-979a-48e7-ad27-fd08c951a94e None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:14.040720 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f48b4-979a-48e7-ad27-fd08c951a94e None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:14.041495 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f48b4-979a-48e7-ad27-fd08c951a94e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:14.041800 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f48b4-979a-48e7-ad27-fd08c951a94e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:14.043235 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f48b4-979a-48e7-ad27-fd08c951a94e None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:14.056221 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 238/480] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:15.174690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a196157-abb1-4d3f-98ef-1d3ef9d7f651 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:15.175240 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a196157-abb1-4d3f-98ef-1d3ef9d7f651 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:15.175240 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a196157-abb1-4d3f-98ef-1d3ef9d7f651 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:15.176885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 243/481] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:15.193258 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710506a-cf2d-40a8-8fec-fcba145e82ab None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:15.194498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710506a-cf2d-40a8-8fec-fcba145e82ab None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:15.195011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710506a-cf2d-40a8-8fec-fcba145e82ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:15.223931 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-e710506a-cf2d-40a8-8fec-fcba145e82ab None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:15.226117 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-e710506a-cf2d-40a8-8fec-fcba145e82ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:15.320542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 239/482] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:15.345599 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a196157-abb1-4d3f-98ef-1d3ef9d7f651 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:15.414001 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0272e4a-558a-4d29-9b2e-be88272a9771 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:15.414435 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0272e4a-558a-4d29-9b2e-be88272a9771 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:15.414591 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0272e4a-558a-4d29-9b2e-be88272a9771 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:15.416298 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 240/483] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:50:15.428790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ffc1b-5f78-47f4-bea5-d742a12d3a9f None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:15.428790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ffc1b-5f78-47f4-bea5-d742a12d3a9f None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:15.428790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ffc1b-5f78-47f4-bea5-d742a12d3a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:15.460605 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-ff2ffc1b-5f78-47f4-bea5-d742a12d3a9f None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:15.461778 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ff2ffc1b-5f78-47f4-bea5-d742a12d3a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:15.560274 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a196157-abb1-4d3f-98ef-1d3ef9d7f651 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:15.629829 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 241/484] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:50:15.637114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18292d-d12f-4524-89df-babb2501e3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:15.637936 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18292d-d12f-4524-89df-babb2501e3f7 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:15.638225 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18292d-d12f-4524-89df-babb2501e3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:15.638482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18292d-d12f-4524-89df-babb2501e3f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:15.656811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18292d-d12f-4524-89df-babb2501e3f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:15.664888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-7b18292d-d12f-4524-89df-babb2501e3f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:15.664888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:15.664888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:15.664888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:15.664888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:15.664888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:15.664888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:15.664888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:15.664888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:15.664888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:15.664888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:15.664888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:15.664888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:15.664888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:15.664888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:15.664888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:15.667178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:15.667178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:15.667178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:15.667178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:15.667178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:15.667178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:15.667178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:15.667178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:15.667178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:15.667178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:15.667178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:15.667178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:15.667178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:15.667178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:15.667178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:15.667178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:15.669146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:15.669146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:15.669146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:15.669146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:15.669146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:15.669146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:15.669146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:15.669146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:15.669146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:15.669146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:15.669146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:15.669146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:15.669146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 244/485] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:50:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:15.677094 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ffc1b-5f78-47f4-bea5-d742a12d3a9f None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:15.716428 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18292d-d12f-4524-89df-babb2501e3f7 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:15.882974 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ffc1b-5f78-47f4-bea5-d742a12d3a9f None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:15.954803 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032fa17-be92-4333-b93d-a5a3b88aa288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:15.956026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032fa17-be92-4333-b93d-a5a3b88aa288 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:15.956528 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032fa17-be92-4333-b93d-a5a3b88aa288 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:15.956967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032fa17-be92-4333-b93d-a5a3b88aa288 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:15.958029 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032fa17-be92-4333-b93d-a5a3b88aa288 None admin] RBAC: Adding query filter params (name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:15.958575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032fa17-be92-4333-b93d-a5a3b88aa288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:15.964402 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18292d-d12f-4524-89df-babb2501e3f7 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:15.967249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032fa17-be92-4333-b93d-a5a3b88aa288 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:15.976931 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 242/486] 10.222.0.73 () {56 vars in 1103 bytes} [Fri May 13 14:50:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:50:15.983887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032fa17-be92-4333-b93d-a5a3b88aa288 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:16.047594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed869f54-29b4-41f4-aa26-c0a447096015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:16.048701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed869f54-29b4-41f4-aa26-c0a447096015 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:16.049133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed869f54-29b4-41f4-aa26-c0a447096015 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:16.049553 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed869f54-29b4-41f4-aa26-c0a447096015 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:16.077643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed869f54-29b4-41f4-aa26-c0a447096015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:16.087374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-ed869f54-29b4-41f4-aa26-c0a447096015 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:16.087374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:16.087374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:16.087374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:16.087374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:16.087374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:16.087374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:16.087374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:16.087374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:16.087374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:16.087374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:16.087374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:16.087374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:16.087374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:16.087374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:16.087374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:16.088511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:16.088511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:16.088511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:16.088511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:16.088511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:16.088511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:16.088511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:16.088511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:16.088511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:16.088511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:16.088511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:16.088511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:16.088511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:16.088511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:16.088511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:16.088511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:16.089423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:16.089423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:16.089423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:16.089423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:16.089423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:16.089423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:16.089423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:16.089423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:16.089423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:16.089423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:16.089423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:16.089423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:16.100276 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 245/487] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:50:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:50:16.106975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed869f54-29b4-41f4-aa26-c0a447096015 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:16.164854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032fa17-be92-4333-b93d-a5a3b88aa288 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:16.203088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158cd66-4ad6-4671-9515-5c2b23072e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:16.207906 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158cd66-4ad6-4671-9515-5c2b23072e9d None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:16.208614 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158cd66-4ad6-4671-9515-5c2b23072e9d None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:16.209052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158cd66-4ad6-4671-9515-5c2b23072e9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:16.233546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158cd66-4ad6-4671-9515-5c2b23072e9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:16.236025 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158cd66-4ad6-4671-9515-5c2b23072e9d None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:16.270862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-3158cd66-4ad6-4671-9515-5c2b23072e9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:16.270862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:16.270862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:16.270862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:16.270862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:16.270862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:16.270862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:16.270862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:16.270862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:16.270862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:16.270862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:16.270862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:16.270862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:16.270862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:16.270862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:16.271820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:16.271820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:16.271820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:16.271820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:16.271820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:16.271820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:16.271820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:16.271820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:16.271820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:16.271820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:16.271820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:16.271820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:16.271820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:16.271820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:16.271820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:16.271820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:16.271820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:16.272680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:16.272680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:16.272680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:16.272680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:16.272680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 243/488] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:16.279914 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158cd66-4ad6-4671-9515-5c2b23072e9d None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:16.289812 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed869f54-29b4-41f4-aa26-c0a447096015 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:16.330874 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f1b9c-2a62-436b-9b1c-ab739e8f168f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:16.331573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f1b9c-2a62-436b-9b1c-ab739e8f168f None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:16.331861 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f1b9c-2a62-436b-9b1c-ab739e8f168f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:16.332355 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f1b9c-2a62-436b-9b1c-ab739e8f168f None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:16.333265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f1b9c-2a62-436b-9b1c-ab739e8f168f None admin] RBAC: Adding query filter params (name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:16.333575 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f1b9c-2a62-436b-9b1c-ab739e8f168f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:16.335303 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f1b9c-2a62-436b-9b1c-ab739e8f168f None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:16.344970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 246/489] 10.222.0.73 () {56 vars in 1103 bytes} [Fri May 13 14:50:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:50:16.351100 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f1b9c-2a62-436b-9b1c-ab739e8f168f None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:16.494085 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f1b9c-2a62-436b-9b1c-ab739e8f168f None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:16.501279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158cd66-4ad6-4671-9515-5c2b23072e9d None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:16.537227 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670d417-e737-42fa-8f07-527caf01594f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:16.538598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670d417-e737-42fa-8f07-527caf01594f None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:16.539548 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670d417-e737-42fa-8f07-527caf01594f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:16.539858 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670d417-e737-42fa-8f07-527caf01594f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:16.554289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670d417-e737-42fa-8f07-527caf01594f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:16.556279 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670d417-e737-42fa-8f07-527caf01594f None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:16.563257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fff98e-ebbb-471b-88d8-66a4f67f31bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:16.564489 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fff98e-ebbb-471b-88d8-66a4f67f31bc None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:16.565039 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fff98e-ebbb-471b-88d8-66a4f67f31bc None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:16.565586 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fff98e-ebbb-471b-88d8-66a4f67f31bc None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:16.567355 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fff98e-ebbb-471b-88d8-66a4f67f31bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:16.567985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fff98e-ebbb-471b-88d8-66a4f67f31bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:16.571525 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fff98e-ebbb-471b-88d8-66a4f67f31bc None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:16.576600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-b670d417-e737-42fa-8f07-527caf01594f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:16.576600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:16.576600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:16.576600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:16.576600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:16.576600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:16.576600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:16.576600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:16.576600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:16.576600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:16.576600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:16.576600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:16.576600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:16.576600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:16.576600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:16.578401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:16.578401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:16.578401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:16.578401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:16.578401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:16.578401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:16.578401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:16.578401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:16.578401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:16.578401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:16.578401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:16.578401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:16.578401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:16.578401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:16.578401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:16.578401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:16.578401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:16.580299 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:16.580299 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:16.580299 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:16.580299 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:16.587133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 247/490] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:50:16.587133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d3069-abab-4cda-a180-181d9fe2da8a None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:16.587133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d3069-abab-4cda-a180-181d9fe2da8a None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:16.587133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d3069-abab-4cda-a180-181d9fe2da8a None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:16.587133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 248/491] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:16.588903 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d3069-abab-4cda-a180-181d9fe2da8a None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:16.598472 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 244/492] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:16.605175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4234f-09a8-4105-8943-b4ba3a539ad6 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:16.605775 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4234f-09a8-4105-8943-b4ba3a539ad6 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:16.606242 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4234f-09a8-4105-8943-b4ba3a539ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:16.625672 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-47a4234f-09a8-4105-8943-b4ba3a539ad6 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:16.626910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-47a4234f-09a8-4105-8943-b4ba3a539ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:16.700097 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 245/493] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:16.701062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4234f-09a8-4105-8943-b4ba3a539ad6 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:16.704365 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d3069-abab-4cda-a180-181d9fe2da8a None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:16.742686 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbbf6d-710b-42c3-8c20-d452ab9836f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:16.743705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbbf6d-710b-42c3-8c20-d452ab9836f4 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:16.744223 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbbf6d-710b-42c3-8c20-d452ab9836f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:16.744648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbbf6d-710b-42c3-8c20-d452ab9836f4 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:16.745525 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbbf6d-710b-42c3-8c20-d452ab9836f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:16.745979 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbbf6d-710b-42c3-8c20-d452ab9836f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:16.747564 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbbf6d-710b-42c3-8c20-d452ab9836f4 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:16.761508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 249/494] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:16.767917 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbbf6d-710b-42c3-8c20-d452ab9836f4 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:16.833756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4234f-09a8-4105-8943-b4ba3a539ad6 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:16.882885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f1389-fc77-4709-98a6-861c829c8924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:16.884000 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f1389-fc77-4709-98a6-861c829c8924 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:16.884524 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f1389-fc77-4709-98a6-861c829c8924 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:16.885002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f1389-fc77-4709-98a6-861c829c8924 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:16.896068 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f1389-fc77-4709-98a6-861c829c8924 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:16.902050 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f1389-fc77-4709-98a6-861c829c8924 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:16.903953 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbbf6d-710b-42c3-8c20-d452ab9836f4 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:16.928334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-fe6f1389-fc77-4709-98a6-861c829c8924 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 14:50:16.928334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:16.928334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:16.928334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:16.928334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:16.928334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:16.928334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:16.928334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:16.928334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:16.928334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:16.928334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:16.928334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:16.928334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:50:16.928334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:50:16.928334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:50:16.928334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:50:16.929300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:16.929300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:16.929300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:50:16.929300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:16.929300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:50:16.929300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:16.929300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:16.929300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:16.929300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:16.929300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:16.929300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:16.929300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:16.929300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:16.929300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:16.929300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:16.929300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:16.929300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:16.929300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:16.930197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:16.930197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:16.930197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:50:16.930197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:50:16.930197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:50:16.930197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:50:16.930197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:50:16.930197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:50:16.930197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 14:50:16.930197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:16.933857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 246/495] 10.222.0.73 () {56 vars in 1093 bytes} [Fri May 13 14:50:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:16.935102 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f1389-fc77-4709-98a6-861c829c8924 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:16.953157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b3611-1f70-4ab6-a668-64fcde9c71f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:16.955563 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b3611-1f70-4ab6-a668-64fcde9c71f2 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:16.955563 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b3611-1f70-4ab6-a668-64fcde9c71f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:16.955563 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b3611-1f70-4ab6-a668-64fcde9c71f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:16.968907 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b3611-1f70-4ab6-a668-64fcde9c71f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:16.975463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-473b3611-1f70-4ab6-a668-64fcde9c71f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:16.975463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:16.975463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:16.975463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:16.975463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:16.975463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:16.975463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:16.975463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:16.975463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:16.975463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:16.975463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:16.975463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:16.975463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:16.975463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:16.975463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:16.975463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:16.976890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:16.976890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:16.976890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:16.976890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:16.976890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:16.976890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:16.976890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:16.976890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:16.976890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:16.976890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:16.976890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:16.976890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:16.976890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:16.976890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:16.976890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:16.976890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:16.977729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:16.977729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:16.977729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:16.977729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:16.977729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:16.977729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:16.977729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:16.977729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:16.977729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:16.977729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:16.977729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:16.977729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:16.977729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 250/496] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:50:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:16.978714 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b3611-1f70-4ab6-a668-64fcde9c71f2 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:17.090852 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f1389-fc77-4709-98a6-861c829c8924 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:17.094973 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b3611-1f70-4ab6-a668-64fcde9c71f2 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:17.133959 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f994ccb-d673-4751-9a33-803c977171ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:17.135204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f994ccb-d673-4751-9a33-803c977171ec None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:17.135553 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f994ccb-d673-4751-9a33-803c977171ec None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:17.135957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f994ccb-d673-4751-9a33-803c977171ec None admin] PATH_INFO: `/v3/users/glance` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:17.141567 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e656f-b7f0-4101-9c12-2be5473acaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:17.142560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e656f-b7f0-4101-9c12-2be5473acaf2 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:17.143040 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e656f-b7f0-4101-9c12-2be5473acaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:17.143467 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e656f-b7f0-4101-9c12-2be5473acaf2 None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:17.144749 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e656f-b7f0-4101-9c12-2be5473acaf2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:17.145381 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e656f-b7f0-4101-9c12-2be5473acaf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:17.146004 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f994ccb-d673-4751-9a33-803c977171ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:17.147458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e656f-b7f0-4101-9c12-2be5473acaf2 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:17.147951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f994ccb-d673-4751-9a33-803c977171ec None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:17.165176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-2f994ccb-d673-4751-9a33-803c977171ec None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 13 14:50:17.165176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:17.165176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:17.165176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:17.165176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:17.165176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:17.165176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:17.165176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:17.165176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:17.165176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:17.165176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:17.165176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:17.165176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:50:17.165176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:50:17.165176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:50:17.165176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:50:17.166396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:17.166396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:17.166396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:50:17.166396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:17.166396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:50:17.166396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:17.166396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:17.166396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:17.166396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:17.166396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:17.166396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:17.166396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:17.166396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:17.166396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:17.166396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:17.166396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:17.166396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:17.166396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:17.167546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:17.167546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:17.167546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:50:17.167546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:50:17.167546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:50:17.167546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:50:17.167546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:50:17.167546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:50:17.167546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 13 14:50:17.167546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:17.173995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 247/497] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:50:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:17.175126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f994ccb-d673-4751-9a33-803c977171ec None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:17.199630 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 251/498] 10.222.0.73 () {56 vars in 1133 bytes} [Fri May 13 14:50:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:17.200786 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e656f-b7f0-4101-9c12-2be5473acaf2 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:17.292680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f994ccb-d673-4751-9a33-803c977171ec None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:17.319230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e656f-b7f0-4101-9c12-2be5473acaf2 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:17.333865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a1324-2505-4401-bfd6-3265d8c87f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:17.335459 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a1324-2505-4401-bfd6-3265d8c87f69 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:17.335897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a1324-2505-4401-bfd6-3265d8c87f69 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:17.336179 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a1324-2505-4401-bfd6-3265d8c87f69 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:17.336944 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a1324-2505-4401-bfd6-3265d8c87f69 None admin] RBAC: Adding query filter params (name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:17.337272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a1324-2505-4401-bfd6-3265d8c87f69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:17.338651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a1324-2505-4401-bfd6-3265d8c87f69 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:17.347598 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 248/499] 10.222.0.73 () {56 vars in 1103 bytes} [Fri May 13 14:50:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:17.348382 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a1324-2505-4401-bfd6-3265d8c87f69 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:17.360915 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173b722-13e6-4c15-85d1-59c4f2712d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:17.361605 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173b722-13e6-4c15-85d1-59c4f2712d39 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:17.361889 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173b722-13e6-4c15-85d1-59c4f2712d39 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:17.362165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173b722-13e6-4c15-85d1-59c4f2712d39 None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:17.363050 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173b722-13e6-4c15-85d1-59c4f2712d39 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:17.364625 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173b722-13e6-4c15-85d1-59c4f2712d39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:17.368793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173b722-13e6-4c15-85d1-59c4f2712d39 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:17.404613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 252/500] 10.222.0.73 () {56 vars in 1137 bytes} [Fri May 13 14:50:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:17.404613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf5f32-558d-4b4b-85e8-14531c746db3 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:17.404613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf5f32-558d-4b4b-85e8-14531c746db3 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:17.404613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf5f32-558d-4b4b-85e8-14531c746db3 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:17.408882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 253/501] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:17.408882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf5f32-558d-4b4b-85e8-14531c746db3 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:17.473671 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a1324-2505-4401-bfd6-3265d8c87f69 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:17.515417 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56ef68-6035-4ddc-9078-02c4dc0b8787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:17.516522 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56ef68-6035-4ddc-9078-02c4dc0b8787 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:17.517019 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56ef68-6035-4ddc-9078-02c4dc0b8787 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:17.517472 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56ef68-6035-4ddc-9078-02c4dc0b8787 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:17.525950 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf5f32-558d-4b4b-85e8-14531c746db3 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:17.573154 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d15c4-e986-4900-a0da-98affea5df2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:17.574412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d15c4-e986-4900-a0da-98affea5df2b None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:17.574904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d15c4-e986-4900-a0da-98affea5df2b None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:17.575250 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d15c4-e986-4900-a0da-98affea5df2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:17.592520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d15c4-e986-4900-a0da-98affea5df2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:17.595149 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d15c4-e986-4900-a0da-98affea5df2b None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:17.617964 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56ef68-6035-4ddc-9078-02c4dc0b8787 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:17.623246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56ef68-6035-4ddc-9078-02c4dc0b8787 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:17.633341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-c13d15c4-e986-4900-a0da-98affea5df2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:17.633341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:17.633341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:17.633341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:17.633341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:17.633341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:17.633341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:17.633341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:17.633341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:17.633341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:17.633341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:17.633341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:17.633341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:17.633341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:17.633341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:17.634485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:17.634485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:17.634485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:17.634485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:17.634485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:17.634485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:17.634485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:17.634485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:17.634485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:17.634485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:17.634485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:17.634485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:17.634485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:17.634485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:17.634485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:17.634485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:17.634485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:17.635430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:17.635430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:17.635430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:17.635430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:17.635840 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 254/502] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:17.636831 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d15c4-e986-4900-a0da-98affea5df2b None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:17.773926 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 249/503] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:50:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:50:17.774183 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d15c4-e986-4900-a0da-98affea5df2b None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:17.774314 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7df5e7-4a8f-4f39-b919-248bb954d04e None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:17.774314 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7df5e7-4a8f-4f39-b919-248bb954d04e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:17.774314 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7df5e7-4a8f-4f39-b919-248bb954d04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:17.798458 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-be7df5e7-4a8f-4f39-b919-248bb954d04e None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:17.800487 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-be7df5e7-4a8f-4f39-b919-248bb954d04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:17.829081 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9117742-6ba5-4129-a9a7-595b9bcbc47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:17.830017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9117742-6ba5-4129-a9a7-595b9bcbc47c None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:17.830469 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9117742-6ba5-4129-a9a7-595b9bcbc47c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:17.830954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9117742-6ba5-4129-a9a7-595b9bcbc47c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:17.899442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 250/504] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:17.902027 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62588cda-840f-4be2-8071-d968a58663b2 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:17.902628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62588cda-840f-4be2-8071-d968a58663b2 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:17.902988 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62588cda-840f-4be2-8071-d968a58663b2 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:17.905775 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 251/505] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:17.909545 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62588cda-840f-4be2-8071-d968a58663b2 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:17.911480 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9117742-6ba5-4129-a9a7-595b9bcbc47c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:17.913601 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9117742-6ba5-4129-a9a7-595b9bcbc47c None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:18.033876 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 255/506] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:50:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:50:18.035337 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9117742-6ba5-4129-a9a7-595b9bcbc47c None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:18.049193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62588cda-840f-4be2-8071-d968a58663b2 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:18.102538 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a4d88-c405-4feb-84e1-e7129711ae4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:18.103284 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a4d88-c405-4feb-84e1-e7129711ae4a None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:18.103725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a4d88-c405-4feb-84e1-e7129711ae4a None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:18.104240 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a4d88-c405-4feb-84e1-e7129711ae4a None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:18.105169 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a4d88-c405-4feb-84e1-e7129711ae4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:18.105583 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a4d88-c405-4feb-84e1-e7129711ae4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:18.107230 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a4d88-c405-4feb-84e1-e7129711ae4a None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:18.120830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 252/507] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:18.123085 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63dca4-ab4d-4c42-a459-339de697d2b3 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:18.123564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63dca4-ab4d-4c42-a459-339de697d2b3 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:18.124040 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63dca4-ab4d-4c42-a459-339de697d2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:18.143757 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-2f63dca4-ab4d-4c42-a459-339de697d2b3 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:18.145612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-2f63dca4-ab4d-4c42-a459-339de697d2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:18.173940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9117742-6ba5-4129-a9a7-595b9bcbc47c None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:18.217070 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ddd57-91e0-4ee5-8f32-78906982cbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:18.218007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ddd57-91e0-4ee5-8f32-78906982cbe7 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:18.218370 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ddd57-91e0-4ee5-8f32-78906982cbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:18.218728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ddd57-91e0-4ee5-8f32-78906982cbe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:18.235161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 253/508] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:18.235161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63dca4-ab4d-4c42-a459-339de697d2b3 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:18.235983 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ddd57-91e0-4ee5-8f32-78906982cbe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:18.238894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ddd57-91e0-4ee5-8f32-78906982cbe7 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:18.267669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-393ddd57-91e0-4ee5-8f32-78906982cbe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:18.267669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:18.267669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:18.267669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:18.267669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:18.267669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:18.267669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:18.267669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:18.267669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:18.267669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:18.267669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:18.267669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:18.267669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:18.267669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:18.267669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:18.269387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:18.269387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:18.269387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:18.269387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:18.269387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:18.269387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:18.269387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:18.269387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:18.269387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:18.269387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:18.269387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:18.269387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:18.269387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:18.269387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:18.269387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:18.269387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:18.269387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:18.272604 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:18.272604 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:18.272604 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:18.272604 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:18.272604 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 256/509] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:18.272604 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ddd57-91e0-4ee5-8f32-78906982cbe7 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:18.337210 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63dca4-ab4d-4c42-a459-339de697d2b3 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:18.374488 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2514535-ba25-46c5-be0c-af3c44cdddbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:18.375310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2514535-ba25-46c5-be0c-af3c44cdddbc None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:18.375586 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2514535-ba25-46c5-be0c-af3c44cdddbc None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:18.375855 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2514535-ba25-46c5-be0c-af3c44cdddbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:18.387793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2514535-ba25-46c5-be0c-af3c44cdddbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:18.389284 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2514535-ba25-46c5-be0c-af3c44cdddbc None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:18.400248 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ddd57-91e0-4ee5-8f32-78906982cbe7 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:18.415677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-e2514535-ba25-46c5-be0c-af3c44cdddbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:18.415677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:18.415677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:18.415677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:18.415677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:18.415677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:18.415677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:18.415677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:18.415677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:18.415677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:18.415677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:18.415677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:18.415677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:18.415677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:18.415677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:18.417023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:18.417023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:18.417023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:18.417023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:18.417023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:18.417023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:18.417023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:18.417023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:18.417023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:18.417023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:18.417023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:18.417023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:18.417023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:18.417023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:18.417023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:18.417023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:18.417023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:18.418738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:18.418738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:18.418738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:18.418738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:18.418738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 254/510] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:18.418738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2514535-ba25-46c5-be0c-af3c44cdddbc None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:18.442756 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ae1d0-209a-4ebb-a604-db62cbde7782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:18.443639 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ae1d0-209a-4ebb-a604-db62cbde7782 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:18.444431 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ae1d0-209a-4ebb-a604-db62cbde7782 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:18.444705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ae1d0-209a-4ebb-a604-db62cbde7782 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:18.460637 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ae1d0-209a-4ebb-a604-db62cbde7782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:18.462129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ae1d0-209a-4ebb-a604-db62cbde7782 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:18.480971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-2d7ae1d0-209a-4ebb-a604-db62cbde7782 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:18.480971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:18.480971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:18.480971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:18.480971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:18.480971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:18.480971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:18.480971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:18.480971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:18.480971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:18.480971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:18.480971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:18.480971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:18.480971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:18.480971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:18.482814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:18.482814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:18.482814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:18.482814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:18.482814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:18.482814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:18.482814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:18.482814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:18.482814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:18.482814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:18.482814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:18.482814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:18.482814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:18.482814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:18.482814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:18.482814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:18.482814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:18.484613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:18.484613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:18.484613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:18.484613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:18.484613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 257/511] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:18.484613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ae1d0-209a-4ebb-a604-db62cbde7782 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:18.564897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2514535-ba25-46c5-be0c-af3c44cdddbc None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:18.603341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ae1d0-209a-4ebb-a604-db62cbde7782 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:18.606040 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b3b70-2c9d-4999-968d-37f50391d314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:18.607327 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b3b70-2c9d-4999-968d-37f50391d314 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:18.607652 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b3b70-2c9d-4999-968d-37f50391d314 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:18.607963 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b3b70-2c9d-4999-968d-37f50391d314 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:18.620326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b3b70-2c9d-4999-968d-37f50391d314 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:18.622863 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b3b70-2c9d-4999-968d-37f50391d314 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:18.659069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-9b2b3b70-2c9d-4999-968d-37f50391d314 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 13 14:50:18.659069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:18.659069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:18.659069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:18.659069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:18.659069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:18.659069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:18.659069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:18.659069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:18.659069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:18.659069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:18.659069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:18.659069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:50:18.659069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:50:18.659069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:50:18.659069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:50:18.661032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:18.661032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:18.661032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:50:18.661032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:18.661032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:50:18.661032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:18.661032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:18.661032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:18.661032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:18.661032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:18.661032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:18.661032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:18.661032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:18.661032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:18.661032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:18.661032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:18.661032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:18.661032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:18.663356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:18.663356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:18.663356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:50:18.663356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:50:18.663356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:50:18.663356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:50:18.663356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:50:18.663356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:50:18.663356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 13 14:50:18.663356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:18.663356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 255/512] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:50:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:18.663356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b3b70-2c9d-4999-968d-37f50391d314 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:18.673188 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479ea81-b306-4d6b-9f8e-980aa463d28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:18.674157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479ea81-b306-4d6b-9f8e-980aa463d28c None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:18.674502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479ea81-b306-4d6b-9f8e-980aa463d28c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:18.674911 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479ea81-b306-4d6b-9f8e-980aa463d28c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:18.690067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479ea81-b306-4d6b-9f8e-980aa463d28c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:18.698899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-2479ea81-b306-4d6b-9f8e-980aa463d28c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:18.698899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:18.698899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:18.698899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:18.698899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:18.698899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:18.698899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:18.698899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:18.698899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:18.698899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:18.698899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:18.698899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:18.698899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:18.698899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:18.698899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:18.698899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:18.700723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:18.700723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:18.700723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:18.700723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:18.700723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:18.700723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:18.700723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:18.700723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:18.700723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:18.700723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:18.700723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:18.700723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:18.700723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:18.700723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:18.700723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:18.700723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:18.702403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:18.702403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:18.702403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:18.702403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:18.702403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:18.702403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:18.702403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:18.702403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:18.702403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:18.702403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:18.702403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:18.702403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:18.702403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 258/513] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:50:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:18.704925 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479ea81-b306-4d6b-9f8e-980aa463d28c None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:18.795331 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b3b70-2c9d-4999-968d-37f50391d314 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:18.849515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479ea81-b306-4d6b-9f8e-980aa463d28c None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:18.852073 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf794f-f7da-4748-8ab0-c24b6df6d370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:18.852885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf794f-f7da-4748-8ab0-c24b6df6d370 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:18.853255 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf794f-f7da-4748-8ab0-c24b6df6d370 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:18.853615 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf794f-f7da-4748-8ab0-c24b6df6d370 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:18.854450 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf794f-f7da-4748-8ab0-c24b6df6d370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:18.854876 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf794f-f7da-4748-8ab0-c24b6df6d370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:18.856405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf794f-f7da-4748-8ab0-c24b6df6d370 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:18.870245 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 256/514] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:18.871136 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf794f-f7da-4748-8ab0-c24b6df6d370 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:18.894163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc8369-91b1-4344-a9f0-168a1c3a08cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:18.894879 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc8369-91b1-4344-a9f0-168a1c3a08cb None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:18.895158 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc8369-91b1-4344-a9f0-168a1c3a08cb None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:18.895429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc8369-91b1-4344-a9f0-168a1c3a08cb None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:18.896184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc8369-91b1-4344-a9f0-168a1c3a08cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:18.896490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc8369-91b1-4344-a9f0-168a1c3a08cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:18.898441 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc8369-91b1-4344-a9f0-168a1c3a08cb None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:18.911523 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 259/515] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:18.912436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc8369-91b1-4344-a9f0-168a1c3a08cb None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:19.005324 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf794f-f7da-4748-8ab0-c24b6df6d370 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:19.039576 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc8369-91b1-4344-a9f0-168a1c3a08cb None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:19.059019 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35831bc2-c167-4a35-b521-8c08d88a8965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:19.059951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35831bc2-c167-4a35-b521-8c08d88a8965 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:19.060359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35831bc2-c167-4a35-b521-8c08d88a8965 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:19.060695 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35831bc2-c167-4a35-b521-8c08d88a8965 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:19.061694 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35831bc2-c167-4a35-b521-8c08d88a8965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:19.062067 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35831bc2-c167-4a35-b521-8c08d88a8965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:19.063697 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35831bc2-c167-4a35-b521-8c08d88a8965 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:19.087401 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 257/516] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:19.087401 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35831bc2-c167-4a35-b521-8c08d88a8965 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:19.088155 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e4472-4588-492c-8d00-f7cfc3338f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:19.088988 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e4472-4588-492c-8d00-f7cfc3338f67 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:19.089356 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e4472-4588-492c-8d00-f7cfc3338f67 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:19.089715 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e4472-4588-492c-8d00-f7cfc3338f67 None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:19.090679 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e4472-4588-492c-8d00-f7cfc3338f67 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:19.091123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e4472-4588-492c-8d00-f7cfc3338f67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:19.092696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e4472-4588-492c-8d00-f7cfc3338f67 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:19.115757 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 260/517] 10.222.0.73 () {56 vars in 1137 bytes} [Fri May 13 14:50:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:19.116882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e4472-4588-492c-8d00-f7cfc3338f67 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:19.214004 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35831bc2-c167-4a35-b521-8c08d88a8965 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:19.248092 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e4472-4588-492c-8d00-f7cfc3338f67 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:19.255605 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c022f1-44bd-429c-b26a-90e5a18715e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:19.256731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c022f1-44bd-429c-b26a-90e5a18715e6 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:19.257015 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c022f1-44bd-429c-b26a-90e5a18715e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:19.257287 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c022f1-44bd-429c-b26a-90e5a18715e6 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:19.258057 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c022f1-44bd-429c-b26a-90e5a18715e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:19.258359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c022f1-44bd-429c-b26a-90e5a18715e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:19.259799 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c022f1-44bd-429c-b26a-90e5a18715e6 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:19.268725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 258/518] 10.222.0.73 () {56 vars in 1103 bytes} [Fri May 13 14:50:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:19.269575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c022f1-44bd-429c-b26a-90e5a18715e6 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:19.290758 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac82ab-5394-4989-adfb-4146d0d5c79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:19.291760 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac82ab-5394-4989-adfb-4146d0d5c79b None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:19.292189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac82ab-5394-4989-adfb-4146d0d5c79b None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:19.292545 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac82ab-5394-4989-adfb-4146d0d5c79b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:19.301446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac82ab-5394-4989-adfb-4146d0d5c79b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:19.305812 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac82ab-5394-4989-adfb-4146d0d5c79b None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:19.325310 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-a9ac82ab-5394-4989-adfb-4146d0d5c79b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:19.325310 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:19.325310 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:19.325310 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:19.325310 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:19.325310 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:19.325310 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:19.325310 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:19.325310 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:19.325310 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:19.325310 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:19.325310 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:19.325310 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:50:19.325310 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:50:19.325310 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:50:19.327216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:50:19.327216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:19.327216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:19.327216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:19.327216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:19.327216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:19.327216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:19.327216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:19.327216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:19.327216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:19.327216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:19.327216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:19.327216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:19.327216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:19.327216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:19.327216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:19.327216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:19.329226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:50:19.329226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:50:19.329226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:50:19.329226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:50:19.329226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:50:19.329226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:50:19.329226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:19.329226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:19.329226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 261/519] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:19.329226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac82ab-5394-4989-adfb-4146d0d5c79b None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:19.403080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c022f1-44bd-429c-b26a-90e5a18715e6 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:19.447352 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3491897-3d22-464d-ae97-b754403fbe64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:19.448185 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3491897-3d22-464d-ae97-b754403fbe64 None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:19.448561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3491897-3d22-464d-ae97-b754403fbe64 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:19.448943 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3491897-3d22-464d-ae97-b754403fbe64 None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:19.449759 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3491897-3d22-464d-ae97-b754403fbe64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:19.451622 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3491897-3d22-464d-ae97-b754403fbe64 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:19.457192 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac82ab-5394-4989-adfb-4146d0d5c79b None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:19.477072 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 259/520] 10.222.0.73 () {60 vars in 1132 bytes} [Fri May 13 14:50:19 2022] POST /identity/v3/users => generated 247 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:50:19.478132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3491897-3d22-464d-ae97-b754403fbe64 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:19.512236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf29ee9-a011-4330-9db5-0ecc047347d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:19.512978 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf29ee9-a011-4330-9db5-0ecc047347d3 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:19.513261 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf29ee9-a011-4330-9db5-0ecc047347d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:19.513562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf29ee9-a011-4330-9db5-0ecc047347d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:19.526145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf29ee9-a011-4330-9db5-0ecc047347d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:19.529055 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf29ee9-a011-4330-9db5-0ecc047347d3 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:19.555008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-caf29ee9-a011-4330-9db5-0ecc047347d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:19.555008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:19.555008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:19.555008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:19.555008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:19.555008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:19.555008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:19.555008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:19.555008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:19.555008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:19.555008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:19.555008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:19.555008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:50:19.555008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:50:19.555008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:50:19.556705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:50:19.556705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:19.556705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:19.556705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:19.556705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:19.556705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:19.556705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:19.556705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:19.556705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:19.556705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:19.556705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:19.556705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:19.556705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:19.556705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:19.556705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:19.556705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:19.556705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:19.567535 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:50:19.567535 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:50:19.567535 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:50:19.567535 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:50:19.567535 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:50:19.567535 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:50:19.567535 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:19.567535 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:19.567535 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 262/521] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:19.567535 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf29ee9-a011-4330-9db5-0ecc047347d3 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:19.633155 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3491897-3d22-464d-ae97-b754403fbe64 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:19.683076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bcfbb-69e8-4244-828c-0e96d1e7870d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:19.684274 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bcfbb-69e8-4244-828c-0e96d1e7870d None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:19.684856 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bcfbb-69e8-4244-828c-0e96d1e7870d None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:19.685355 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bcfbb-69e8-4244-828c-0e96d1e7870d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:19.690505 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf29ee9-a011-4330-9db5-0ecc047347d3 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:19.729898 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28811c-d290-46ff-874c-56924aa432e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:19.730723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28811c-d290-46ff-874c-56924aa432e2 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:19.731034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28811c-d290-46ff-874c-56924aa432e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:19.731309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28811c-d290-46ff-874c-56924aa432e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:19.743905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28811c-d290-46ff-874c-56924aa432e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:19.745459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28811c-d290-46ff-874c-56924aa432e2 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:19.774419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-bb28811c-d290-46ff-874c-56924aa432e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:19.774419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:19.774419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:19.774419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:19.774419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:19.774419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:19.774419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:19.774419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:19.774419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:19.774419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:19.774419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:19.774419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:19.774419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:19.774419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:19.774419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:19.775453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:19.775453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:19.775453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:19.775453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:19.775453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:19.775453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:19.775453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:19.775453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:19.775453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:19.775453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:19.775453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:19.775453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:19.775453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:19.775453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:19.775453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:19.775453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:19.775453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:19.776432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:19.776432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:19.776432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:19.776432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:19.778205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 263/522] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:19.784242 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28811c-d290-46ff-874c-56924aa432e2 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:19.784942 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80bcfbb-69e8-4244-828c-0e96d1e7870d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:19.786474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80bcfbb-69e8-4244-828c-0e96d1e7870d None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:19.908317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28811c-d290-46ff-874c-56924aa432e2 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:19.934796 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 260/523] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:50:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:50:19.934796 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bcfbb-69e8-4244-828c-0e96d1e7870d None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:19.959794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ddc58-85cd-486a-bf6a-22007e7fa67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:19.960996 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ddc58-85cd-486a-bf6a-22007e7fa67d None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:19.961493 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ddc58-85cd-486a-bf6a-22007e7fa67d None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:19.961980 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ddc58-85cd-486a-bf6a-22007e7fa67d None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:19.963552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ddc58-85cd-486a-bf6a-22007e7fa67d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:19.964123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ddc58-85cd-486a-bf6a-22007e7fa67d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:19.966968 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ddc58-85cd-486a-bf6a-22007e7fa67d None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:20.004988 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 264/524] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:50:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:20.004988 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ddc58-85cd-486a-bf6a-22007e7fa67d None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:20.042545 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bcfbb-69e8-4244-828c-0e96d1e7870d None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:20.100898 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960880d-d30e-47e8-8f07-514c32d2ca45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:20.102422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960880d-d30e-47e8-8f07-514c32d2ca45 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:20.103230 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960880d-d30e-47e8-8f07-514c32d2ca45 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:20.103904 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960880d-d30e-47e8-8f07-514c32d2ca45 None admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:20.105365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960880d-d30e-47e8-8f07-514c32d2ca45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:20.105873 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960880d-d30e-47e8-8f07-514c32d2ca45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:20.108227 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960880d-d30e-47e8-8f07-514c32d2ca45 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:20.137425 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 261/525] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:50:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:20.138652 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960880d-d30e-47e8-8f07-514c32d2ca45 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:20.144265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ddc58-85cd-486a-bf6a-22007e7fa67d None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:20.194944 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ad33c-afff-4b63-942f-bc8872c6fa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:20.195836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ad33c-afff-4b63-942f-bc8872c6fa96 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:20.196284 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ad33c-afff-4b63-942f-bc8872c6fa96 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:20.196724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ad33c-afff-4b63-942f-bc8872c6fa96 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:20.197954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ad33c-afff-4b63-942f-bc8872c6fa96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:20.198443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ad33c-afff-4b63-942f-bc8872c6fa96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:20.200860 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ad33c-afff-4b63-942f-bc8872c6fa96 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:20.220711 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 265/526] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:20.222209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ad33c-afff-4b63-942f-bc8872c6fa96 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:20.278611 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960880d-d30e-47e8-8f07-514c32d2ca45 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:20.327663 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e3c88-da54-4f53-a2c5-b8e0de1dcec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:20.328448 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e3c88-da54-4f53-a2c5-b8e0de1dcec9 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:20.328746 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e3c88-da54-4f53-a2c5-b8e0de1dcec9 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:20.329019 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e3c88-da54-4f53-a2c5-b8e0de1dcec9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:20.341477 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e3c88-da54-4f53-a2c5-b8e0de1dcec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:20.343198 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e3c88-da54-4f53-a2c5-b8e0de1dcec9 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:20.354242 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ad33c-afff-4b63-942f-bc8872c6fa96 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:20.364010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-384e3c88-da54-4f53-a2c5-b8e0de1dcec9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:20.364010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:20.364010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:20.364010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:20.364010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:20.364010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:20.364010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:20.364010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:20.364010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:20.364010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:20.364010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:20.364010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:20.364010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:20.364010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:20.364010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:20.366224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:20.366224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:20.366224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:20.366224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:20.366224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:20.366224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:20.366224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:20.366224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:20.366224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:20.366224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:20.366224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:20.366224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:20.366224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:20.366224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:20.366224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:20.366224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:20.366224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:20.369129 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:20.369129 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:20.369129 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:20.369129 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:20.372830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 262/527] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:20.373758 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e3c88-da54-4f53-a2c5-b8e0de1dcec9 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:20.394184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a470765-017a-4b10-99f7-bb0a6dd3c928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:20.394894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a470765-017a-4b10-99f7-bb0a6dd3c928 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:20.395521 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a470765-017a-4b10-99f7-bb0a6dd3c928 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:20.395521 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a470765-017a-4b10-99f7-bb0a6dd3c928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:20.396300 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a470765-017a-4b10-99f7-bb0a6dd3c928 None admin] RBAC: Adding query filter params (role.id=354a460a8146476989f8a7b4fc1aac93, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=52d539202cfb40a48b231713e16a599a) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:20.396654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a470765-017a-4b10-99f7-bb0a6dd3c928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:20.398148 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a470765-017a-4b10-99f7-bb0a6dd3c928 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:20.415058 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 266/528] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:50:20 2022] GET /identity/v3/role_assignments?user.id=52d539202cfb40a48b231713e16a599a&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=354a460a8146476989f8a7b4fc1aac93 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:20.415058 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a470765-017a-4b10-99f7-bb0a6dd3c928 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:20.559756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e3c88-da54-4f53-a2c5-b8e0de1dcec9 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:20.600003 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a470765-017a-4b10-99f7-bb0a6dd3c928 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:20.607735 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4e256-80ab-41cc-9736-2e65219ff3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:20.608739 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4e256-80ab-41cc-9736-2e65219ff3b7 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:20.609232 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4e256-80ab-41cc-9736-2e65219ff3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:20.609685 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4e256-80ab-41cc-9736-2e65219ff3b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:20.610892 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4e256-80ab-41cc-9736-2e65219ff3b7 None admin] RBAC: Adding query filter params (role.id=354a460a8146476989f8a7b4fc1aac93, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=6cdd8008619d4ee3b8fe45e0e5241878) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:20.611441 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4e256-80ab-41cc-9736-2e65219ff3b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:20.613175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4e256-80ab-41cc-9736-2e65219ff3b7 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:20.627424 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 263/529] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:50:20 2022] GET /identity/v3/role_assignments?user.id=6cdd8008619d4ee3b8fe45e0e5241878&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=354a460a8146476989f8a7b4fc1aac93 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:20.627424 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4e256-80ab-41cc-9736-2e65219ff3b7 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:20.704652 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f245d2-5b2b-47f9-beb9-7b7216643f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:20.705698 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f245d2-5b2b-47f9-beb9-7b7216643f4f None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:20.706134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f245d2-5b2b-47f9-beb9-7b7216643f4f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:20.706547 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f245d2-5b2b-47f9-beb9-7b7216643f4f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:20.719639 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f245d2-5b2b-47f9-beb9-7b7216643f4f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:20.721686 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f245d2-5b2b-47f9-beb9-7b7216643f4f None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:20.760391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-b5f245d2-5b2b-47f9-beb9-7b7216643f4f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 13 14:50:20.760391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:20.760391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:20.760391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:20.760391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:20.760391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:20.760391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:20.760391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:20.760391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:20.760391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:20.760391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:20.760391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:20.760391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:50:20.760391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:50:20.760391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:50:20.760391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:50:20.762209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:20.762209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:20.762209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:50:20.762209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:20.762209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:50:20.762209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:20.762209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:20.762209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:20.762209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:20.762209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:20.762209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:20.762209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:20.762209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:20.762209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:20.762209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:20.762209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:20.762209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:20.762209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:20.763897 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:20.763897 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:20.763897 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:50:20.763897 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:50:20.763897 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:50:20.763897 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:50:20.763897 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:50:20.763897 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:50:20.763897 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 13 14:50:20.763897 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:20.763897 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 267/530] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:50:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:20.769958 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f245d2-5b2b-47f9-beb9-7b7216643f4f None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:20.964782 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f245d2-5b2b-47f9-beb9-7b7216643f4f None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:20.990384 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4e256-80ab-41cc-9736-2e65219ff3b7 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:21.004666 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417ff0f-47cc-42f0-ba68-e597c7bf9d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:21.005402 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417ff0f-47cc-42f0-ba68-e597c7bf9d1c None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:21.005685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417ff0f-47cc-42f0-ba68-e597c7bf9d1c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:21.005999 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417ff0f-47cc-42f0-ba68-e597c7bf9d1c None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:21.006876 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417ff0f-47cc-42f0-ba68-e597c7bf9d1c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:21.007188 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417ff0f-47cc-42f0-ba68-e597c7bf9d1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:21.008653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417ff0f-47cc-42f0-ba68-e597c7bf9d1c None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:21.034975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 268/531] 10.222.0.73 () {56 vars in 1139 bytes} [Fri May 13 14:50:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:21.036696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417ff0f-47cc-42f0-ba68-e597c7bf9d1c None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:21.136156 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdfb80-a82e-4174-912b-429af32a55dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:21.147038 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdfb80-a82e-4174-912b-429af32a55dd None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:21.148495 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdfb80-a82e-4174-912b-429af32a55dd None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:21.149489 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdfb80-a82e-4174-912b-429af32a55dd None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:21.151296 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcdfb80-a82e-4174-912b-429af32a55dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:21.152244 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcdfb80-a82e-4174-912b-429af32a55dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:21.154667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417ff0f-47cc-42f0-ba68-e597c7bf9d1c None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:21.155599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcdfb80-a82e-4174-912b-429af32a55dd None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:21.180320 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 264/532] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 557 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:21.189500 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdfb80-a82e-4174-912b-429af32a55dd None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:21.196658 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ff7d1-d559-4e40-87e3-fdee14b9e2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:21.197329 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ff7d1-d559-4e40-87e3-fdee14b9e2a6 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:21.197607 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ff7d1-d559-4e40-87e3-fdee14b9e2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:21.197880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ff7d1-d559-4e40-87e3-fdee14b9e2a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:21.309497 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ff7d1-d559-4e40-87e3-fdee14b9e2a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:21.312212 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ff7d1-d559-4e40-87e3-fdee14b9e2a6 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:21.463604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdfb80-a82e-4174-912b-429af32a55dd None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:21.538763 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26144a5-0762-4b8c-a4f4-ea71c556c5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:21.540115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26144a5-0762-4b8c-a4f4-ea71c556c5c4 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:21.540605 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26144a5-0762-4b8c-a4f4-ea71c556c5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:21.541081 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26144a5-0762-4b8c-a4f4-ea71c556c5c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:21.565581 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26144a5-0762-4b8c-a4f4-ea71c556c5c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:21.569941 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26144a5-0762-4b8c-a4f4-ea71c556c5c4 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:21.585245 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 269/533] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:50:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 14:50:21.594591 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ff7d1-d559-4e40-87e3-fdee14b9e2a6 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:21.617754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-e26144a5-0762-4b8c-a4f4-ea71c556c5c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:21.617754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:21.617754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:21.617754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:21.617754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:21.617754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:21.617754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:21.617754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:21.617754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:21.617754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:21.617754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:21.617754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:21.617754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:50:21.617754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:50:21.617754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:50:21.619427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:50:21.619427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:21.619427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:21.619427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:21.619427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:21.619427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:21.619427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:21.619427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:21.619427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:21.619427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:21.619427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:21.619427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:21.619427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:21.619427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:21.619427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:21.619427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:21.619427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:21.621792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:50:21.621792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:50:21.621792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:50:21.621792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:50:21.621792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:50:21.621792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:50:21.621792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:21.621792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:21.621792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 265/534] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:21.633424 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26144a5-0762-4b8c-a4f4-ea71c556c5c4 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:21.898852 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ff7d1-d559-4e40-87e3-fdee14b9e2a6 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:21.941745 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26144a5-0762-4b8c-a4f4-ea71c556c5c4 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:21.991659 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420ef04-ff67-4b14-9930-bca2e20af53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:21.992350 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420ef04-ff67-4b14-9930-bca2e20af53b None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:21.992635 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420ef04-ff67-4b14-9930-bca2e20af53b None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:21.992922 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420ef04-ff67-4b14-9930-bca2e20af53b None admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:21.993751 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420ef04-ff67-4b14-9930-bca2e20af53b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:21.994050 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420ef04-ff67-4b14-9930-bca2e20af53b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:21.995614 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420ef04-ff67-4b14-9930-bca2e20af53b None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:21.996925 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bc218-0b69-4e69-87c3-19004cb2d9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:21.998631 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bc218-0b69-4e69-87c3-19004cb2d9ec None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:21.999426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bc218-0b69-4e69-87c3-19004cb2d9ec None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:22.000144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bc218-0b69-4e69-87c3-19004cb2d9ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:22.019019 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 266/535] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:50:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:50:22.021384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60bc218-0b69-4e69-87c3-19004cb2d9ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:22.024547 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60bc218-0b69-4e69-87c3-19004cb2d9ec None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:22.028544 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420ef04-ff67-4b14-9930-bca2e20af53b None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:22.069550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-b60bc218-0b69-4e69-87c3-19004cb2d9ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:22.069550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:22.069550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:22.069550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:22.069550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:22.069550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:22.069550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:22.069550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:22.069550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:22.069550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:22.069550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:22.069550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:22.069550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:22.069550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:22.069550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:22.071514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:22.071514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:22.071514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:22.071514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:22.071514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:22.071514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:22.071514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:22.071514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:22.071514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:22.071514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:22.071514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:22.071514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:22.071514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:22.071514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:22.071514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:22.071514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:22.071514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:22.073487 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:22.073487 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:22.073487 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:22.073487 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:22.076783 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 270/536] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 483 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:22.085446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bc218-0b69-4e69-87c3-19004cb2d9ec None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:22.192602 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420ef04-ff67-4b14-9930-bca2e20af53b None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:22.254195 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0c47a-b5fd-4bd3-b9af-6340258ba7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:22.255655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0c47a-b5fd-4bd3-b9af-6340258ba7cf None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:22.256900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0c47a-b5fd-4bd3-b9af-6340258ba7cf None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:22.257560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0c47a-b5fd-4bd3-b9af-6340258ba7cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:22.259391 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c0c47a-b5fd-4bd3-b9af-6340258ba7cf None admin] RBAC: Adding query filter params (role.id=354a460a8146476989f8a7b4fc1aac93, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=343a23610db84b028ccc05e4f876a0c4) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:22.260176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c0c47a-b5fd-4bd3-b9af-6340258ba7cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:22.263008 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c0c47a-b5fd-4bd3-b9af-6340258ba7cf None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:22.273820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 267/537] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:50:22 2022] GET /identity/v3/role_assignments?user.id=343a23610db84b028ccc05e4f876a0c4&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=354a460a8146476989f8a7b4fc1aac93 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:50:22.333567 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bc218-0b69-4e69-87c3-19004cb2d9ec None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:22.400676 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed3eb5-94ea-4533-adf2-c3152560bfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:22.401705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed3eb5-94ea-4533-adf2-c3152560bfaa None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:22.402158 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed3eb5-94ea-4533-adf2-c3152560bfaa None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:22.402610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed3eb5-94ea-4533-adf2-c3152560bfaa None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:22.403989 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed3eb5-94ea-4533-adf2-c3152560bfaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:22.404493 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed3eb5-94ea-4533-adf2-c3152560bfaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:22.406693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed3eb5-94ea-4533-adf2-c3152560bfaa None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:22.428878 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 271/538] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:50:22.440563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0c47a-b5fd-4bd3-b9af-6340258ba7cf None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:22.613850 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0c47a-b5fd-4bd3-b9af-6340258ba7cf None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:22.656928 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a48395-32e8-4770-bf15-f5ed2dd5fe9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:22.658038 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a48395-32e8-4770-bf15-f5ed2dd5fe9f None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:22.658482 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a48395-32e8-4770-bf15-f5ed2dd5fe9f None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:22.658941 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a48395-32e8-4770-bf15-f5ed2dd5fe9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:22.667760 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a48395-32e8-4770-bf15-f5ed2dd5fe9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:22.669573 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a48395-32e8-4770-bf15-f5ed2dd5fe9f None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:22.686405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-a4a48395-32e8-4770-bf15-f5ed2dd5fe9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:22.686405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:22.686405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:22.686405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:22.686405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:22.686405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:22.686405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:22.686405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:22.686405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:22.686405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:22.686405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:22.686405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:22.686405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:50:22.686405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:50:22.686405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:50:22.687440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:50:22.687440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:22.687440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:22.687440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:22.687440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:22.687440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:22.687440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:22.687440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:22.687440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:22.687440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:22.687440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:22.687440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:22.687440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:22.687440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:22.687440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:22.687440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:22.687440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:22.688381 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:50:22.688381 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:50:22.688381 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:50:22.688381 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:50:22.688381 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:50:22.688381 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:50:22.688381 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:22.688381 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:22.690688 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 268/539] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:22.700597 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed3eb5-94ea-4533-adf2-c3152560bfaa None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:22.919398 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed3eb5-94ea-4533-adf2-c3152560bfaa None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:22.977645 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4985e6-f28d-4b7b-99cc-cdf2942df411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:22.978711 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4985e6-f28d-4b7b-99cc-cdf2942df411 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:22.979269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4985e6-f28d-4b7b-99cc-cdf2942df411 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:22.979743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4985e6-f28d-4b7b-99cc-cdf2942df411 None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:22.980765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4985e6-f28d-4b7b-99cc-cdf2942df411 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:22.981303 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4985e6-f28d-4b7b-99cc-cdf2942df411 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:22.983015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4985e6-f28d-4b7b-99cc-cdf2942df411 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:23.003615 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 272/540] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:50:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:23.013062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a48395-32e8-4770-bf15-f5ed2dd5fe9f None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:23.241766 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a48395-32e8-4770-bf15-f5ed2dd5fe9f None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:23.291230 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f254d0-0d92-42e8-9f46-033df9a1601e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:23.292311 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f254d0-0d92-42e8-9f46-033df9a1601e None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:23.292810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f254d0-0d92-42e8-9f46-033df9a1601e None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:23.293296 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f254d0-0d92-42e8-9f46-033df9a1601e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:23.294434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f254d0-0d92-42e8-9f46-033df9a1601e None admin] RBAC: Adding query filter params (role.id=354a460a8146476989f8a7b4fc1aac93, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=ee97a542470644f89cd665dfdf2f9e92) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:23.295025 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f254d0-0d92-42e8-9f46-033df9a1601e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:23.296728 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f254d0-0d92-42e8-9f46-033df9a1601e None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:23.304200 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 269/541] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:50:23 2022] GET /identity/v3/role_assignments?user.id=ee97a542470644f89cd665dfdf2f9e92&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=354a460a8146476989f8a7b4fc1aac93 => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:50:23.534219 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fba7a-9142-4aed-b9d1-ae1e5ced6a9c None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:23.535416 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fba7a-9142-4aed-b9d1-ae1e5ced6a9c None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:23.536193 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fba7a-9142-4aed-b9d1-ae1e5ced6a9c None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:23.539651 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 273/542] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:23.549070 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6646c-9f8a-493d-8c11-d6f17691d483 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:23.549997 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6646c-9f8a-493d-8c11-d6f17691d483 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:23.550778 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6646c-9f8a-493d-8c11-d6f17691d483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:23.586449 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-51d6646c-9f8a-493d-8c11-d6f17691d483 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:23.593470 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-51d6646c-9f8a-493d-8c11-d6f17691d483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:23.750647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 270/543] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:23.803227 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fba7a-9142-4aed-b9d1-ae1e5ced6a9c None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:24.067624 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fba7a-9142-4aed-b9d1-ae1e5ced6a9c None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:24.137137 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5cdb8-6d2d-4bd9-9620-c4d4f18ba036 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:24.137788 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5cdb8-6d2d-4bd9-9620-c4d4f18ba036 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:24.138273 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5cdb8-6d2d-4bd9-9620-c4d4f18ba036 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:24.140331 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 271/544] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:50:24.146483 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d4b9d-b320-4812-b388-5e59863b3332 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:24.147167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d4b9d-b320-4812-b388-5e59863b3332 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:24.147655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d4b9d-b320-4812-b388-5e59863b3332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:24.176811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902b0cd-49e5-4f9c-83a0-24a992628ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:24.178691 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902b0cd-49e5-4f9c-83a0-24a992628ab2 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:24.179201 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902b0cd-49e5-4f9c-83a0-24a992628ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:24.179662 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902b0cd-49e5-4f9c-83a0-24a992628ab2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:24.183101 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-1d2d4b9d-b320-4812-b388-5e59863b3332 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:24.185139 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-1d2d4b9d-b320-4812-b388-5e59863b3332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:24.209871 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902b0cd-49e5-4f9c-83a0-24a992628ab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:24.219098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-1902b0cd-49e5-4f9c-83a0-24a992628ab2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:24.219098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:24.219098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:24.219098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:24.219098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:24.219098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:24.219098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:24.219098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:24.219098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:24.219098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:24.219098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:24.219098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:24.219098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:24.219098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:24.219098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:24.219098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:24.220072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:24.220072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:24.220072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:24.220072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:24.220072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:24.220072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:24.220072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:24.220072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:24.220072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:24.220072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:24.220072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:24.220072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:24.220072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:24.220072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:24.220072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:24.220072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:24.220910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:24.220910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:24.220910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:24.220910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:24.220910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:24.220910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:24.220910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:24.220910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:24.220910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:24.220910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:24.220910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:24.220910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:24.224387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 274/545] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:50:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:24.234290 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902b0cd-49e5-4f9c-83a0-24a992628ab2 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:24.321472 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 272/546] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:50:24.345828 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d4b9d-b320-4812-b388-5e59863b3332 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:24.409637 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902b0cd-49e5-4f9c-83a0-24a992628ab2 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:24.473935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f2880-d6b3-46f2-9aee-210d1b68f289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:24.474692 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f2880-d6b3-46f2-9aee-210d1b68f289 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:24.475013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f2880-d6b3-46f2-9aee-210d1b68f289 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:24.475290 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f2880-d6b3-46f2-9aee-210d1b68f289 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:24.476061 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f2880-d6b3-46f2-9aee-210d1b68f289 None admin] RBAC: Adding query filter params (name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:24.476369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f2880-d6b3-46f2-9aee-210d1b68f289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:24.477797 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f2880-d6b3-46f2-9aee-210d1b68f289 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:24.499365 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 275/547] 10.222.0.73 () {56 vars in 1103 bytes} [Fri May 13 14:50:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:24.504113 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f2880-d6b3-46f2-9aee-210d1b68f289 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:24.591925 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d4b9d-b320-4812-b388-5e59863b3332 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:24.667181 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928154ad-35cb-4f5f-ad36-88d46b9bf127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:24.668216 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928154ad-35cb-4f5f-ad36-88d46b9bf127 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:24.668512 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928154ad-35cb-4f5f-ad36-88d46b9bf127 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:24.668794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928154ad-35cb-4f5f-ad36-88d46b9bf127 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:24.681556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928154ad-35cb-4f5f-ad36-88d46b9bf127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:24.695437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-928154ad-35cb-4f5f-ad36-88d46b9bf127 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:24.695437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:24.695437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:24.695437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:24.695437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:24.695437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:24.695437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:24.695437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:24.695437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:24.695437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:24.695437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:24.695437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:24.695437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:24.695437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:24.695437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:24.695437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:24.696419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:24.696419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:24.696419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:24.696419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:24.696419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:24.696419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:24.696419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:24.696419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:24.696419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:24.696419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:24.696419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:24.696419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:24.696419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:24.696419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:24.696419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:24.696419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:24.697214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:24.697214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:24.697214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:24.697214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:24.697214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:24.697214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:24.697214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:24.697214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:24.697214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:24.697214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:24.697214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:24.697214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:24.697214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 273/548] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:50:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:50:24.702878 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c40c35-5f83-4ee8-a0cc-35b96bcc008b None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:24.702878 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c40c35-5f83-4ee8-a0cc-35b96bcc008b None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:24.702878 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c40c35-5f83-4ee8-a0cc-35b96bcc008b None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:24.704981 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 274/549] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:24.705983 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c40c35-5f83-4ee8-a0cc-35b96bcc008b None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:24.745211 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f2880-d6b3-46f2-9aee-210d1b68f289 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:24.808769 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c3104-90d4-4add-a08d-226df2a87cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:24.809578 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c3104-90d4-4add-a08d-226df2a87cbf None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:24.809861 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c3104-90d4-4add-a08d-226df2a87cbf None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:24.810351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c3104-90d4-4add-a08d-226df2a87cbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:24.825726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c40c35-5f83-4ee8-a0cc-35b96bcc008b None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:24.835221 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c3104-90d4-4add-a08d-226df2a87cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:24.838627 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c3104-90d4-4add-a08d-226df2a87cbf None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:24.863283 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4db20-1260-4633-8f1f-5f9ce6440ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:24.863884 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4db20-1260-4633-8f1f-5f9ce6440ac9 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:24.864171 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4db20-1260-4633-8f1f-5f9ce6440ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:24.864535 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4db20-1260-4633-8f1f-5f9ce6440ac9 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:24.865854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4db20-1260-4633-8f1f-5f9ce6440ac9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:24.866168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4db20-1260-4633-8f1f-5f9ce6440ac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:24.867655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4db20-1260-4633-8f1f-5f9ce6440ac9 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:24.876114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-6a2c3104-90d4-4add-a08d-226df2a87cbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:24.876114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:24.876114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:24.876114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:24.876114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:24.876114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:24.876114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:24.876114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:24.876114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:24.876114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:24.876114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:24.876114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:24.876114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:24.876114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:24.876114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:24.878084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:24.878084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:24.878084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:24.878084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:24.878084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:24.878084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:24.878084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:24.878084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:24.878084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:24.878084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:24.878084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:24.878084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:24.878084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:24.878084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:24.878084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:24.878084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:24.878084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:24.880230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:24.880230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:24.880230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:24.880230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:24.890936 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 275/551] 10.222.0.73 () {56 vars in 1103 bytes} [Fri May 13 14:50:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:24.890936 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19d3ca-3326-4701-892d-07c98721e046 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:24.890936 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19d3ca-3326-4701-892d-07c98721e046 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:24.890936 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19d3ca-3326-4701-892d-07c98721e046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:24.891852 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 276/551] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:24.893627 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c3104-90d4-4add-a08d-226df2a87cbf None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:24.909026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-ea19d3ca-3326-4701-892d-07c98721e046 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:24.910438 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ea19d3ca-3326-4701-892d-07c98721e046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:24.992821 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 276/552] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:24.994288 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19d3ca-3326-4701-892d-07c98721e046 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:25.090511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c3104-90d4-4add-a08d-226df2a87cbf None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:25.155972 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4fe1f-3ab5-441b-aaf8-6d6b9c4db91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:25.157681 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4fe1f-3ab5-441b-aaf8-6d6b9c4db91b None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:25.158405 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4fe1f-3ab5-441b-aaf8-6d6b9c4db91b None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:25.159155 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4fe1f-3ab5-441b-aaf8-6d6b9c4db91b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:25.180958 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4fe1f-3ab5-441b-aaf8-6d6b9c4db91b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:25.183198 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19d3ca-3326-4701-892d-07c98721e046 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:25.184548 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4fe1f-3ab5-441b-aaf8-6d6b9c4db91b None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:25.219669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-c2e4fe1f-3ab5-441b-aaf8-6d6b9c4db91b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:25.219669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:25.219669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:25.219669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:25.219669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:25.219669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:25.219669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:25.219669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:25.219669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:25.219669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:25.219669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:25.219669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:25.219669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:25.219669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:25.219669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:25.221197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:25.221197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:25.221197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:25.221197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:25.221197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:25.221197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:25.221197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:25.221197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:25.221197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:25.221197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:25.221197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:25.221197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:25.221197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:25.221197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:25.221197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:25.221197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:25.221197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:25.222704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:25.222704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:25.222704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:25.222704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:25.226678 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 277/553] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:25.228681 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4fe1f-3ab5-441b-aaf8-6d6b9c4db91b None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:25.259918 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c03e2-3953-41db-844b-fdc11e4f59dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:25.261128 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c03e2-3953-41db-844b-fdc11e4f59dd None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:25.261603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c03e2-3953-41db-844b-fdc11e4f59dd None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:25.262039 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c03e2-3953-41db-844b-fdc11e4f59dd None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:25.263296 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c03e2-3953-41db-844b-fdc11e4f59dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:25.263787 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c03e2-3953-41db-844b-fdc11e4f59dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:25.266583 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c03e2-3953-41db-844b-fdc11e4f59dd None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:25.295677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 277/554] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:25.295677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c03e2-3953-41db-844b-fdc11e4f59dd None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:25.430964 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4fe1f-3ab5-441b-aaf8-6d6b9c4db91b None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:25.466603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c03e2-3953-41db-844b-fdc11e4f59dd None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:25.496683 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ec375-81d1-4f5a-858b-9b0bdf32cec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:25.498444 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ec375-81d1-4f5a-858b-9b0bdf32cec6 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:25.499209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ec375-81d1-4f5a-858b-9b0bdf32cec6 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:25.499969 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ec375-81d1-4f5a-858b-9b0bdf32cec6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:25.511763 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e929ed3-5d4d-4983-b79b-564e439f3e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:25.512667 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e929ed3-5d4d-4983-b79b-564e439f3e31 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:25.512953 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e929ed3-5d4d-4983-b79b-564e439f3e31 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:25.513229 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e929ed3-5d4d-4983-b79b-564e439f3e31 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:25.513986 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e929ed3-5d4d-4983-b79b-564e439f3e31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:25.514293 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e929ed3-5d4d-4983-b79b-564e439f3e31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:25.515904 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e929ed3-5d4d-4983-b79b-564e439f3e31 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:25.523480 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ec375-81d1-4f5a-858b-9b0bdf32cec6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:25.533665 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 278/555] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:25.534675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e929ed3-5d4d-4983-b79b-564e439f3e31 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:25.541341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-120ec375-81d1-4f5a-858b-9b0bdf32cec6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:25.541341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:25.541341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:25.541341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:25.541341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:25.541341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:25.541341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:25.541341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:25.541341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:25.541341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:25.541341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:25.541341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:25.541341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:25.541341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:25.541341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:25.541341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:25.542869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:25.542869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:25.542869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:25.542869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:25.542869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:25.542869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:25.542869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:25.542869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:25.542869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:25.542869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:25.542869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:25.542869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:25.542869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:25.542869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:25.542869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:25.542869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:25.544426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:25.544426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:25.544426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:25.544426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:25.544426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:25.544426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:25.544426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:25.544426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:25.544426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:25.544426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:25.544426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:25.544426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:25.548710 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 278/556] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:50:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:25.550699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ec375-81d1-4f5a-858b-9b0bdf32cec6 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:25.645051 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e929ed3-5d4d-4983-b79b-564e439f3e31 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:25.683788 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f2218-bc1d-4f42-b9be-70e575ef68ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:25.684614 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f2218-bc1d-4f42-b9be-70e575ef68ca None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:25.684897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f2218-bc1d-4f42-b9be-70e575ef68ca None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:25.685173 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f2218-bc1d-4f42-b9be-70e575ef68ca None admin] PATH_INFO: `/v3/users/swift` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:25.693914 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f2218-bc1d-4f42-b9be-70e575ef68ca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:25.695517 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f2218-bc1d-4f42-b9be-70e575ef68ca None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:25.711701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-3c8f2218-bc1d-4f42-b9be-70e575ef68ca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 14:50:25.711701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:25.711701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:25.711701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:25.711701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:25.711701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:25.711701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:25.711701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:25.711701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:25.711701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:25.711701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:25.711701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:25.711701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:50:25.711701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:50:25.711701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:50:25.711701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:50:25.713532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:25.713532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:25.713532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:50:25.713532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:25.713532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:50:25.713532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:25.713532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:25.713532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:25.713532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:25.713532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:25.713532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:25.713532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:25.713532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:25.713532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:25.713532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:25.713532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:25.713532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:25.713532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:25.715323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:25.715323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:25.715323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:50:25.715323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:50:25.715323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:50:25.715323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:50:25.715323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:50:25.715323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:50:25.715323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 14:50:25.715323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:25.717828 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 279/557] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:50:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:25.718784 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f2218-bc1d-4f42-b9be-70e575ef68ca None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:25.745105 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ec375-81d1-4f5a-858b-9b0bdf32cec6 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:25.805453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f5dc0-4b79-4d75-a99d-0300d50215c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:25.807344 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f5dc0-4b79-4d75-a99d-0300d50215c1 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:25.808097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f5dc0-4b79-4d75-a99d-0300d50215c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:25.808589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f5dc0-4b79-4d75-a99d-0300d50215c1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:25.824034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f5dc0-4b79-4d75-a99d-0300d50215c1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:25.826854 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f5dc0-4b79-4d75-a99d-0300d50215c1 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:25.855687 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f2218-bc1d-4f42-b9be-70e575ef68ca None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:25.856518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-147f5dc0-4b79-4d75-a99d-0300d50215c1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 14:50:25.856518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:25.856518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:25.856518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:25.856518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:25.856518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:25.856518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:25.856518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:25.856518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:25.856518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:25.856518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:25.856518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:25.856518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:50:25.856518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:50:25.856518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:50:25.856518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:50:25.858429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:25.858429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:25.858429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:50:25.858429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:25.858429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:50:25.858429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:25.858429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:25.858429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:25.858429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:25.858429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:25.858429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:25.858429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:25.858429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:25.858429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:25.858429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:25.858429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:25.858429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:25.858429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:25.860585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:25.860585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:25.860585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:50:25.860585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:50:25.860585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:50:25.860585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:50:25.860585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:50:25.860585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:50:25.860585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 14:50:25.860585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:25.860585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 279/558] 10.222.0.73 () {56 vars in 1093 bytes} [Fri May 13 14:50:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:25.861872 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f5dc0-4b79-4d75-a99d-0300d50215c1 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:25.927645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e10d8-f4a0-4e8b-8a45-fd26ca1e36bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:25.928531 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e10d8-f4a0-4e8b-8a45-fd26ca1e36bf None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:25.929024 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e10d8-f4a0-4e8b-8a45-fd26ca1e36bf None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:25.929503 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e10d8-f4a0-4e8b-8a45-fd26ca1e36bf None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:25.933098 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e10d8-f4a0-4e8b-8a45-fd26ca1e36bf None admin] RBAC: Adding query filter params (name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:25.933098 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e10d8-f4a0-4e8b-8a45-fd26ca1e36bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:25.934198 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e10d8-f4a0-4e8b-8a45-fd26ca1e36bf None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:25.952787 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 280/559] 10.222.0.73 () {56 vars in 1103 bytes} [Fri May 13 14:50:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:25.954791 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2418990-11cc-4194-b1d3-8ed64e624fea None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:25.957296 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2418990-11cc-4194-b1d3-8ed64e624fea None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:25.957296 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2418990-11cc-4194-b1d3-8ed64e624fea None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:25.963134 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 281/560] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:25.963134 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2418990-11cc-4194-b1d3-8ed64e624fea None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:26.046372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f5dc0-4b79-4d75-a99d-0300d50215c1 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:26.092614 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b046d20-a35c-4aec-8af4-2020e3fd5b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:26.093633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b046d20-a35c-4aec-8af4-2020e3fd5b5b None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:26.093633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b046d20-a35c-4aec-8af4-2020e3fd5b5b None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:26.093965 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b046d20-a35c-4aec-8af4-2020e3fd5b5b None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:26.094856 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b046d20-a35c-4aec-8af4-2020e3fd5b5b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:26.095152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b046d20-a35c-4aec-8af4-2020e3fd5b5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:26.096616 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b046d20-a35c-4aec-8af4-2020e3fd5b5b None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:26.117752 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 280/561] 10.222.0.73 () {56 vars in 1135 bytes} [Fri May 13 14:50:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:26.118633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b046d20-a35c-4aec-8af4-2020e3fd5b5b None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:26.148591 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2418990-11cc-4194-b1d3-8ed64e624fea None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:26.191456 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed469f5a-4500-4e31-a290-29c40a94434d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:26.192816 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed469f5a-4500-4e31-a290-29c40a94434d None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:26.193867 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed469f5a-4500-4e31-a290-29c40a94434d None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:26.194351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed469f5a-4500-4e31-a290-29c40a94434d None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:26.195529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed469f5a-4500-4e31-a290-29c40a94434d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:26.196167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed469f5a-4500-4e31-a290-29c40a94434d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:26.197892 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed469f5a-4500-4e31-a290-29c40a94434d None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:26.241090 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 282/562] 10.222.0.73 () {56 vars in 1133 bytes} [Fri May 13 14:50:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:26.242593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec860a-fe24-46c5-bec1-74dec1b83835 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:26.243002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec860a-fe24-46c5-bec1-74dec1b83835 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:26.243345 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec860a-fe24-46c5-bec1-74dec1b83835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:26.265805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-61ec860a-fe24-46c5-bec1-74dec1b83835 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:26.267604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-61ec860a-fe24-46c5-bec1-74dec1b83835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:26.316396 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b046d20-a35c-4aec-8af4-2020e3fd5b5b None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:26.342074 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 283/563] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:26.343536 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec860a-fe24-46c5-bec1-74dec1b83835 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:26.358373 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36cdff-b6c7-4832-ac98-c79a8673c4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:26.359307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36cdff-b6c7-4832-ac98-c79a8673c4b6 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:26.359687 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36cdff-b6c7-4832-ac98-c79a8673c4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:26.360309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36cdff-b6c7-4832-ac98-c79a8673c4b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:26.372552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36cdff-b6c7-4832-ac98-c79a8673c4b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:26.374020 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36cdff-b6c7-4832-ac98-c79a8673c4b6 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:26.395380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-de36cdff-b6c7-4832-ac98-c79a8673c4b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:26.395380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:26.395380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:26.395380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:26.395380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:26.395380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:26.395380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:26.395380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:26.395380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:26.395380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:26.395380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:26.395380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:26.395380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:26.395380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:26.395380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:26.397880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:26.397880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:26.397880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:26.397880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:26.397880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:26.397880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:26.397880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:26.397880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:26.397880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:26.397880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:26.397880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:26.397880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:26.397880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:26.397880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:26.397880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:26.397880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:26.397880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:26.399743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:26.399743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:26.399743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:26.399743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:26.399743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 281/564] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:26.400336 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db56412-47c4-4a53-af3a-f04808dfadca None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:26.400718 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db56412-47c4-4a53-af3a-f04808dfadca None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:26.401082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db56412-47c4-4a53-af3a-f04808dfadca None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:26.402856 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 282/565] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:26.404152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db56412-47c4-4a53-af3a-f04808dfadca None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:26.499785 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec860a-fe24-46c5-bec1-74dec1b83835 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:26.516235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db56412-47c4-4a53-af3a-f04808dfadca None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:26.546071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78577be-384c-434a-a3bc-83f600c39a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:26.547147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78577be-384c-434a-a3bc-83f600c39a47 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:26.547586 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78577be-384c-434a-a3bc-83f600c39a47 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:26.548029 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78577be-384c-434a-a3bc-83f600c39a47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:26.575148 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49cd31-c2e2-4156-ba5b-794b0ee5bd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:26.577300 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49cd31-c2e2-4156-ba5b-794b0ee5bd61 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:26.577673 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49cd31-c2e2-4156-ba5b-794b0ee5bd61 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:26.578003 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49cd31-c2e2-4156-ba5b-794b0ee5bd61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:26.590227 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49cd31-c2e2-4156-ba5b-794b0ee5bd61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:26.591741 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49cd31-c2e2-4156-ba5b-794b0ee5bd61 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:26.618129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-3a49cd31-c2e2-4156-ba5b-794b0ee5bd61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:26.618129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:26.618129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:26.618129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:26.618129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:26.618129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:26.618129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:26.618129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:26.618129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:26.618129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:26.618129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:26.618129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:26.618129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:26.618129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:26.618129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:26.619728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:26.619728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:26.619728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:26.619728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:26.619728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:26.619728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:26.619728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:26.619728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:26.619728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:26.619728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:26.619728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:26.619728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:26.619728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:26.619728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:26.619728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:26.619728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:26.619728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:26.621314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:26.621314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:26.621314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:26.621314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:26.621314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 283/566] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:26.621314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49cd31-c2e2-4156-ba5b-794b0ee5bd61 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:26.638239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78577be-384c-434a-a3bc-83f600c39a47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:26.639785 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78577be-384c-434a-a3bc-83f600c39a47 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:26.744278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 284/567] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:50:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:50:26.745365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78577be-384c-434a-a3bc-83f600c39a47 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:26.798292 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49cd31-c2e2-4156-ba5b-794b0ee5bd61 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:26.851822 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2a0ef-1dd1-47b6-877e-4e44f5dd750a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:26.853179 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2a0ef-1dd1-47b6-877e-4e44f5dd750a None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:26.853672 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2a0ef-1dd1-47b6-877e-4e44f5dd750a None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:26.854165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2a0ef-1dd1-47b6-877e-4e44f5dd750a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:26.854805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78577be-384c-434a-a3bc-83f600c39a47 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:26.873093 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2a0ef-1dd1-47b6-877e-4e44f5dd750a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:26.889079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-cce2a0ef-1dd1-47b6-877e-4e44f5dd750a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:26.889079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:26.889079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:26.889079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:26.889079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:26.889079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:26.889079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:26.889079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:26.889079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:26.889079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:26.889079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:26.889079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:26.889079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:26.889079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:26.889079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:26.889079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:26.890304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:26.890304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:26.890304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:26.890304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:26.890304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:26.890304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:26.890304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:26.890304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:26.890304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:26.890304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:26.890304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:26.890304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:26.890304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:26.890304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:26.890304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:26.890304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:26.891282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:26.891282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:26.891282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:26.891282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:26.891282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:26.891282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:26.891282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:26.891282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:26.891282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:26.891282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:26.891282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:26.891282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:26.892464 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2839b3a-c9be-4f2d-85b6-c4162b6f61eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:26.893147 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 284/568] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:50:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:26.893300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2839b3a-c9be-4f2d-85b6-c4162b6f61eb None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:26.893300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2839b3a-c9be-4f2d-85b6-c4162b6f61eb None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:26.893300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2839b3a-c9be-4f2d-85b6-c4162b6f61eb None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:26.893300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2839b3a-c9be-4f2d-85b6-c4162b6f61eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:26.893752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2839b3a-c9be-4f2d-85b6-c4162b6f61eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:26.893898 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca9db0-7c5a-4bf9-8c7a-e7a6287c8637 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:26.895033 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca9db0-7c5a-4bf9-8c7a-e7a6287c8637 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:26.895033 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca9db0-7c5a-4bf9-8c7a-e7a6287c8637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:26.895514 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2839b3a-c9be-4f2d-85b6-c4162b6f61eb None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:26.914156 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 285/569] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:26.916078 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2839b3a-c9be-4f2d-85b6-c4162b6f61eb None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:26.916253 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-46ca9db0-7c5a-4bf9-8c7a-e7a6287c8637 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:26.917746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-46ca9db0-7c5a-4bf9-8c7a-e7a6287c8637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:27.022849 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 285/570] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:27.022849 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca9db0-7c5a-4bf9-8c7a-e7a6287c8637 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:27.059310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2839b3a-c9be-4f2d-85b6-c4162b6f61eb None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:27.100444 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f41bd9-6bce-4cb9-bb66-0eecac5e16a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:27.101127 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f41bd9-6bce-4cb9-bb66-0eecac5e16a0 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:27.101408 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f41bd9-6bce-4cb9-bb66-0eecac5e16a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:27.101687 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f41bd9-6bce-4cb9-bb66-0eecac5e16a0 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:27.102431 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f41bd9-6bce-4cb9-bb66-0eecac5e16a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:27.102737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f41bd9-6bce-4cb9-bb66-0eecac5e16a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:27.104192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f41bd9-6bce-4cb9-bb66-0eecac5e16a0 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:27.117728 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 286/571] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:27.118608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f41bd9-6bce-4cb9-bb66-0eecac5e16a0 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:27.165025 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca9db0-7c5a-4bf9-8c7a-e7a6287c8637 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:27.201248 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d853e5-9119-4d7a-a0e2-92601f043527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:27.202064 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d853e5-9119-4d7a-a0e2-92601f043527 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:27.202344 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d853e5-9119-4d7a-a0e2-92601f043527 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:27.202617 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d853e5-9119-4d7a-a0e2-92601f043527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:27.214290 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d853e5-9119-4d7a-a0e2-92601f043527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:27.215795 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d853e5-9119-4d7a-a0e2-92601f043527 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:27.242145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-58d853e5-9119-4d7a-a0e2-92601f043527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:27.242145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:27.242145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:27.242145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:27.242145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:27.242145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:27.242145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:27.242145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:27.242145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:27.242145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:27.242145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:27.242145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:27.242145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:27.242145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:27.242145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:27.243809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:27.243809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:27.243809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:27.243809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:27.243809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:27.243809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:27.243809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:27.243809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:27.243809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:27.243809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:27.243809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:27.243809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:27.243809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:27.243809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:27.243809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:27.243809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:27.243809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:27.246096 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:27.246096 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:27.246096 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:27.246096 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:27.246096 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 286/572] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:27.246096 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d853e5-9119-4d7a-a0e2-92601f043527 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:27.262923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f41bd9-6bce-4cb9-bb66-0eecac5e16a0 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:27.315118 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e56ed-8080-4fee-8393-a59ac0d12dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:27.315837 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e56ed-8080-4fee-8393-a59ac0d12dcc None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:27.316261 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e56ed-8080-4fee-8393-a59ac0d12dcc None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:27.316648 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e56ed-8080-4fee-8393-a59ac0d12dcc None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:27.317782 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e56ed-8080-4fee-8393-a59ac0d12dcc None admin] RBAC: Adding query filter params (name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:27.318252 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e56ed-8080-4fee-8393-a59ac0d12dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:27.319818 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e56ed-8080-4fee-8393-a59ac0d12dcc None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:27.329996 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 287/573] 10.222.0.73 () {56 vars in 1103 bytes} [Fri May 13 14:50:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:27.330793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e56ed-8080-4fee-8393-a59ac0d12dcc None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:27.382535 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d853e5-9119-4d7a-a0e2-92601f043527 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:27.423771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9da11-7a5a-4a66-8c18-7da5b925dad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:27.424808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9da11-7a5a-4a66-8c18-7da5b925dad7 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:27.425159 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9da11-7a5a-4a66-8c18-7da5b925dad7 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:27.425543 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9da11-7a5a-4a66-8c18-7da5b925dad7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:27.435633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9da11-7a5a-4a66-8c18-7da5b925dad7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:27.437708 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9da11-7a5a-4a66-8c18-7da5b925dad7 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:27.450075 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e56ed-8080-4fee-8393-a59ac0d12dcc None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:27.459369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-ecb9da11-7a5a-4a66-8c18-7da5b925dad7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 13 14:50:27.459369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:27.459369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:27.459369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:27.459369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:27.459369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:27.459369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:27.459369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:27.459369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:27.459369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:27.459369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:27.459369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:27.459369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:50:27.459369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:50:27.459369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:50:27.459369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:50:27.469520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:27.469520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:27.469520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:50:27.469520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:27.469520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:50:27.469520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:27.469520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:27.469520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:27.469520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:27.469520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:27.469520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:27.469520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:27.469520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:27.469520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:27.469520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:27.469520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:27.469520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:27.469520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:27.472037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:27.472037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:27.472037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:50:27.472037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:50:27.472037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:50:27.472037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:50:27.472037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:50:27.472037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:50:27.472037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 13 14:50:27.472037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:27.472037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 287/574] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:50:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:27.472037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9da11-7a5a-4a66-8c18-7da5b925dad7 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:27.492524 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d1536-982a-4338-b3f1-f2d9efee5e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:27.493366 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d1536-982a-4338-b3f1-f2d9efee5e7c None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:27.493646 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d1536-982a-4338-b3f1-f2d9efee5e7c None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:27.493930 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d1536-982a-4338-b3f1-f2d9efee5e7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:27.506989 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d1536-982a-4338-b3f1-f2d9efee5e7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:27.515271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-b49d1536-982a-4338-b3f1-f2d9efee5e7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:27.515271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:27.515271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:27.515271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:27.515271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:27.515271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:27.515271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:27.515271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:27.515271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:27.515271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:27.515271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:27.515271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:27.515271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:27.515271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:27.515271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:27.515271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:27.517282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:27.517282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:27.517282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:27.517282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:27.517282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:27.517282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:27.517282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:27.517282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:27.517282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:27.517282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:27.517282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:27.517282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:27.517282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:27.517282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:27.517282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:27.517282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:27.519220 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:27.519220 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:27.519220 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:27.519220 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:27.519220 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:27.519220 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:27.519220 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:27.519220 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:27.519220 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:27.519220 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:27.519220 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:27.519220 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:27.519220 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 288/575] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:50:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:27.519220 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d1536-982a-4338-b3f1-f2d9efee5e7c None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:27.622708 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9da11-7a5a-4a66-8c18-7da5b925dad7 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:27.629815 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d1536-982a-4338-b3f1-f2d9efee5e7c None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:27.667980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836614c7-1c2e-4220-b911-1c59979c62f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:27.668660 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836614c7-1c2e-4220-b911-1c59979c62f4 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:27.668942 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836614c7-1c2e-4220-b911-1c59979c62f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:27.669218 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836614c7-1c2e-4220-b911-1c59979c62f4 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:27.669960 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836614c7-1c2e-4220-b911-1c59979c62f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:27.670266 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836614c7-1c2e-4220-b911-1c59979c62f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:27.671698 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836614c7-1c2e-4220-b911-1c59979c62f4 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:27.682170 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e846d-55ac-47c1-9e72-b0fd2ffb48c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:27.683573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e846d-55ac-47c1-9e72-b0fd2ffb48c6 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:27.684065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e846d-55ac-47c1-9e72-b0fd2ffb48c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:27.684589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e846d-55ac-47c1-9e72-b0fd2ffb48c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:27.685011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 289/576] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:27.685882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836614c7-1c2e-4220-b911-1c59979c62f4 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:27.695417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e846d-55ac-47c1-9e72-b0fd2ffb48c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:27.696923 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e846d-55ac-47c1-9e72-b0fd2ffb48c6 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:27.712270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-3e8e846d-55ac-47c1-9e72-b0fd2ffb48c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:27.712270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:27.712270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:27.712270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:27.712270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:27.712270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:27.712270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:27.712270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:27.712270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:27.712270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:27.712270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:27.712270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:27.712270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:50:27.712270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:50:27.712270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:50:27.714178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:50:27.714178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:27.714178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:27.714178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:27.714178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:27.714178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:27.714178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:27.714178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:27.714178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:27.714178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:27.714178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:27.714178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:27.714178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:27.714178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:27.714178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:27.714178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:27.714178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:27.715690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:50:27.715690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:50:27.715690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:50:27.715690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:50:27.715690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:50:27.715690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:50:27.715690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:27.715690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:27.715690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 288/577] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:27.715690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e846d-55ac-47c1-9e72-b0fd2ffb48c6 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:27.824130 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836614c7-1c2e-4220-b911-1c59979c62f4 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:27.848057 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e846d-55ac-47c1-9e72-b0fd2ffb48c6 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:27.878865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea5ee6-5bb5-40d9-962b-2bba82fedc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:27.880047 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea5ee6-5bb5-40d9-962b-2bba82fedc1d None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:27.880509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea5ee6-5bb5-40d9-962b-2bba82fedc1d None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:27.881020 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea5ee6-5bb5-40d9-962b-2bba82fedc1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:27.896001 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea5ee6-5bb5-40d9-962b-2bba82fedc1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:27.898299 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea5ee6-5bb5-40d9-962b-2bba82fedc1d None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:27.898721 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65330953-298b-475b-8d63-15318bbc2fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:27.899587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65330953-298b-475b-8d63-15318bbc2fd0 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:27.900002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65330953-298b-475b-8d63-15318bbc2fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:27.900392 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65330953-298b-475b-8d63-15318bbc2fd0 None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:27.901378 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65330953-298b-475b-8d63-15318bbc2fd0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:27.901805 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65330953-298b-475b-8d63-15318bbc2fd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:27.903460 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65330953-298b-475b-8d63-15318bbc2fd0 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:27.918186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-13ea5ee6-5bb5-40d9-962b-2bba82fedc1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:27.918186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:27.918186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:27.918186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:27.918186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:27.918186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:27.918186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:27.918186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:27.918186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:27.918186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:27.918186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:27.918186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:27.918186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:27.918186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:27.918186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:27.919976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:27.919976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:27.919976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:27.919976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:27.919976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:27.919976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:27.919976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:27.919976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:27.919976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:27.919976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:27.919976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:27.919976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:27.919976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:27.919976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:27.919976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:27.919976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:27.919976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:27.921695 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:27.921695 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:27.921695 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:27.921695 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:27.921695 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 290/578] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:27.922347 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea5ee6-5bb5-40d9-962b-2bba82fedc1d None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:27.940803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 289/579] 10.222.0.73 () {56 vars in 1137 bytes} [Fri May 13 14:50:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:27.940803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65330953-298b-475b-8d63-15318bbc2fd0 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:28.041115 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65330953-298b-475b-8d63-15318bbc2fd0 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:28.076789 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d7d56-543a-4260-b883-09abff4cf99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:28.077612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d7d56-543a-4260-b883-09abff4cf99f None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:28.077898 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d7d56-543a-4260-b883-09abff4cf99f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:28.078175 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d7d56-543a-4260-b883-09abff4cf99f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:28.087134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d7d56-543a-4260-b883-09abff4cf99f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:28.088734 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d7d56-543a-4260-b883-09abff4cf99f None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:28.092206 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea5ee6-5bb5-40d9-962b-2bba82fedc1d None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:28.103384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-c89d7d56-543a-4260-b883-09abff4cf99f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:28.103384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:28.103384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:28.103384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:28.103384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:28.103384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:28.103384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:28.103384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:28.103384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:28.103384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:28.103384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:28.103384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:28.103384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:50:28.103384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:50:28.103384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:50:28.104443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:50:28.104443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:28.104443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:28.104443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:28.104443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:28.104443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:28.104443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:28.104443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:28.104443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:28.104443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:28.104443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:28.104443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:28.104443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:28.104443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:28.104443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:28.104443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:28.104443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:28.106067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:50:28.106067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:50:28.106067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:50:28.106067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:50:28.106067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:50:28.106067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:50:28.106067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:28.106067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:28.106067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 290/580] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:28.106067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d7d56-543a-4260-b883-09abff4cf99f None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:28.152537 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a163e-3068-4e81-a7c3-18b8b5f04891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:28.153617 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a163e-3068-4e81-a7c3-18b8b5f04891 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:28.154110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a163e-3068-4e81-a7c3-18b8b5f04891 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:28.154602 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a163e-3068-4e81-a7c3-18b8b5f04891 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:28.156066 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a163e-3068-4e81-a7c3-18b8b5f04891 None admin] RBAC: Adding query filter params (name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:28.156602 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a163e-3068-4e81-a7c3-18b8b5f04891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:28.159285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a163e-3068-4e81-a7c3-18b8b5f04891 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:28.174745 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 291/581] 10.222.0.73 () {56 vars in 1103 bytes} [Fri May 13 14:50:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:28.176361 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a163e-3068-4e81-a7c3-18b8b5f04891 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:28.222326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d7d56-543a-4260-b883-09abff4cf99f None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:28.258497 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004656f4-044e-4429-9969-edf08bb2352f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:28.259350 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004656f4-044e-4429-9969-edf08bb2352f None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:28.259722 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004656f4-044e-4429-9969-edf08bb2352f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:28.260101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004656f4-044e-4429-9969-edf08bb2352f None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:28.261053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004656f4-044e-4429-9969-edf08bb2352f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:28.261462 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004656f4-044e-4429-9969-edf08bb2352f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:28.263069 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004656f4-044e-4429-9969-edf08bb2352f None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:28.275977 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 291/582] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:50:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:28.276849 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004656f4-044e-4429-9969-edf08bb2352f None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:28.345226 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a163e-3068-4e81-a7c3-18b8b5f04891 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:28.398636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93432d7-8275-4971-9d4d-97b77ee5e53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:28.399458 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93432d7-8275-4971-9d4d-97b77ee5e53c None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:28.399887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93432d7-8275-4971-9d4d-97b77ee5e53c None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:28.400292 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93432d7-8275-4971-9d4d-97b77ee5e53c None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:28.401168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93432d7-8275-4971-9d4d-97b77ee5e53c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:28.401622 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93432d7-8275-4971-9d4d-97b77ee5e53c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:28.403246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93432d7-8275-4971-9d4d-97b77ee5e53c None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:28.421875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 292/583] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:28.423213 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93432d7-8275-4971-9d4d-97b77ee5e53c None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:28.430535 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004656f4-044e-4429-9969-edf08bb2352f None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:28.485344 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063363d-1c72-461f-9c20-7a1967e83000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:28.486600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063363d-1c72-461f-9c20-7a1967e83000 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:28.487092 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063363d-1c72-461f-9c20-7a1967e83000 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:28.487545 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063363d-1c72-461f-9c20-7a1967e83000 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:28.499862 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063363d-1c72-461f-9c20-7a1967e83000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:28.501544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063363d-1c72-461f-9c20-7a1967e83000 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:28.521866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-3063363d-1c72-461f-9c20-7a1967e83000 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:28.521866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:28.521866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:28.521866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:28.521866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:28.521866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:28.521866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:28.521866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:28.521866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:28.521866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:28.521866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:28.521866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:28.521866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:28.521866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:28.521866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:28.523837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:28.523837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:28.523837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:28.523837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:28.523837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:28.523837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:28.523837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:28.523837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:28.523837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:28.523837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:28.523837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:28.523837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:28.523837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:28.523837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:28.523837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:28.523837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:28.523837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:28.525763 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:28.525763 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:28.525763 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:28.525763 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:28.525763 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 292/584] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:28.525763 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063363d-1c72-461f-9c20-7a1967e83000 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:28.560740 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93432d7-8275-4971-9d4d-97b77ee5e53c None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:28.606012 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2070abe-6ac7-46a8-b2ec-0d7bfa18678a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:28.606970 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2070abe-6ac7-46a8-b2ec-0d7bfa18678a None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:28.607342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2070abe-6ac7-46a8-b2ec-0d7bfa18678a None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:28.607729 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2070abe-6ac7-46a8-b2ec-0d7bfa18678a None admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:28.608672 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2070abe-6ac7-46a8-b2ec-0d7bfa18678a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:28.609094 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2070abe-6ac7-46a8-b2ec-0d7bfa18678a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:28.611698 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2070abe-6ac7-46a8-b2ec-0d7bfa18678a None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:28.632497 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 293/585] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:50:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:28.633878 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2070abe-6ac7-46a8-b2ec-0d7bfa18678a None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:28.665812 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063363d-1c72-461f-9c20-7a1967e83000 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:28.706769 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a941ca-0844-445a-99f6-ee1d6a063700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:28.708011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a941ca-0844-445a-99f6-ee1d6a063700 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:28.708509 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a941ca-0844-445a-99f6-ee1d6a063700 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:28.708896 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a941ca-0844-445a-99f6-ee1d6a063700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:28.725805 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a941ca-0844-445a-99f6-ee1d6a063700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:28.728442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a941ca-0844-445a-99f6-ee1d6a063700 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:28.758784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-c3a941ca-0844-445a-99f6-ee1d6a063700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:28.758784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:28.758784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:28.758784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:28.758784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:28.758784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:28.758784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:28.758784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:28.758784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:28.758784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:28.758784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:28.758784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:28.758784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:28.758784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:28.758784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:28.760696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:28.760696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:28.760696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:28.760696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:28.760696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:28.760696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:28.760696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:28.760696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:28.760696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:28.760696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:28.760696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:28.760696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:28.760696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:28.760696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:28.760696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:28.760696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:28.760696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:28.762574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:28.762574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:28.762574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:28.762574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:28.768736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 293/586] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:28.768736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a941ca-0844-445a-99f6-ee1d6a063700 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:28.770991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2070abe-6ac7-46a8-b2ec-0d7bfa18678a None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:28.810664 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7509a-9eb7-476f-b923-ab09d70e2dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:28.811872 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7509a-9eb7-476f-b923-ab09d70e2dce None admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:28.812192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7509a-9eb7-476f-b923-ab09d70e2dce None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:28.812473 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7509a-9eb7-476f-b923-ab09d70e2dce None admin] PATH_INFO: `/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/52d539202cfb40a48b231713e16a599a/roles/354a460a8146476989f8a7b4fc1aac93` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:28.839605 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7509a-9eb7-476f-b923-ab09d70e2dce None admin] RBAC: Authorizing `identity:create_grant(project_id=48788e7517a14ca5b5af9f161512ac9c, user_id=52d539202cfb40a48b231713e16a599a, role_id=354a460a8146476989f8a7b4fc1aac93)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:28.841216 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7509a-9eb7-476f-b923-ab09d70e2dce None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:28.860245 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 294/587] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:50:28 2022] PUT /identity/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/52d539202cfb40a48b231713e16a599a/roles/354a460a8146476989f8a7b4fc1aac93 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:50:28.861571 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7509a-9eb7-476f-b923-ab09d70e2dce None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:28.899317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a941ca-0844-445a-99f6-ee1d6a063700 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:28.950586 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c532b-f5f7-4a61-ada6-2065e61e945e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:28.952194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c532b-f5f7-4a61-ada6-2065e61e945e None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:28.952510 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c532b-f5f7-4a61-ada6-2065e61e945e None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:28.952909 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c532b-f5f7-4a61-ada6-2065e61e945e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:28.968912 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c532b-f5f7-4a61-ada6-2065e61e945e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:28.972273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c532b-f5f7-4a61-ada6-2065e61e945e None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:29.004368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-586c532b-f5f7-4a61-ada6-2065e61e945e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 13 14:50:29.004368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:29.004368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:29.004368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:29.004368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:29.004368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:29.004368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:29.004368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:29.004368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:29.004368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:29.004368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:29.004368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:29.004368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:50:29.004368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:50:29.004368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:50:29.004368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:50:29.006307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:29.006307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:29.006307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:50:29.006307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:29.006307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:50:29.006307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:29.006307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:29.006307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:29.006307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:29.006307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:29.006307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:29.006307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:29.006307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:29.006307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:29.006307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:29.006307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:29.006307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:29.006307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:29.008335 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:29.008335 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:29.008335 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:50:29.008335 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:50:29.008335 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:50:29.008335 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:50:29.008335 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:50:29.008335 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:50:29.008335 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 13 14:50:29.008335 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:29.013349 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 294/588] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:50:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:29.013349 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c532b-f5f7-4a61-ada6-2065e61e945e None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:29.031933 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7509a-9eb7-476f-b923-ab09d70e2dce None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:29.076919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4993c27-1936-4c7b-97f9-09d416e6d3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:29.077607 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4993c27-1936-4c7b-97f9-09d416e6d3f6 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:29.077883 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4993c27-1936-4c7b-97f9-09d416e6d3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:29.078171 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4993c27-1936-4c7b-97f9-09d416e6d3f6 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:29.078938 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4993c27-1936-4c7b-97f9-09d416e6d3f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:29.079250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4993c27-1936-4c7b-97f9-09d416e6d3f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:29.080699 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4993c27-1936-4c7b-97f9-09d416e6d3f6 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:29.100059 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 295/589] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:29.101418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4993c27-1936-4c7b-97f9-09d416e6d3f6 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:29.158961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c532b-f5f7-4a61-ada6-2065e61e945e None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:29.207208 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abbe86-4e35-4860-972c-ff2e40fd6c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:29.207809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abbe86-4e35-4860-972c-ff2e40fd6c6a None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:29.208095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abbe86-4e35-4860-972c-ff2e40fd6c6a None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:29.208374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abbe86-4e35-4860-972c-ff2e40fd6c6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:29.209285 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abbe86-4e35-4860-972c-ff2e40fd6c6a None admin] RBAC: Adding query filter params (role.id=354a460a8146476989f8a7b4fc1aac93, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=27265a0c2e6b47c09f28b9cd3ac47d28) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:29.209592 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abbe86-4e35-4860-972c-ff2e40fd6c6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:29.211118 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abbe86-4e35-4860-972c-ff2e40fd6c6a None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:29.222908 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 295/590] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:50:29 2022] GET /identity/v3/role_assignments?user.id=27265a0c2e6b47c09f28b9cd3ac47d28&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=354a460a8146476989f8a7b4fc1aac93 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:29.222908 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abbe86-4e35-4860-972c-ff2e40fd6c6a None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:29.231986 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4993c27-1936-4c7b-97f9-09d416e6d3f6 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:29.301181 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032746f-0924-48a5-be64-6949f2faa8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:29.302798 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032746f-0924-48a5-be64-6949f2faa8d9 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:29.303329 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032746f-0924-48a5-be64-6949f2faa8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:29.303743 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032746f-0924-48a5-be64-6949f2faa8d9 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:29.305084 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032746f-0924-48a5-be64-6949f2faa8d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:29.305647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032746f-0924-48a5-be64-6949f2faa8d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:29.308399 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032746f-0924-48a5-be64-6949f2faa8d9 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:29.334367 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 296/591] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:29.335965 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032746f-0924-48a5-be64-6949f2faa8d9 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:29.358272 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abbe86-4e35-4860-972c-ff2e40fd6c6a None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:29.398948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084bd4f-9c01-40da-bf75-e99a0503b7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:29.400059 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084bd4f-9c01-40da-bf75-e99a0503b7bf None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:29.400551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084bd4f-9c01-40da-bf75-e99a0503b7bf None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:29.401059 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084bd4f-9c01-40da-bf75-e99a0503b7bf None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:29.402142 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084bd4f-9c01-40da-bf75-e99a0503b7bf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:29.402702 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084bd4f-9c01-40da-bf75-e99a0503b7bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:29.404462 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084bd4f-9c01-40da-bf75-e99a0503b7bf None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:29.425504 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 296/592] 10.222.0.73 () {56 vars in 1137 bytes} [Fri May 13 14:50:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:29.426732 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084bd4f-9c01-40da-bf75-e99a0503b7bf None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:29.550977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032746f-0924-48a5-be64-6949f2faa8d9 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:29.561141 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084bd4f-9c01-40da-bf75-e99a0503b7bf None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:29.600853 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29252661-08d7-47ef-94d3-5e4b3e53ec5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:29.601728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29252661-08d7-47ef-94d3-5e4b3e53ec5f None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:29.602228 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29252661-08d7-47ef-94d3-5e4b3e53ec5f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:29.602513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29252661-08d7-47ef-94d3-5e4b3e53ec5f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:29.611100 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29252661-08d7-47ef-94d3-5e4b3e53ec5f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:29.612864 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29252661-08d7-47ef-94d3-5e4b3e53ec5f None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:29.616348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56095f2-f86a-42b4-bbf4-9fc32a885b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:29.617873 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56095f2-f86a-42b4-bbf4-9fc32a885b68 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:29.618494 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56095f2-f86a-42b4-bbf4-9fc32a885b68 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:29.619121 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56095f2-f86a-42b4-bbf4-9fc32a885b68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:29.630109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-29252661-08d7-47ef-94d3-5e4b3e53ec5f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 13 14:50:29.630109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:29.630109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:29.630109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:29.630109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:29.630109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:29.630109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:29.630109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:29.630109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:29.630109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:29.630109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:29.630109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:29.630109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:50:29.630109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:50:29.630109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:50:29.630109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:50:29.632361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:29.632361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:29.632361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:50:29.632361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:29.632361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:50:29.632361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:29.632361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:29.632361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:29.632361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:29.632361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:29.632361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:29.632361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:29.632361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:29.632361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:29.632361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:29.632361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:29.632361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:29.632361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:29.634510 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:29.634510 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:29.634510 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:50:29.634510 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:50:29.634510 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:50:29.634510 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:50:29.634510 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:50:29.634510 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:50:29.634510 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 13 14:50:29.634510 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:29.634510 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 297/593] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:50:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:29.634510 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29252661-08d7-47ef-94d3-5e4b3e53ec5f None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:29.645328 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56095f2-f86a-42b4-bbf4-9fc32a885b68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:29.645328 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56095f2-f86a-42b4-bbf4-9fc32a885b68 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:29.660268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-f56095f2-f86a-42b4-bbf4-9fc32a885b68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:29.660268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:29.660268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:29.660268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:29.660268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:29.660268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:29.660268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:29.660268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:29.660268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:29.660268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:29.660268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:29.660268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:29.660268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:50:29.660268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:50:29.660268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:50:29.662427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:50:29.662427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:29.662427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:29.662427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:29.662427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:29.662427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:29.662427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:29.662427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:29.662427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:29.662427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:29.662427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:29.662427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:29.662427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:29.662427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:29.662427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:29.662427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:29.662427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:29.665950 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:50:29.665950 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:50:29.665950 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:50:29.665950 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:50:29.665950 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:50:29.665950 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:50:29.665950 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:29.665950 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:29.667742 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 297/594] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:29.667742 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56095f2-f86a-42b4-bbf4-9fc32a885b68 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:29.785982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56095f2-f86a-42b4-bbf4-9fc32a885b68 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:29.824446 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825be2d3-887e-4cc3-8641-52cd92112fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:29.825076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825be2d3-887e-4cc3-8641-52cd92112fde None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:29.825380 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825be2d3-887e-4cc3-8641-52cd92112fde None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:29.825660 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825be2d3-887e-4cc3-8641-52cd92112fde None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:29.826485 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825be2d3-887e-4cc3-8641-52cd92112fde None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:29.826784 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825be2d3-887e-4cc3-8641-52cd92112fde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:29.828478 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825be2d3-887e-4cc3-8641-52cd92112fde None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:29.828781 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29252661-08d7-47ef-94d3-5e4b3e53ec5f None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:29.848579 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 298/595] 10.222.0.73 () {56 vars in 1139 bytes} [Fri May 13 14:50:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:29.850003 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825be2d3-887e-4cc3-8641-52cd92112fde None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:29.898657 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210185a-9802-43db-acaa-5517f3cffe86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:29.900156 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210185a-9802-43db-acaa-5517f3cffe86 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:29.900635 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210185a-9802-43db-acaa-5517f3cffe86 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:29.901131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210185a-9802-43db-acaa-5517f3cffe86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:29.930689 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210185a-9802-43db-acaa-5517f3cffe86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:29.934001 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210185a-9802-43db-acaa-5517f3cffe86 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:29.964970 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825be2d3-887e-4cc3-8641-52cd92112fde None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:29.969551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-6210185a-9802-43db-acaa-5517f3cffe86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:29.969551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:29.969551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:29.969551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:29.969551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:29.969551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:29.969551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:29.969551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:29.969551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:29.969551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:29.969551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:29.969551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:29.969551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:29.969551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:29.969551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:29.971437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:29.971437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:29.971437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:29.971437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:29.971437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:29.971437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:29.971437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:29.971437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:29.971437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:29.971437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:29.971437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:29.971437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:29.971437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:29.971437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:29.971437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:29.971437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:29.971437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:29.973109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:29.973109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:29.973109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:29.973109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:29.976919 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 298/596] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:29.978657 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210185a-9802-43db-acaa-5517f3cffe86 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:30.003883 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d108fa-ea60-4e61-97f5-333056a5437f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:30.004589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d108fa-ea60-4e61-97f5-333056a5437f None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:30.004879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d108fa-ea60-4e61-97f5-333056a5437f None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:30.005146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d108fa-ea60-4e61-97f5-333056a5437f None admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:30.006164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d108fa-ea60-4e61-97f5-333056a5437f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:30.006475 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d108fa-ea60-4e61-97f5-333056a5437f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:30.007986 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d108fa-ea60-4e61-97f5-333056a5437f None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:30.025875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 299/597] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:50:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:30.026929 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d108fa-ea60-4e61-97f5-333056a5437f None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:30.138902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d108fa-ea60-4e61-97f5-333056a5437f None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:30.171560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210185a-9802-43db-acaa-5517f3cffe86 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:30.179316 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec750565-86f7-4cfc-952e-774ba61ff08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:30.180279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec750565-86f7-4cfc-952e-774ba61ff08b None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:30.180580 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec750565-86f7-4cfc-952e-774ba61ff08b None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:30.180864 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec750565-86f7-4cfc-952e-774ba61ff08b None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:30.181605 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec750565-86f7-4cfc-952e-774ba61ff08b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:30.181918 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec750565-86f7-4cfc-952e-774ba61ff08b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:30.183383 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec750565-86f7-4cfc-952e-774ba61ff08b None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:30.197559 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 300/598] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:30.198464 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec750565-86f7-4cfc-952e-774ba61ff08b None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:30.241294 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1762dd-7ba5-4e53-b047-d72e64c54645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:30.243905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1762dd-7ba5-4e53-b047-d72e64c54645 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:30.244692 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1762dd-7ba5-4e53-b047-d72e64c54645 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:30.245522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1762dd-7ba5-4e53-b047-d72e64c54645 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:30.265435 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1762dd-7ba5-4e53-b047-d72e64c54645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:30.268705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1762dd-7ba5-4e53-b047-d72e64c54645 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:30.304410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-1f1762dd-7ba5-4e53-b047-d72e64c54645 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:30.304410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:30.304410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:30.304410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:30.304410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:30.304410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:30.304410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:30.304410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:30.304410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:30.304410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:30.304410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:30.304410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:30.304410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:30.304410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:30.304410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:30.306110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:30.306110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:30.306110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:30.306110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:30.306110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:30.306110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:30.306110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:30.306110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:30.306110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:30.306110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:30.306110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:30.306110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:30.306110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:30.306110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:30.306110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:30.306110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:30.306110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:30.307788 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:30.307788 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:30.307788 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:30.307788 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:30.310475 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec750565-86f7-4cfc-952e-774ba61ff08b None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:30.313630 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 299/599] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:30.315588 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1762dd-7ba5-4e53-b047-d72e64c54645 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:30.349813 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b00cc-a674-4d99-9b65-765f67fea89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:30.350591 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b00cc-a674-4d99-9b65-765f67fea89f None admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:30.350888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b00cc-a674-4d99-9b65-765f67fea89f None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:30.351166 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b00cc-a674-4d99-9b65-765f67fea89f None admin] PATH_INFO: `/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/6cdd8008619d4ee3b8fe45e0e5241878/roles/354a460a8146476989f8a7b4fc1aac93` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:30.367695 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b00cc-a674-4d99-9b65-765f67fea89f None admin] RBAC: Authorizing `identity:create_grant(project_id=48788e7517a14ca5b5af9f161512ac9c, user_id=6cdd8008619d4ee3b8fe45e0e5241878, role_id=354a460a8146476989f8a7b4fc1aac93)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:30.369213 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b00cc-a674-4d99-9b65-765f67fea89f None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:30.391160 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 301/600] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:50:30 2022] PUT /identity/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/6cdd8008619d4ee3b8fe45e0e5241878/roles/354a460a8146476989f8a7b4fc1aac93 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:50:30.392414 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b00cc-a674-4d99-9b65-765f67fea89f None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:30.507302 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1762dd-7ba5-4e53-b047-d72e64c54645 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:30.593568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a94cc-da1e-46eb-a5fa-25123704d8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:30.594892 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a94cc-da1e-46eb-a5fa-25123704d8be None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:30.595444 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a94cc-da1e-46eb-a5fa-25123704d8be None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:30.595953 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a94cc-da1e-46eb-a5fa-25123704d8be None admin] PATH_INFO: `/v3/projects/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:30.608871 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a94cc-da1e-46eb-a5fa-25123704d8be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:30.611749 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a94cc-da1e-46eb-a5fa-25123704d8be None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:30.627400 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b00cc-a674-4d99-9b65-765f67fea89f None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:30.638587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-8f7a94cc-da1e-46eb-a5fa-25123704d8be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:30.638587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:30.638587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:30.638587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:30.638587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:30.638587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:30.638587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:30.638587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:30.638587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:30.638587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:30.638587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:30.638587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:30.638587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:50:30.638587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:50:30.638587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:50:30.639598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:50:30.639598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:30.639598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:30.639598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:30.639598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:30.639598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:30.639598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:30.639598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:30.639598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:30.639598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:30.639598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:30.639598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:30.639598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:30.639598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:30.639598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:30.639598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:30.639598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:30.641525 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:50:30.641525 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:50:30.641525 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:50:30.641525 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:50:30.641525 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:50:30.641525 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:50:30.641525 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:30.641525 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:30.652380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 300/601] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:30.658288 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a94cc-da1e-46eb-a5fa-25123704d8be None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:30.681982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99938511-aa63-4f71-a294-b33f11357ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:30.682671 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99938511-aa63-4f71-a294-b33f11357ad1 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:30.683016 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99938511-aa63-4f71-a294-b33f11357ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:30.683346 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99938511-aa63-4f71-a294-b33f11357ad1 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:30.684252 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99938511-aa63-4f71-a294-b33f11357ad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:30.684876 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99938511-aa63-4f71-a294-b33f11357ad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:30.686318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99938511-aa63-4f71-a294-b33f11357ad1 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:30.700354 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 302/602] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:30.708726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99938511-aa63-4f71-a294-b33f11357ad1 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:30.785771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a94cc-da1e-46eb-a5fa-25123704d8be None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:30.827393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f52d6-6714-469c-a9d4-9dd58ddc8b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:30.828362 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99938511-aa63-4f71-a294-b33f11357ad1 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:30.828722 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f52d6-6714-469c-a9d4-9dd58ddc8b91 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:30.829234 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f52d6-6714-469c-a9d4-9dd58ddc8b91 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:30.829715 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f52d6-6714-469c-a9d4-9dd58ddc8b91 None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:30.830724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f52d6-6714-469c-a9d4-9dd58ddc8b91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:30.831348 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f52d6-6714-469c-a9d4-9dd58ddc8b91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:30.833043 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f52d6-6714-469c-a9d4-9dd58ddc8b91 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:30.847267 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 301/603] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:50:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:30.858366 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f52d6-6714-469c-a9d4-9dd58ddc8b91 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:30.885984 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677f1b0-e806-48c1-a9fb-e291e5a25f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:30.886228 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677f1b0-e806-48c1-a9fb-e291e5a25f98 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:30.886495 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677f1b0-e806-48c1-a9fb-e291e5a25f98 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:30.886662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677f1b0-e806-48c1-a9fb-e291e5a25f98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:30.906570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677f1b0-e806-48c1-a9fb-e291e5a25f98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:30.907773 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677f1b0-e806-48c1-a9fb-e291e5a25f98 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:30.941565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-b677f1b0-e806-48c1-a9fb-e291e5a25f98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:30.941565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:30.941565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:30.941565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:30.941565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:30.941565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:30.941565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:30.941565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:30.941565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:30.941565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:30.941565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:30.941565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:30.941565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:50:30.941565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:50:30.941565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:50:30.942777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:50:30.942777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:30.942777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:30.942777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:30.942777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:30.942777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:30.942777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:30.942777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:30.942777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:30.942777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:30.942777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:30.942777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:30.942777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:30.942777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:30.942777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:30.942777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:30.942777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:30.943776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:50:30.943776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:50:30.943776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:50:30.943776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:50:30.943776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:50:30.943776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:50:30.943776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:30.943776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:30.945045 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 303/604] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:50:30.953415 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677f1b0-e806-48c1-a9fb-e291e5a25f98 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:31.075175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677f1b0-e806-48c1-a9fb-e291e5a25f98 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:31.117070 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f52d6-6714-469c-a9d4-9dd58ddc8b91 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:31.133196 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bec65a-3a33-4866-85be-5a6a5a3f794d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:31.133882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bec65a-3a33-4866-85be-5a6a5a3f794d None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:31.134168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bec65a-3a33-4866-85be-5a6a5a3f794d None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:31.134450 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bec65a-3a33-4866-85be-5a6a5a3f794d None admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:31.135281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bec65a-3a33-4866-85be-5a6a5a3f794d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:31.135594 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bec65a-3a33-4866-85be-5a6a5a3f794d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:31.137233 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bec65a-3a33-4866-85be-5a6a5a3f794d None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:31.157863 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 304/605] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:50:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:31.169628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bec65a-3a33-4866-85be-5a6a5a3f794d None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:31.196282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d506f5-e848-4f47-b592-50720ed05416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:31.197203 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d506f5-e848-4f47-b592-50720ed05416 None admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:31.197489 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d506f5-e848-4f47-b592-50720ed05416 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:31.197765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d506f5-e848-4f47-b592-50720ed05416 None admin] PATH_INFO: `/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/343a23610db84b028ccc05e4f876a0c4/roles/354a460a8146476989f8a7b4fc1aac93` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:31.243768 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d506f5-e848-4f47-b592-50720ed05416 None admin] RBAC: Authorizing `identity:create_grant(project_id=48788e7517a14ca5b5af9f161512ac9c, user_id=343a23610db84b028ccc05e4f876a0c4, role_id=354a460a8146476989f8a7b4fc1aac93)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:31.245247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d506f5-e848-4f47-b592-50720ed05416 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:31.273405 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 302/606] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:50:30 2022] PUT /identity/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/343a23610db84b028ccc05e4f876a0c4/roles/354a460a8146476989f8a7b4fc1aac93 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:50:31.293759 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bec65a-3a33-4866-85be-5a6a5a3f794d None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:31.332709 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9893f3-c842-451b-bd94-f7f1e2e371e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:31.333795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9893f3-c842-451b-bd94-f7f1e2e371e7 None admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:31.334085 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9893f3-c842-451b-bd94-f7f1e2e371e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:31.334362 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9893f3-c842-451b-bd94-f7f1e2e371e7 None admin] PATH_INFO: `/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/ee97a542470644f89cd665dfdf2f9e92/roles/354a460a8146476989f8a7b4fc1aac93` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:31.352411 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9893f3-c842-451b-bd94-f7f1e2e371e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=48788e7517a14ca5b5af9f161512ac9c, user_id=ee97a542470644f89cd665dfdf2f9e92, role_id=354a460a8146476989f8a7b4fc1aac93)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:31.354036 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9893f3-c842-451b-bd94-f7f1e2e371e7 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:31.373217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 305/607] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:50:31 2022] PUT /identity/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/ee97a542470644f89cd665dfdf2f9e92/roles/354a460a8146476989f8a7b4fc1aac93 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:50:32.289244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd2f34-f94b-4ef6-a3a9-6ac9d0ad4b84 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:32.290255 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd2f34-f94b-4ef6-a3a9-6ac9d0ad4b84 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:32.290255 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd2f34-f94b-4ef6-a3a9-6ac9d0ad4b84 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:32.293163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 303/608] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:32.298473 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f08fe-c7e5-4a24-964a-dc5cfa56445d None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:32.299406 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f08fe-c7e5-4a24-964a-dc5cfa56445d None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:32.299406 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f08fe-c7e5-4a24-964a-dc5cfa56445d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:32.320922 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-1b3f08fe-c7e5-4a24-964a-dc5cfa56445d None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:32.323467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-1b3f08fe-c7e5-4a24-964a-dc5cfa56445d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:32.474896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 306/609] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 14:50:32.521893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd2f34-f94b-4ef6-a3a9-6ac9d0ad4b84 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:32.793023 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd2f34-f94b-4ef6-a3a9-6ac9d0ad4b84 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:32.880913 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efab39-d2fe-4707-9a3d-c9e839b1708c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:32.882297 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efab39-d2fe-4707-9a3d-c9e839b1708c None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:32.882782 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efab39-d2fe-4707-9a3d-c9e839b1708c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:32.883295 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efab39-d2fe-4707-9a3d-c9e839b1708c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:32.912291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efab39-d2fe-4707-9a3d-c9e839b1708c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:32.935893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-55efab39-d2fe-4707-9a3d-c9e839b1708c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:32.935893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:32.935893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:32.935893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:32.935893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:32.935893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:32.935893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:32.935893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:32.935893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:32.935893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:32.935893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:32.935893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:32.935893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:32.935893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:32.935893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:32.935893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:32.937669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:32.937669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:32.937669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:32.937669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:32.937669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:32.937669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:32.937669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:32.937669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:32.937669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:32.937669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:32.937669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:32.937669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:32.937669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:32.937669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:32.937669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:32.937669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:32.939271 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:32.939271 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:32.939271 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:32.939271 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:32.939271 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:32.939271 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:32.939271 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:32.939271 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:32.939271 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:32.939271 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:32.939271 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:32.939271 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:32.939271 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 304/610] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:50:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:32.946178 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f08fe-c7e5-4a24-964a-dc5cfa56445d None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:33.126025 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f08fe-c7e5-4a24-964a-dc5cfa56445d None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:33.170642 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7e55d-6538-4ca8-969c-e8e5a0b4ac88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:33.171804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7e55d-6538-4ca8-969c-e8e5a0b4ac88 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:33.172305 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7e55d-6538-4ca8-969c-e8e5a0b4ac88 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:33.172796 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7e55d-6538-4ca8-969c-e8e5a0b4ac88 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:33.173821 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7e55d-6538-4ca8-969c-e8e5a0b4ac88 None admin] RBAC: Adding query filter params (name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:33.174358 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7e55d-6538-4ca8-969c-e8e5a0b4ac88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:33.176110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7e55d-6538-4ca8-969c-e8e5a0b4ac88 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:33.191010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 307/611] 10.222.0.73 () {56 vars in 1103 bytes} [Fri May 13 14:50:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:33.197707 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efab39-d2fe-4707-9a3d-c9e839b1708c None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:33.359425 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efab39-d2fe-4707-9a3d-c9e839b1708c None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:33.396357 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b51e1-a863-4c0d-a754-0821bce1dae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:33.397103 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b51e1-a863-4c0d-a754-0821bce1dae1 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:33.397387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b51e1-a863-4c0d-a754-0821bce1dae1 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:33.397663 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b51e1-a863-4c0d-a754-0821bce1dae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:33.410077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b51e1-a863-4c0d-a754-0821bce1dae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:33.412155 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b51e1-a863-4c0d-a754-0821bce1dae1 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:33.431127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-e23b51e1-a863-4c0d-a754-0821bce1dae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:33.431127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:33.431127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:33.431127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:33.431127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:33.431127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:33.431127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:33.431127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:33.431127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:33.431127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:33.431127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:33.431127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:33.431127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:33.431127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:33.431127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:33.432074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:33.432074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:33.432074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:33.432074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:33.432074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:33.432074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:33.432074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:33.432074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:33.432074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:33.432074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:33.432074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:33.432074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:33.432074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:33.432074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:33.432074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:33.432074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:33.432074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:33.433664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:33.433664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:33.433664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:33.433664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:33.433664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 305/612] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:33.439223 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7e55d-6538-4ca8-969c-e8e5a0b4ac88 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:33.463077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7ed20-c0b7-4780-a388-504419cdd0bb None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:33.463451 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7ed20-c0b7-4780-a388-504419cdd0bb None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:33.463619 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7ed20-c0b7-4780-a388-504419cdd0bb None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:33.465363 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 306/613] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:33.471243 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40744b6c-299b-458e-893e-fd59de7d8dc7 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:33.471566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40744b6c-299b-458e-893e-fd59de7d8dc7 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:33.471791 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40744b6c-299b-458e-893e-fd59de7d8dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:33.492116 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-40744b6c-299b-458e-893e-fd59de7d8dc7 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:33.493339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-40744b6c-299b-458e-893e-fd59de7d8dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:33.625316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 307/614] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:33.669635 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40744b6c-299b-458e-893e-fd59de7d8dc7 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:33.694957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7e55d-6538-4ca8-969c-e8e5a0b4ac88 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:33.785527 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045facac-e3bb-4570-9807-132268ea1c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:33.789360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045facac-e3bb-4570-9807-132268ea1c1c None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:33.789925 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045facac-e3bb-4570-9807-132268ea1c1c None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:33.790419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045facac-e3bb-4570-9807-132268ea1c1c None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:33.791918 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045facac-e3bb-4570-9807-132268ea1c1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:33.792474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045facac-e3bb-4570-9807-132268ea1c1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:33.801353 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045facac-e3bb-4570-9807-132268ea1c1c None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:33.827982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 308/615] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:33.834722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045facac-e3bb-4570-9807-132268ea1c1c None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:33.943226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40744b6c-299b-458e-893e-fd59de7d8dc7 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:33.991122 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a22516-8e3c-4f3b-8fb1-eae521f3a5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:33.992698 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22516-8e3c-4f3b-8fb1-eae521f3a5d4 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:33.992985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22516-8e3c-4f3b-8fb1-eae521f3a5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:33.993261 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22516-8e3c-4f3b-8fb1-eae521f3a5d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:34.006157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a22516-8e3c-4f3b-8fb1-eae521f3a5d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:34.014226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-57a22516-8e3c-4f3b-8fb1-eae521f3a5d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:34.014226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:34.014226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:34.014226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:34.014226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:34.014226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:34.014226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:34.014226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:34.014226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:34.014226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:34.014226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:34.014226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:34.014226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:34.014226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:34.014226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:34.014226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:34.015296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:34.015296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:34.015296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:34.015296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:34.015296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:34.015296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:34.015296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:34.015296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:34.015296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:34.015296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:34.015296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:34.015296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:34.015296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:34.015296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:34.015296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:34.015296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:34.016130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:34.016130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:34.016130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:34.016130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:34.016130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:34.016130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:34.016130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:34.016130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:34.016130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:34.016130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:34.016130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:34.016130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:34.016130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 308/616] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:50:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:50:34.018407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bbfbb-8cd8-427e-83dd-47c74b71cec5 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:34.018407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bbfbb-8cd8-427e-83dd-47c74b71cec5 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:34.018407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bbfbb-8cd8-427e-83dd-47c74b71cec5 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:34.022844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 309/617] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:34.022844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bbfbb-8cd8-427e-83dd-47c74b71cec5 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:34.028251 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045facac-e3bb-4570-9807-132268ea1c1c None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:34.065794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9895e0-d7bc-431a-978e-8051499e7648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:34.066917 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9895e0-d7bc-431a-978e-8051499e7648 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:34.067211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9895e0-d7bc-431a-978e-8051499e7648 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:34.067486 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9895e0-d7bc-431a-978e-8051499e7648 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:34.075562 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9895e0-d7bc-431a-978e-8051499e7648 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:34.077032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9895e0-d7bc-431a-978e-8051499e7648 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:34.093318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-4a9895e0-d7bc-431a-978e-8051499e7648 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 14:50:34.093318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:34.093318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:34.093318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:34.093318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:34.093318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:34.093318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:34.093318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:34.093318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:34.093318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:34.093318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:34.093318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:34.093318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:50:34.093318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:50:34.093318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:50:34.093318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:50:34.094337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:34.094337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:34.094337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:50:34.094337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:34.094337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:50:34.094337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:34.094337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:34.094337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:34.094337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:34.094337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:34.094337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:34.094337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:34.094337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:34.094337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:34.094337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:34.094337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:34.094337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:34.094337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:34.095309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:34.095309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:34.095309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:50:34.095309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:50:34.095309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:50:34.095309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:50:34.095309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:50:34.095309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:50:34.095309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 14:50:34.095309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:34.095309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 309/618] 10.222.0.73 () {56 vars in 1093 bytes} [Fri May 13 14:50:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:50:34.097475 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd5f92-cef3-48a7-905a-6913b7c90fd6 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:34.097475 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd5f92-cef3-48a7-905a-6913b7c90fd6 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:34.097475 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd5f92-cef3-48a7-905a-6913b7c90fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:34.120432 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-effd5f92-cef3-48a7-905a-6913b7c90fd6 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:34.121647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-effd5f92-cef3-48a7-905a-6913b7c90fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:34.170720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bbfbb-8cd8-427e-83dd-47c74b71cec5 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:34.196173 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 310/619] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:34.197305 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd5f92-cef3-48a7-905a-6913b7c90fd6 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:34.218895 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f7248-c4d7-46ad-9635-494bfc536578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:34.220469 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f7248-c4d7-46ad-9635-494bfc536578 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:34.221042 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f7248-c4d7-46ad-9635-494bfc536578 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:34.221534 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f7248-c4d7-46ad-9635-494bfc536578 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:34.222514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f7248-c4d7-46ad-9635-494bfc536578 None admin] RBAC: Adding query filter params (name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:34.223073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f7248-c4d7-46ad-9635-494bfc536578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:34.226179 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f7248-c4d7-46ad-9635-494bfc536578 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:34.238690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 310/620] 10.222.0.73 () {56 vars in 1103 bytes} [Fri May 13 14:50:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:34.240273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f7248-c4d7-46ad-9635-494bfc536578 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:34.332077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd5f92-cef3-48a7-905a-6913b7c90fd6 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:34.357746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f7248-c4d7-46ad-9635-494bfc536578 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:34.378767 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54d837-1103-4368-9b1d-391df792cb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:34.379512 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54d837-1103-4368-9b1d-391df792cb36 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:34.379797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54d837-1103-4368-9b1d-391df792cb36 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:34.380076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54d837-1103-4368-9b1d-391df792cb36 None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:34.382092 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54d837-1103-4368-9b1d-391df792cb36 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:34.382417 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54d837-1103-4368-9b1d-391df792cb36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:34.384280 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54d837-1103-4368-9b1d-391df792cb36 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:34.397743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762189cc-5702-4350-9847-ba4405fc7490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:34.399368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762189cc-5702-4350-9847-ba4405fc7490 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:34.399858 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762189cc-5702-4350-9847-ba4405fc7490 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:34.400334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762189cc-5702-4350-9847-ba4405fc7490 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:34.408065 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 311/621] 10.222.0.73 () {56 vars in 1133 bytes} [Fri May 13 14:50:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:34.409229 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54d837-1103-4368-9b1d-391df792cb36 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:34.413574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762189cc-5702-4350-9847-ba4405fc7490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:34.422126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-762189cc-5702-4350-9847-ba4405fc7490 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:34.422126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:34.422126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:34.422126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:34.422126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:34.422126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:34.422126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:34.422126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:34.422126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:34.422126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:34.422126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:34.422126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:34.422126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:34.422126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:34.422126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:34.422126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:34.423213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:34.423213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:34.423213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:34.423213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:34.423213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:34.423213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:34.423213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:34.423213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:34.423213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:34.423213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:34.423213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:34.423213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:34.423213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:34.423213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:34.423213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:34.423213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:34.424097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:34.424097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:34.424097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:34.424097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:34.424097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:34.424097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:34.424097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:34.424097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:34.424097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:34.424097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:34.424097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:34.424097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:34.428159 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 311/622] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:50:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:34.429397 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762189cc-5702-4350-9847-ba4405fc7490 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:34.534074 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54d837-1103-4368-9b1d-391df792cb36 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:34.550136 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762189cc-5702-4350-9847-ba4405fc7490 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:34.571769 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b6f21-eae4-473b-befd-8c0ece24fe15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:34.572865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b6f21-eae4-473b-befd-8c0ece24fe15 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:34.573304 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b6f21-eae4-473b-befd-8c0ece24fe15 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:34.573579 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b6f21-eae4-473b-befd-8c0ece24fe15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:34.584255 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b6f21-eae4-473b-befd-8c0ece24fe15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:34.585721 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b6f21-eae4-473b-befd-8c0ece24fe15 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:34.587138 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be454a-23e9-4552-ac57-8306cb46e118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:34.588118 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be454a-23e9-4552-ac57-8306cb46e118 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:34.588792 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be454a-23e9-4552-ac57-8306cb46e118 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:34.589075 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be454a-23e9-4552-ac57-8306cb46e118 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:34.604217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-3f2b6f21-eae4-473b-befd-8c0ece24fe15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:34.604217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:34.604217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:34.604217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:34.604217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:34.604217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:34.604217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:34.604217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:34.604217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:34.604217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:34.604217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:34.604217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:34.604217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:34.604217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:34.604217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:34.605193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:34.605193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:34.605193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:34.605193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:34.605193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:34.605193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:34.605193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:34.605193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:34.605193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:34.605193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:34.605193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:34.605193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:34.605193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:34.605193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:34.605193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:34.605193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:34.605193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:34.606166 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:34.606166 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:34.606166 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:34.606166 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:34.606166 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 312/623] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:34.606441 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b6f21-eae4-473b-befd-8c0ece24fe15 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:34.670426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be454a-23e9-4552-ac57-8306cb46e118 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:34.671944 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be454a-23e9-4552-ac57-8306cb46e118 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:34.719956 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b6f21-eae4-473b-befd-8c0ece24fe15 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:34.757711 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77193c8d-ddca-4125-bb5b-ebf293284054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:34.758652 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77193c8d-ddca-4125-bb5b-ebf293284054 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:34.759145 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77193c8d-ddca-4125-bb5b-ebf293284054 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:34.759571 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77193c8d-ddca-4125-bb5b-ebf293284054 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:34.760479 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77193c8d-ddca-4125-bb5b-ebf293284054 None admin] RBAC: Adding query filter params (name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:34.760937 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77193c8d-ddca-4125-bb5b-ebf293284054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:34.762513 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77193c8d-ddca-4125-bb5b-ebf293284054 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:34.780403 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 313/624] 10.222.0.73 () {56 vars in 1103 bytes} [Fri May 13 14:50:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:34.780403 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90695e2f-caf1-4c76-9810-009ccd156cc5 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:34.780403 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90695e2f-caf1-4c76-9810-009ccd156cc5 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:34.780403 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90695e2f-caf1-4c76-9810-009ccd156cc5 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:34.782007 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 314/625] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:34.783539 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90695e2f-caf1-4c76-9810-009ccd156cc5 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:34.785649 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 312/626] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:50:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:50:34.787529 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c2e84-8230-4791-b828-b66644e0a741 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:34.787811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c2e84-8230-4791-b828-b66644e0a741 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:34.788084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c2e84-8230-4791-b828-b66644e0a741 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:34.790113 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 313/627] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:34.791407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c2e84-8230-4791-b828-b66644e0a741 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:34.911613 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90695e2f-caf1-4c76-9810-009ccd156cc5 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:34.918985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c2e84-8230-4791-b828-b66644e0a741 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:34.961754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99508e00-05d3-4020-a3b7-7f26675bef59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:34.962803 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99508e00-05d3-4020-a3b7-7f26675bef59 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:34.963281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99508e00-05d3-4020-a3b7-7f26675bef59 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:34.963847 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99508e00-05d3-4020-a3b7-7f26675bef59 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:34.964961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99508e00-05d3-4020-a3b7-7f26675bef59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:34.965457 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99508e00-05d3-4020-a3b7-7f26675bef59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:34.967927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99508e00-05d3-4020-a3b7-7f26675bef59 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:34.971693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b10d4a-58ee-4232-b999-ec5991ed0632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:34.972879 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b10d4a-58ee-4232-b999-ec5991ed0632 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:34.973322 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b10d4a-58ee-4232-b999-ec5991ed0632 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:34.973752 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b10d4a-58ee-4232-b999-ec5991ed0632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:34.994306 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 315/628] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:34.994306 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a8cc7-3fcf-473f-b410-7b2ac81b80ac None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:34.994306 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a8cc7-3fcf-473f-b410-7b2ac81b80ac None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:34.994796 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b10d4a-58ee-4232-b999-ec5991ed0632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:34.994931 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a8cc7-3fcf-473f-b410-7b2ac81b80ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:34.995063 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b10d4a-58ee-4232-b999-ec5991ed0632 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:35.014047 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-919a8cc7-3fcf-473f-b410-7b2ac81b80ac None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:35.015011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-c9b10d4a-58ee-4232-b999-ec5991ed0632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:35.015011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:35.015011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:35.015011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:35.015011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:35.015011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:35.015011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:35.015011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:35.015011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:35.015011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:35.015011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:35.015011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:35.015011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:35.015011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:35.015011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:35.016656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:35.016656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:35.016656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:35.016656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:35.016656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:35.016656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:35.016656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:35.016656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:35.016656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:35.016656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:35.016656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:35.016656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:35.016656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:35.016656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:35.016656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:35.016656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:35.016656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:35.018499 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:35.018499 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:35.018499 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:35.018499 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:35.019016 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-919a8cc7-3fcf-473f-b410-7b2ac81b80ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:35.019152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 314/629] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:35.019152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b10d4a-58ee-4232-b999-ec5991ed0632 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:35.097010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 316/630] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:35.098413 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eaabf-1ea3-4853-9020-27ce68e51cbd None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:35.098761 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eaabf-1ea3-4853-9020-27ce68e51cbd None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:35.101594 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eaabf-1ea3-4853-9020-27ce68e51cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:35.122807 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-6f8eaabf-1ea3-4853-9020-27ce68e51cbd None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:35.124620 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6f8eaabf-1ea3-4853-9020-27ce68e51cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:35.155305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b10d4a-58ee-4232-b999-ec5991ed0632 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:35.199587 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 317/631] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:35.200458 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8eaabf-1ea3-4853-9020-27ce68e51cbd None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:35.221559 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9a190-d75e-4c93-a127-445a30ab74d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:35.222381 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9a190-d75e-4c93-a127-445a30ab74d5 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:35.222660 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9a190-d75e-4c93-a127-445a30ab74d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:35.222951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9a190-d75e-4c93-a127-445a30ab74d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:35.235791 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9a190-d75e-4c93-a127-445a30ab74d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:35.237284 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9a190-d75e-4c93-a127-445a30ab74d5 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:35.256954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-22e9a190-d75e-4c93-a127-445a30ab74d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:35.256954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:35.256954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:35.256954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:35.256954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:35.256954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:35.256954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:35.256954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:35.256954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:35.256954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:35.256954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:35.256954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:35.256954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:35.256954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:35.256954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:35.258985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:35.258985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:35.258985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:35.258985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:35.258985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:35.258985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:35.258985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:35.258985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:35.258985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:35.258985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:35.258985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:35.258985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:35.258985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:35.258985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:35.258985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:35.258985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:35.258985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:35.260766 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:35.260766 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:35.260766 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:35.260766 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:35.260766 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 315/632] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:35.260766 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9a190-d75e-4c93-a127-445a30ab74d5 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:35.330636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8eaabf-1ea3-4853-9020-27ce68e51cbd None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:35.374111 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861e61c-b93f-44a6-98b4-5ac798fe9d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:35.375232 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861e61c-b93f-44a6-98b4-5ac798fe9d49 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:35.375675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861e61c-b93f-44a6-98b4-5ac798fe9d49 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:35.376122 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861e61c-b93f-44a6-98b4-5ac798fe9d49 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:35.383948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9a190-d75e-4c93-a127-445a30ab74d5 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:35.388185 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861e61c-b93f-44a6-98b4-5ac798fe9d49 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:35.390782 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861e61c-b93f-44a6-98b4-5ac798fe9d49 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:35.417368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-1861e61c-b93f-44a6-98b4-5ac798fe9d49 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 14:50:35.417368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:35.417368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:35.417368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:35.417368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:35.417368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:35.417368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:35.417368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:35.417368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:35.417368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:35.417368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:35.417368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:35.417368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:50:35.417368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:50:35.417368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:50:35.417368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:50:35.419412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:35.419412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:35.419412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:50:35.419412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:35.419412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:50:35.419412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:35.419412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:35.419412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:35.419412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:35.419412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:35.419412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:35.419412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:35.419412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:35.419412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:35.419412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:35.419412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:35.419412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:35.419412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:35.428845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:35.428845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:35.428845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:50:35.428845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:50:35.428845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:50:35.428845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:50:35.428845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:50:35.428845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:50:35.428845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 14:50:35.428845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:35.428845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 318/633] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:50:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:35.428845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861e61c-b93f-44a6-98b4-5ac798fe9d49 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:35.439030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8c8cc-ba19-4e9e-aee7-cd404cb457c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:35.440051 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8c8cc-ba19-4e9e-aee7-cd404cb457c1 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:35.440417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8c8cc-ba19-4e9e-aee7-cd404cb457c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:35.440773 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8c8cc-ba19-4e9e-aee7-cd404cb457c1 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:35.441908 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8c8cc-ba19-4e9e-aee7-cd404cb457c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:35.442336 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8c8cc-ba19-4e9e-aee7-cd404cb457c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:35.444033 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8c8cc-ba19-4e9e-aee7-cd404cb457c1 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:35.461037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 316/634] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:35.462480 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8c8cc-ba19-4e9e-aee7-cd404cb457c1 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:35.554743 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861e61c-b93f-44a6-98b4-5ac798fe9d49 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:35.584996 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8c8cc-ba19-4e9e-aee7-cd404cb457c1 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:35.611164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f35b9-e1cf-4fb2-bf47-7ab9c5ea308d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:35.612550 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f35b9-e1cf-4fb2-bf47-7ab9c5ea308d None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:35.613049 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f35b9-e1cf-4fb2-bf47-7ab9c5ea308d None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:35.613534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f35b9-e1cf-4fb2-bf47-7ab9c5ea308d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:35.623476 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f35ed-4368-47c5-b416-3eed7015b939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:35.624374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f35ed-4368-47c5-b416-3eed7015b939 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:35.624606 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f35ed-4368-47c5-b416-3eed7015b939 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:35.624881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f35ed-4368-47c5-b416-3eed7015b939 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:35.631817 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f35b9-e1cf-4fb2-bf47-7ab9c5ea308d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:35.640909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-716f35b9-e1cf-4fb2-bf47-7ab9c5ea308d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:35.640909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:35.640909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:35.640909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:35.640909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:35.640909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:35.640909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:35.640909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:35.640909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:35.640909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:35.640909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:35.640909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:35.640909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:35.640909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:35.640909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:35.640909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:35.642961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:35.642961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:35.642961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:35.642961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:35.642961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:35.642961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:35.642961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:35.642961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:35.642961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:35.642961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:35.642961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:35.642961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:35.642961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:35.642961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:35.642961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:35.642961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:35.644651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:35.644651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:35.644651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:35.644651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:35.644651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:35.644651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:35.644651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:35.644651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:35.644651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:35.644651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:35.644651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:35.644651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:35.646496 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f35ed-4368-47c5-b416-3eed7015b939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:35.646636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 319/635] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:50:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:35.646636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f35b9-e1cf-4fb2-bf47-7ab9c5ea308d None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:35.657359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-983f35ed-4368-47c5-b416-3eed7015b939 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:35.657359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:35.657359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:35.657359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:35.657359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:35.657359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:35.657359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:35.657359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:35.657359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:35.657359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:35.657359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:35.657359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:35.657359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:35.657359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:35.657359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:35.657359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:35.659282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:35.659282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:35.659282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:35.659282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:35.659282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:35.659282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:35.659282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:35.659282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:35.659282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:35.659282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:35.659282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:35.659282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:35.659282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:35.659282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:35.659282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:35.659282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:35.660910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:35.660910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:35.660910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:35.660910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:35.660910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:35.660910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:35.660910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:35.660910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:35.660910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:35.660910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:35.660910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:35.660910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:35.660910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 317/636] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:50:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:35.662952 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f35ed-4368-47c5-b416-3eed7015b939 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:35.774734 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f35b9-e1cf-4fb2-bf47-7ab9c5ea308d None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:35.802229 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f35ed-4368-47c5-b416-3eed7015b939 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:35.814009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdaef3-65f0-400e-a4bf-40d595aceb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:35.814786 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdaef3-65f0-400e-a4bf-40d595aceb76 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:35.815109 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdaef3-65f0-400e-a4bf-40d595aceb76 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:35.815448 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdaef3-65f0-400e-a4bf-40d595aceb76 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:35.816322 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdaef3-65f0-400e-a4bf-40d595aceb76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:35.816904 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdaef3-65f0-400e-a4bf-40d595aceb76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:35.819016 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdaef3-65f0-400e-a4bf-40d595aceb76 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:35.837857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 320/637] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:35.837857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdaef3-65f0-400e-a4bf-40d595aceb76 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:35.869081 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e9829-bcaf-4711-98bf-d703484cc48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:35.870133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e9829-bcaf-4711-98bf-d703484cc48c None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:35.870596 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e9829-bcaf-4711-98bf-d703484cc48c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:35.871113 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e9829-bcaf-4711-98bf-d703484cc48c None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:35.872720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e9829-bcaf-4711-98bf-d703484cc48c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:35.873210 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e9829-bcaf-4711-98bf-d703484cc48c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:35.875883 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e9829-bcaf-4711-98bf-d703484cc48c None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:35.909995 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 318/638] 10.222.0.73 () {56 vars in 1135 bytes} [Fri May 13 14:50:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:35.911330 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e9829-bcaf-4711-98bf-d703484cc48c None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:35.953066 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdaef3-65f0-400e-a4bf-40d595aceb76 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:35.989846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512c945-424d-46a6-94e0-3b321d859239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:35.990662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512c945-424d-46a6-94e0-3b321d859239 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:35.990980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512c945-424d-46a6-94e0-3b321d859239 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:35.991259 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512c945-424d-46a6-94e0-3b321d859239 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:35.999504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512c945-424d-46a6-94e0-3b321d859239 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:36.001000 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512c945-424d-46a6-94e0-3b321d859239 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:36.017043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-e512c945-424d-46a6-94e0-3b321d859239 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 13 14:50:36.017043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:36.017043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:36.017043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:36.017043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:36.017043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:36.017043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:36.017043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:36.017043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:36.017043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:36.017043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:36.017043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:36.017043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:50:36.017043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:50:36.017043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:50:36.017043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:50:36.018461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:36.018461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:36.018461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:50:36.018461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:36.018461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:50:36.018461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:36.018461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:36.018461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:36.018461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:36.018461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:36.018461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:36.018461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:36.018461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:36.018461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:36.018461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:36.018461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:36.018461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:36.018461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:36.019704 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:36.019704 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:36.019704 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:50:36.019704 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:50:36.019704 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:50:36.019704 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:50:36.019704 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:50:36.019704 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:50:36.019704 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 13 14:50:36.019704 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:36.019704 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 321/639] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:50:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:36.019704 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512c945-424d-46a6-94e0-3b321d859239 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:36.070495 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e9829-bcaf-4711-98bf-d703484cc48c None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:36.124177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c6a7d-81a4-440d-9429-6244f5fafe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:36.125235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c6a7d-81a4-440d-9429-6244f5fafe7c None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:36.125684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c6a7d-81a4-440d-9429-6244f5fafe7c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:36.126120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c6a7d-81a4-440d-9429-6244f5fafe7c None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:36.127235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c6a7d-81a4-440d-9429-6244f5fafe7c None admin] RBAC: Adding query filter params (name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:36.127717 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c6a7d-81a4-440d-9429-6244f5fafe7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:36.129977 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c6a7d-81a4-440d-9429-6244f5fafe7c None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:36.143737 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 319/640] 10.222.0.73 () {56 vars in 1103 bytes} [Fri May 13 14:50:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:36.145108 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c6a7d-81a4-440d-9429-6244f5fafe7c None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:36.165900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512c945-424d-46a6-94e0-3b321d859239 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:36.221609 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51430d49-6d54-4f4a-b9c1-3a23843370f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:36.222663 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51430d49-6d54-4f4a-b9c1-3a23843370f3 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:36.223132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51430d49-6d54-4f4a-b9c1-3a23843370f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:36.223580 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51430d49-6d54-4f4a-b9c1-3a23843370f3 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:36.224944 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51430d49-6d54-4f4a-b9c1-3a23843370f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:36.225418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51430d49-6d54-4f4a-b9c1-3a23843370f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:36.227761 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51430d49-6d54-4f4a-b9c1-3a23843370f3 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:36.242034 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 322/641] 10.222.0.73 () {56 vars in 1103 bytes} [Fri May 13 14:50:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:36.243504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51430d49-6d54-4f4a-b9c1-3a23843370f3 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:36.314592 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c6a7d-81a4-440d-9429-6244f5fafe7c None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:36.369688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fceb4-e4c1-4a42-a6f2-af1b5e9810a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:36.371029 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fceb4-e4c1-4a42-a6f2-af1b5e9810a4 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:36.371228 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fceb4-e4c1-4a42-a6f2-af1b5e9810a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:36.371638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fceb4-e4c1-4a42-a6f2-af1b5e9810a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:36.384396 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fceb4-e4c1-4a42-a6f2-af1b5e9810a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:36.386864 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fceb4-e4c1-4a42-a6f2-af1b5e9810a4 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:36.401178 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51430d49-6d54-4f4a-b9c1-3a23843370f3 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:36.411882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-7f9fceb4-e4c1-4a42-a6f2-af1b5e9810a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:36.411882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:36.411882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:36.411882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:36.411882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:36.411882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:36.411882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:36.411882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:36.411882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:36.411882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:36.411882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:36.411882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:36.411882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:50:36.411882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:50:36.411882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:50:36.412938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:50:36.412938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:36.412938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:36.412938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:36.412938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:36.412938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:36.412938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:36.412938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:36.412938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:36.412938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:36.412938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:36.412938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:36.412938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:36.412938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:36.412938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:36.412938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:36.412938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:36.414546 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:50:36.414546 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:50:36.414546 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:50:36.414546 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:50:36.414546 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:50:36.414546 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:50:36.414546 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:36.414546 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:36.414546 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 320/642] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:36.415579 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fceb4-e4c1-4a42-a6f2-af1b5e9810a4 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:36.464175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97f306-78ea-4fa0-80c3-1a614bc6d4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:36.465444 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97f306-78ea-4fa0-80c3-1a614bc6d4da None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:36.465907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97f306-78ea-4fa0-80c3-1a614bc6d4da None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:36.466378 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97f306-78ea-4fa0-80c3-1a614bc6d4da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:36.484016 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97f306-78ea-4fa0-80c3-1a614bc6d4da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:36.486614 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97f306-78ea-4fa0-80c3-1a614bc6d4da None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:36.516957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-8e97f306-78ea-4fa0-80c3-1a614bc6d4da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:36.516957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:36.516957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:36.516957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:36.516957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:36.516957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:36.516957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:36.516957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:36.516957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:36.516957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:36.516957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:36.516957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:36.516957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:36.516957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:36.516957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:36.518713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:36.518713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:36.518713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:36.518713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:36.518713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:36.518713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:36.518713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:36.518713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:36.518713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:36.518713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:36.518713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:36.518713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:36.518713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:36.518713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:36.518713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:36.518713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:36.518713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:36.520596 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:36.520596 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:36.520596 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:36.520596 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:36.520596 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 323/643] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:36.521196 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97f306-78ea-4fa0-80c3-1a614bc6d4da None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:36.582522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fceb4-e4c1-4a42-a6f2-af1b5e9810a4 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:36.635433 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9841ad-4df4-4deb-addb-6ba3016201c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:36.636409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9841ad-4df4-4deb-addb-6ba3016201c8 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:36.636855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9841ad-4df4-4deb-addb-6ba3016201c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:36.637301 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9841ad-4df4-4deb-addb-6ba3016201c8 None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:36.638780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9841ad-4df4-4deb-addb-6ba3016201c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:36.639314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9841ad-4df4-4deb-addb-6ba3016201c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:36.641513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9841ad-4df4-4deb-addb-6ba3016201c8 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:36.670969 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 321/644] 10.222.0.73 () {56 vars in 1137 bytes} [Fri May 13 14:50:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:36.672296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9841ad-4df4-4deb-addb-6ba3016201c8 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:36.679111 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97f306-78ea-4fa0-80c3-1a614bc6d4da None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:36.734578 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb583be-46d0-44c5-9ae3-49b280afb790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:36.735886 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb583be-46d0-44c5-9ae3-49b280afb790 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:36.736349 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb583be-46d0-44c5-9ae3-49b280afb790 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:36.736802 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb583be-46d0-44c5-9ae3-49b280afb790 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:36.755722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb583be-46d0-44c5-9ae3-49b280afb790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:36.758263 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb583be-46d0-44c5-9ae3-49b280afb790 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:36.788257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-ccb583be-46d0-44c5-9ae3-49b280afb790 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:36.788257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:36.788257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:36.788257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:36.788257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:36.788257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:36.788257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:36.788257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:36.788257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:36.788257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:36.788257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:36.788257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:36.788257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:36.788257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:36.788257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:36.790157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:36.790157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:36.790157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:36.790157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:36.790157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:36.790157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:36.790157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:36.790157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:36.790157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:36.790157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:36.790157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:36.790157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:36.790157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:36.790157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:36.790157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:36.790157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:36.790157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:36.797803 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:36.797803 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:36.797803 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:36.797803 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:36.797803 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 324/645] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:36.797803 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb583be-46d0-44c5-9ae3-49b280afb790 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:36.843028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9841ad-4df4-4deb-addb-6ba3016201c8 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:36.889147 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e01ca3-53fe-4397-9cc1-82fbb859057d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:36.890049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e01ca3-53fe-4397-9cc1-82fbb859057d None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:36.890458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e01ca3-53fe-4397-9cc1-82fbb859057d None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:36.890887 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e01ca3-53fe-4397-9cc1-82fbb859057d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:36.903144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e01ca3-53fe-4397-9cc1-82fbb859057d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:36.904800 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e01ca3-53fe-4397-9cc1-82fbb859057d None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:36.930743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-d1e01ca3-53fe-4397-9cc1-82fbb859057d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:36.930743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:36.930743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:36.930743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:36.930743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:36.930743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:36.930743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:36.930743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:36.930743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:36.930743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:36.930743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:36.930743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:36.930743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:36.930743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:36.930743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:36.932775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:36.932775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:36.932775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:36.932775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:36.932775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:36.932775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:36.932775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:36.932775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:36.932775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:36.932775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:36.932775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:36.932775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:36.932775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:36.932775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:36.932775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:36.932775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:36.932775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:36.934534 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:36.934534 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:36.934534 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:36.934534 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:36.934534 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 322/646] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:36.934534 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e01ca3-53fe-4397-9cc1-82fbb859057d None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:36.943622 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb583be-46d0-44c5-9ae3-49b280afb790 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:36.982261 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118fc2a-a905-422b-88c2-a5365d739a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:36.983220 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118fc2a-a905-422b-88c2-a5365d739a77 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:36.983570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118fc2a-a905-422b-88c2-a5365d739a77 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:36.983933 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118fc2a-a905-422b-88c2-a5365d739a77 None admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:36.984855 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118fc2a-a905-422b-88c2-a5365d739a77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:36.985251 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118fc2a-a905-422b-88c2-a5365d739a77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:36.987018 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118fc2a-a905-422b-88c2-a5365d739a77 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:37.003665 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 325/647] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:50:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:37.004792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118fc2a-a905-422b-88c2-a5365d739a77 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:37.059611 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e01ca3-53fe-4397-9cc1-82fbb859057d None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:37.109193 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acc8ea-470f-46e1-8ff5-02898a5d3bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:37.110240 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acc8ea-470f-46e1-8ff5-02898a5d3bb4 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:37.110694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acc8ea-470f-46e1-8ff5-02898a5d3bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:37.111183 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acc8ea-470f-46e1-8ff5-02898a5d3bb4 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:37.112421 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99acc8ea-470f-46e1-8ff5-02898a5d3bb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:37.112863 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99acc8ea-470f-46e1-8ff5-02898a5d3bb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:37.114527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99acc8ea-470f-46e1-8ff5-02898a5d3bb4 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:37.128454 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 323/648] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:37.129531 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acc8ea-470f-46e1-8ff5-02898a5d3bb4 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:37.142711 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118fc2a-a905-422b-88c2-a5365d739a77 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:37.199297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965814ef-16b8-496e-8c11-1ab0ec97ac98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:37.200306 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965814ef-16b8-496e-8c11-1ab0ec97ac98 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:37.200771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965814ef-16b8-496e-8c11-1ab0ec97ac98 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:37.201214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965814ef-16b8-496e-8c11-1ab0ec97ac98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:37.286594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acc8ea-470f-46e1-8ff5-02898a5d3bb4 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:37.308979 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965814ef-16b8-496e-8c11-1ab0ec97ac98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:37.311386 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965814ef-16b8-496e-8c11-1ab0ec97ac98 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:37.340339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6fc4c-e446-4f73-ba04-e1906452e3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:37.341378 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6fc4c-e446-4f73-ba04-e1906452e3b7 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:37.341820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6fc4c-e446-4f73-ba04-e1906452e3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:37.342272 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6fc4c-e446-4f73-ba04-e1906452e3b7 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:37.343535 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6fc4c-e446-4f73-ba04-e1906452e3b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:37.344032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6fc4c-e446-4f73-ba04-e1906452e3b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:37.346111 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6fc4c-e446-4f73-ba04-e1906452e3b7 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:37.366414 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 324/649] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:37.367614 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6fc4c-e446-4f73-ba04-e1906452e3b7 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:37.461175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 326/650] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:50:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:50:37.462574 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965814ef-16b8-496e-8c11-1ab0ec97ac98 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:37.496949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6fc4c-e446-4f73-ba04-e1906452e3b7 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:37.532156 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece3171-a9fa-4c14-ae04-90eef8cfb88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:37.532856 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece3171-a9fa-4c14-ae04-90eef8cfb88f None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:37.533207 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece3171-a9fa-4c14-ae04-90eef8cfb88f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:37.533514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece3171-a9fa-4c14-ae04-90eef8cfb88f None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:37.534400 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece3171-a9fa-4c14-ae04-90eef8cfb88f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:37.534737 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece3171-a9fa-4c14-ae04-90eef8cfb88f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:37.536912 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece3171-a9fa-4c14-ae04-90eef8cfb88f None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:37.550764 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 325/651] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:37.552744 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece3171-a9fa-4c14-ae04-90eef8cfb88f None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:37.614005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965814ef-16b8-496e-8c11-1ab0ec97ac98 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:37.666535 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560b42a-02c0-476b-924c-e29da953302b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:37.667612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560b42a-02c0-476b-924c-e29da953302b None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:37.668076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560b42a-02c0-476b-924c-e29da953302b None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:37.668535 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560b42a-02c0-476b-924c-e29da953302b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:37.669694 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560b42a-02c0-476b-924c-e29da953302b None admin] RBAC: Adding query filter params (role.id=354a460a8146476989f8a7b4fc1aac93, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=52d539202cfb40a48b231713e16a599a) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:37.670210 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560b42a-02c0-476b-924c-e29da953302b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:37.672677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560b42a-02c0-476b-924c-e29da953302b None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:37.682119 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 327/652] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:50:37 2022] GET /identity/v3/role_assignments?user.id=52d539202cfb40a48b231713e16a599a&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=354a460a8146476989f8a7b4fc1aac93 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:37.683040 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560b42a-02c0-476b-924c-e29da953302b None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:37.710860 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece3171-a9fa-4c14-ae04-90eef8cfb88f None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:37.755666 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6954d9e-2e0e-4fa1-a77a-e994984fac9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:37.756388 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6954d9e-2e0e-4fa1-a77a-e994984fac9e None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:37.756667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6954d9e-2e0e-4fa1-a77a-e994984fac9e None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:37.756932 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6954d9e-2e0e-4fa1-a77a-e994984fac9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:37.765216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6954d9e-2e0e-4fa1-a77a-e994984fac9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:37.766762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6954d9e-2e0e-4fa1-a77a-e994984fac9e None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:37.783511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-e6954d9e-2e0e-4fa1-a77a-e994984fac9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:37.783511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:37.783511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:37.783511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:37.783511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:37.783511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:37.783511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:37.783511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:37.783511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:37.783511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:37.783511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:37.783511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:37.783511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:50:37.783511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:50:37.783511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:50:37.784544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:50:37.784544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:37.784544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:37.784544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:37.784544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:37.784544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:37.784544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:37.784544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:37.784544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:37.784544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:37.784544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:37.784544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:37.784544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:37.784544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:37.784544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:37.784544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:37.784544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:37.785442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:50:37.785442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:50:37.785442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:50:37.785442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:50:37.785442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:50:37.785442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:50:37.785442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:37.785442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:37.785442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 326/653] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:37.786331 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6954d9e-2e0e-4fa1-a77a-e994984fac9e None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:37.836246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560b42a-02c0-476b-924c-e29da953302b None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:37.893846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861f880-cab7-472a-9607-e8b6f6e9106f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:37.894479 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861f880-cab7-472a-9607-e8b6f6e9106f None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:37.894767 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861f880-cab7-472a-9607-e8b6f6e9106f None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:37.895103 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861f880-cab7-472a-9607-e8b6f6e9106f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:37.905648 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861f880-cab7-472a-9607-e8b6f6e9106f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:37.907484 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861f880-cab7-472a-9607-e8b6f6e9106f None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:37.923939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-7861f880-cab7-472a-9607-e8b6f6e9106f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 13 14:50:37.923939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:37.923939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:37.923939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:37.923939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:37.923939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:37.923939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:37.923939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:37.923939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:37.923939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:37.923939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:37.923939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:37.923939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:50:37.923939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:50:37.923939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:50:37.923939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:50:37.925804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:37.925804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:37.925804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:50:37.925804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:37.925804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:50:37.925804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:37.925804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:37.925804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:37.925804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:37.925804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:37.925804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:37.925804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:37.925804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:37.925804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:37.925804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:37.925804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:37.925804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:37.925804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:37.931468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:37.931468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:37.931468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:50:37.931468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:50:37.931468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:50:37.931468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:50:37.931468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:50:37.931468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:50:37.931468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 13 14:50:37.931468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:37.931468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 328/654] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:50:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:37.931468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861f880-cab7-472a-9607-e8b6f6e9106f None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:37.938505 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6954d9e-2e0e-4fa1-a77a-e994984fac9e None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:37.991257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685968d4-e3a1-44ae-938b-984841711afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:37.992513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685968d4-e3a1-44ae-938b-984841711afc None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:37.992904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685968d4-e3a1-44ae-938b-984841711afc None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:37.993284 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685968d4-e3a1-44ae-938b-984841711afc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:38.009033 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685968d4-e3a1-44ae-938b-984841711afc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:38.011479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685968d4-e3a1-44ae-938b-984841711afc None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:38.045793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-685968d4-e3a1-44ae-938b-984841711afc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:38.045793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:38.045793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:38.045793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:38.045793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:38.045793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:38.045793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:38.045793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:38.045793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:38.045793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:38.045793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:38.045793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:38.045793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:38.045793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:38.045793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:38.047653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:38.047653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:38.047653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:38.047653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:38.047653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:38.047653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:38.047653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:38.047653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:38.047653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:38.047653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:38.047653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:38.047653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:38.047653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:38.047653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:38.047653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:38.047653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:38.047653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:38.049377 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:38.049377 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:38.049377 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:38.049377 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:38.049377 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 327/655] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:38.049896 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685968d4-e3a1-44ae-938b-984841711afc None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:38.093397 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861f880-cab7-472a-9607-e8b6f6e9106f None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:38.135819 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fea11-7edc-4ec6-ba55-1cc8cbd44ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:38.136954 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fea11-7edc-4ec6-ba55-1cc8cbd44ab9 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:38.137390 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fea11-7edc-4ec6-ba55-1cc8cbd44ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:38.137792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fea11-7edc-4ec6-ba55-1cc8cbd44ab9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:38.147922 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fea11-7edc-4ec6-ba55-1cc8cbd44ab9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:38.149932 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fea11-7edc-4ec6-ba55-1cc8cbd44ab9 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:38.170005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-535fea11-7edc-4ec6-ba55-1cc8cbd44ab9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 13 14:50:38.170005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:38.170005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:38.170005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:38.170005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:38.170005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:38.170005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:38.170005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:38.170005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:38.170005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:38.170005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:38.170005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:38.170005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:50:38.170005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:50:38.170005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:50:38.170005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:50:38.171882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:38.171882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:38.171882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:50:38.171882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:38.171882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:50:38.171882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:38.171882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:38.171882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:38.171882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:38.171882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:38.171882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:38.171882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:38.171882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:38.171882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:38.171882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:38.171882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:38.171882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:38.171882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:38.173712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:38.173712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:38.173712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:50:38.173712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:50:38.173712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:50:38.173712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:50:38.173712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:50:38.173712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:50:38.173712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 13 14:50:38.173712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:38.176879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 329/656] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:50:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:38.178616 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fea11-7edc-4ec6-ba55-1cc8cbd44ab9 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:38.247277 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685968d4-e3a1-44ae-938b-984841711afc None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:38.317225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fea11-7edc-4ec6-ba55-1cc8cbd44ab9 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:38.319378 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a169c7-0d19-4321-9962-392ca12281f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:38.320501 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a169c7-0d19-4321-9962-392ca12281f5 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:38.320994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a169c7-0d19-4321-9962-392ca12281f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:38.321475 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a169c7-0d19-4321-9962-392ca12281f5 None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:38.323038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a169c7-0d19-4321-9962-392ca12281f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:38.323604 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a169c7-0d19-4321-9962-392ca12281f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:38.326769 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a169c7-0d19-4321-9962-392ca12281f5 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:38.346685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 328/657] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:50:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:38.348135 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a169c7-0d19-4321-9962-392ca12281f5 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:38.376802 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5b410-8e2a-43c5-88f4-e45e5f66f93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:38.377865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5b410-8e2a-43c5-88f4-e45e5f66f93f None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:38.378498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5b410-8e2a-43c5-88f4-e45e5f66f93f None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:38.378998 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5b410-8e2a-43c5-88f4-e45e5f66f93f None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:38.380782 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5b410-8e2a-43c5-88f4-e45e5f66f93f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:38.381222 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5b410-8e2a-43c5-88f4-e45e5f66f93f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:38.382797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5b410-8e2a-43c5-88f4-e45e5f66f93f None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:38.411546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 330/658] 10.222.0.73 () {56 vars in 1137 bytes} [Fri May 13 14:50:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:38.411546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5b410-8e2a-43c5-88f4-e45e5f66f93f None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:38.484462 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a169c7-0d19-4321-9962-392ca12281f5 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:38.532002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca416b6d-9149-4438-8fc7-28211b3789f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:38.533030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca416b6d-9149-4438-8fc7-28211b3789f2 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:38.533505 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca416b6d-9149-4438-8fc7-28211b3789f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:38.533910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca416b6d-9149-4438-8fc7-28211b3789f2 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:38.534840 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca416b6d-9149-4438-8fc7-28211b3789f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:38.535342 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca416b6d-9149-4438-8fc7-28211b3789f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:38.537729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca416b6d-9149-4438-8fc7-28211b3789f2 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:38.538800 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5b410-8e2a-43c5-88f4-e45e5f66f93f None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:38.562092 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 329/659] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:38.562092 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca416b6d-9149-4438-8fc7-28211b3789f2 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:38.595436 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6ba7e-cbf1-4562-b726-d44c0a04e9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:38.596341 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6ba7e-cbf1-4562-b726-d44c0a04e9f1 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:38.596755 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6ba7e-cbf1-4562-b726-d44c0a04e9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:38.597172 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6ba7e-cbf1-4562-b726-d44c0a04e9f1 None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:38.598278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6ba7e-cbf1-4562-b726-d44c0a04e9f1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:38.598905 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6ba7e-cbf1-4562-b726-d44c0a04e9f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:38.600863 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6ba7e-cbf1-4562-b726-d44c0a04e9f1 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:38.628255 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 331/660] 10.222.0.73 () {56 vars in 1139 bytes} [Fri May 13 14:50:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:38.629408 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6ba7e-cbf1-4562-b726-d44c0a04e9f1 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:38.677427 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca416b6d-9149-4438-8fc7-28211b3789f2 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:38.730236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995c814-8164-4a76-849e-0ac7cfcc60a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:38.731722 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995c814-8164-4a76-849e-0ac7cfcc60a9 None admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:38.732163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995c814-8164-4a76-849e-0ac7cfcc60a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:38.732603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995c814-8164-4a76-849e-0ac7cfcc60a9 None admin] PATH_INFO: `/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/27265a0c2e6b47c09f28b9cd3ac47d28/roles/354a460a8146476989f8a7b4fc1aac93` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:38.756701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995c814-8164-4a76-849e-0ac7cfcc60a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=48788e7517a14ca5b5af9f161512ac9c, user_id=27265a0c2e6b47c09f28b9cd3ac47d28, role_id=354a460a8146476989f8a7b4fc1aac93)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:38.758984 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995c814-8164-4a76-849e-0ac7cfcc60a9 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:38.782859 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6ba7e-cbf1-4562-b726-d44c0a04e9f1 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:38.783415 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 330/661] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:50:38 2022] PUT /identity/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/27265a0c2e6b47c09f28b9cd3ac47d28/roles/354a460a8146476989f8a7b4fc1aac93 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:50:38.784995 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995c814-8164-4a76-849e-0ac7cfcc60a9 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:38.830239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e1c0c-ca67-474e-ac86-609eea91a0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:38.831558 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e1c0c-ca67-474e-ac86-609eea91a0fa None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:38.832037 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e1c0c-ca67-474e-ac86-609eea91a0fa None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:38.832573 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e1c0c-ca67-474e-ac86-609eea91a0fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:38.921322 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995c814-8164-4a76-849e-0ac7cfcc60a9 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:38.962393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87856b-4f8c-4dbf-a017-a6b7ee0b79b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:38.963214 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87856b-4f8c-4dbf-a017-a6b7ee0b79b2 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:38.963490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87856b-4f8c-4dbf-a017-a6b7ee0b79b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:38.963759 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87856b-4f8c-4dbf-a017-a6b7ee0b79b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:38.971761 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87856b-4f8c-4dbf-a017-a6b7ee0b79b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:38.973237 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87856b-4f8c-4dbf-a017-a6b7ee0b79b2 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:38.980632 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e1c0c-ca67-474e-ac86-609eea91a0fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:38.983274 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e1c0c-ca67-474e-ac86-609eea91a0fa None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:38.988865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-5e87856b-4f8c-4dbf-a017-a6b7ee0b79b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:38.988865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:38.988865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:38.988865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:38.988865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:38.988865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:38.988865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:38.988865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:38.988865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:38.988865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:38.988865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:38.988865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:38.988865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:50:38.988865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:50:38.988865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:50:38.990472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:50:38.990472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:38.990472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:38.990472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:38.990472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:38.990472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:38.990472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:38.990472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:38.990472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:38.990472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:38.990472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:38.990472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:38.990472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:38.990472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:38.990472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:38.990472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:38.990472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:38.991396 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:50:38.991396 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:50:38.991396 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:50:38.991396 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:50:38.991396 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:50:38.991396 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:50:38.991396 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:38.991396 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:38.991396 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 331/662] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:38.997315 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87856b-4f8c-4dbf-a017-a6b7ee0b79b2 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:39.117347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87856b-4f8c-4dbf-a017-a6b7ee0b79b2 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:39.174616 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 332/663] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:50:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:50:39.174616 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e1c0c-ca67-474e-ac86-609eea91a0fa None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:39.179277 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb12fc0-d472-4131-9b02-396fc9b11126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:39.180342 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb12fc0-d472-4131-9b02-396fc9b11126 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:39.180828 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb12fc0-d472-4131-9b02-396fc9b11126 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:39.181313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb12fc0-d472-4131-9b02-396fc9b11126 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:39.261693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb12fc0-d472-4131-9b02-396fc9b11126 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:39.263614 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb12fc0-d472-4131-9b02-396fc9b11126 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:39.373777 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 332/664] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:50:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:50:39.375049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb12fc0-d472-4131-9b02-396fc9b11126 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:39.384184 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e1c0c-ca67-474e-ac86-609eea91a0fa None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:39.448597 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aafafe-9b79-44b3-8609-91047c0f51b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:39.449732 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aafafe-9b79-44b3-8609-91047c0f51b0 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:39.450117 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aafafe-9b79-44b3-8609-91047c0f51b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:39.450606 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aafafe-9b79-44b3-8609-91047c0f51b0 None admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:39.452187 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aafafe-9b79-44b3-8609-91047c0f51b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:39.452748 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aafafe-9b79-44b3-8609-91047c0f51b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:39.455831 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aafafe-9b79-44b3-8609-91047c0f51b0 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:39.487180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 333/665] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:50:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:39.488287 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb12fc0-d472-4131-9b02-396fc9b11126 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:39.488718 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aafafe-9b79-44b3-8609-91047c0f51b0 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:39.528612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f44258-4d68-4dcb-8562-0f1df4b6ec36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:39.530023 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f44258-4d68-4dcb-8562-0f1df4b6ec36 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:39.530585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f44258-4d68-4dcb-8562-0f1df4b6ec36 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:39.531144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f44258-4d68-4dcb-8562-0f1df4b6ec36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:39.545758 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f44258-4d68-4dcb-8562-0f1df4b6ec36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:39.547984 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f44258-4d68-4dcb-8562-0f1df4b6ec36 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:39.569736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-44f44258-4d68-4dcb-8562-0f1df4b6ec36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:39.569736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:39.569736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:39.569736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:39.569736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:39.569736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:39.569736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:39.569736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:39.569736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:39.569736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:39.569736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:39.569736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:39.569736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:39.569736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:39.569736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:39.570705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:39.570705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:39.570705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:39.570705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:39.570705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:39.570705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:39.570705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:39.570705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:39.570705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:39.570705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:39.570705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:39.570705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:39.570705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:39.570705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:39.570705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:39.570705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:39.570705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:39.571716 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:39.571716 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:39.571716 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:39.571716 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:39.574102 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 333/666] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:39.579831 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f44258-4d68-4dcb-8562-0f1df4b6ec36 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:39.690291 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aafafe-9b79-44b3-8609-91047c0f51b0 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:39.720258 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f44258-4d68-4dcb-8562-0f1df4b6ec36 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:39.750686 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5eb6ef-ca07-4907-aefa-13a086f52a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:39.752098 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5eb6ef-ca07-4907-aefa-13a086f52a01 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:39.752567 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5eb6ef-ca07-4907-aefa-13a086f52a01 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:39.753041 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5eb6ef-ca07-4907-aefa-13a086f52a01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:39.772151 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5eb6ef-ca07-4907-aefa-13a086f52a01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:39.774931 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5eb6ef-ca07-4907-aefa-13a086f52a01 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:39.781443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae9f34-0097-47e3-900d-7309d1488ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:39.782471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae9f34-0097-47e3-900d-7309d1488ec9 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:39.783011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae9f34-0097-47e3-900d-7309d1488ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:39.783483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae9f34-0097-47e3-900d-7309d1488ec9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:39.785121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae9f34-0097-47e3-900d-7309d1488ec9 None admin] RBAC: Adding query filter params (role.id=354a460a8146476989f8a7b4fc1aac93, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=6cdd8008619d4ee3b8fe45e0e5241878) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:39.785677 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae9f34-0097-47e3-900d-7309d1488ec9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:39.788971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae9f34-0097-47e3-900d-7309d1488ec9 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:39.800660 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 334/667] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:50:39 2022] GET /identity/v3/role_assignments?user.id=6cdd8008619d4ee3b8fe45e0e5241878&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=354a460a8146476989f8a7b4fc1aac93 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:39.802748 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae9f34-0097-47e3-900d-7309d1488ec9 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:39.822564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-4d5eb6ef-ca07-4907-aefa-13a086f52a01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:39.822564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:39.822564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:39.822564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:39.822564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:39.822564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:39.822564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:39.822564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:39.822564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:39.822564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:39.822564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:39.822564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:39.822564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:39.822564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:39.822564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:39.823969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:39.823969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:39.823969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:39.823969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:39.823969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:39.823969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:39.823969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:39.823969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:39.823969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:39.823969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:39.823969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:39.823969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:39.823969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:39.823969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:39.823969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:39.823969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:39.823969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:39.826195 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:39.826195 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:39.826195 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:39.826195 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:39.826195 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 334/668] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:39.836646 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5eb6ef-ca07-4907-aefa-13a086f52a01 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:40.081644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae9f34-0097-47e3-900d-7309d1488ec9 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:40.149450 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86499d31-34d3-40f9-be3e-4843f351cdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:40.150552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86499d31-34d3-40f9-be3e-4843f351cdf7 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:40.151076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86499d31-34d3-40f9-be3e-4843f351cdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:40.151546 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86499d31-34d3-40f9-be3e-4843f351cdf7 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:40.152862 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86499d31-34d3-40f9-be3e-4843f351cdf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:40.153378 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86499d31-34d3-40f9-be3e-4843f351cdf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:40.155885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86499d31-34d3-40f9-be3e-4843f351cdf7 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:40.178114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 335/669] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:40.184597 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86499d31-34d3-40f9-be3e-4843f351cdf7 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:40.192085 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5eb6ef-ca07-4907-aefa-13a086f52a01 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:40.262506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4c0c8-aad2-49c8-b8a4-65a36f6bc126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:40.263693 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4c0c8-aad2-49c8-b8a4-65a36f6bc126 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:40.264182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4c0c8-aad2-49c8-b8a4-65a36f6bc126 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:40.264662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4c0c8-aad2-49c8-b8a4-65a36f6bc126 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:40.266026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4c0c8-aad2-49c8-b8a4-65a36f6bc126 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:40.266568 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4c0c8-aad2-49c8-b8a4-65a36f6bc126 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:40.269293 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4c0c8-aad2-49c8-b8a4-65a36f6bc126 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:40.299063 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 335/670] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:40.305214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4c0c8-aad2-49c8-b8a4-65a36f6bc126 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:40.384624 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86499d31-34d3-40f9-be3e-4843f351cdf7 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:40.428441 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443315d-7496-42f2-8b59-578c1051a799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:40.429260 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443315d-7496-42f2-8b59-578c1051a799 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:40.429534 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443315d-7496-42f2-8b59-578c1051a799 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:40.429804 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443315d-7496-42f2-8b59-578c1051a799 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:40.440683 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443315d-7496-42f2-8b59-578c1051a799 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:40.443078 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443315d-7496-42f2-8b59-578c1051a799 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:40.460905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-9443315d-7496-42f2-8b59-578c1051a799 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:40.460905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:40.460905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:40.460905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:40.460905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:40.460905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:40.460905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:40.460905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:40.460905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:40.460905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:40.460905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:40.460905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:40.460905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:50:40.460905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:50:40.460905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:50:40.462881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:50:40.462881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:40.462881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:40.462881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:40.462881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:40.462881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:40.462881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:40.462881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:40.462881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:40.462881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:40.462881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:40.462881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:40.462881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:40.462881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:40.462881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:40.462881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:40.462881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:40.463886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:50:40.463886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:50:40.463886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:50:40.463886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:50:40.463886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:50:40.463886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:50:40.463886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:40.463886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:40.463886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 336/671] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:50:40.472389 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443315d-7496-42f2-8b59-578c1051a799 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:40.511668 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4c0c8-aad2-49c8-b8a4-65a36f6bc126 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:40.573477 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb618d35-d0c8-47f4-a19e-c06695a4cd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:40.575075 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb618d35-d0c8-47f4-a19e-c06695a4cd9d None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:40.575229 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb618d35-d0c8-47f4-a19e-c06695a4cd9d None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:40.575621 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb618d35-d0c8-47f4-a19e-c06695a4cd9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:40.589137 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb618d35-d0c8-47f4-a19e-c06695a4cd9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:40.590116 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443315d-7496-42f2-8b59-578c1051a799 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:40.591908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb618d35-d0c8-47f4-a19e-c06695a4cd9d None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:40.619684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-bb618d35-d0c8-47f4-a19e-c06695a4cd9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:40.619684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:40.619684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:40.619684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:40.619684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:40.619684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:40.619684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:40.619684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:40.619684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:40.619684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:40.619684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:40.619684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:40.619684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:50:40.619684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:50:40.619684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:50:40.620830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:50:40.620830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:40.620830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:40.620830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:40.620830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:40.620830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:40.620830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:40.620830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:40.620830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:40.620830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:40.620830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:40.620830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:40.620830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:40.620830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:40.620830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:40.620830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:40.620830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:40.621871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:50:40.621871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:50:40.621871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:50:40.621871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:50:40.621871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:50:40.621871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:50:40.621871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:40.621871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:40.622349 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 336/672] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:40.630187 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb618d35-d0c8-47f4-a19e-c06695a4cd9d None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:40.633858 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cf0e8-5459-44eb-96be-2c553485f153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:40.634916 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cf0e8-5459-44eb-96be-2c553485f153 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:40.635372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cf0e8-5459-44eb-96be-2c553485f153 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:40.635837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cf0e8-5459-44eb-96be-2c553485f153 None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:40.637038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cf0e8-5459-44eb-96be-2c553485f153 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:40.637713 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cf0e8-5459-44eb-96be-2c553485f153 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:40.640766 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cf0e8-5459-44eb-96be-2c553485f153 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:40.655873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 337/673] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:50:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:40.663515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cf0e8-5459-44eb-96be-2c553485f153 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:40.843523 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cf0e8-5459-44eb-96be-2c553485f153 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:40.914864 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174f550-94c4-45ae-a8cf-ba14248cb02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:40.918857 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174f550-94c4-45ae-a8cf-ba14248cb02c None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:40.918857 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174f550-94c4-45ae-a8cf-ba14248cb02c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:40.918857 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174f550-94c4-45ae-a8cf-ba14248cb02c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:40.918857 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174f550-94c4-45ae-a8cf-ba14248cb02c None admin] RBAC: Adding query filter params (role.id=354a460a8146476989f8a7b4fc1aac93, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=343a23610db84b028ccc05e4f876a0c4) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:40.919853 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174f550-94c4-45ae-a8cf-ba14248cb02c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:40.922370 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174f550-94c4-45ae-a8cf-ba14248cb02c None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:40.922606 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb618d35-d0c8-47f4-a19e-c06695a4cd9d None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:40.940008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 338/674] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:50:40 2022] GET /identity/v3/role_assignments?user.id=343a23610db84b028ccc05e4f876a0c4&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=354a460a8146476989f8a7b4fc1aac93 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:50:40.943387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1236f-de4e-4229-85a3-0a106f4ef46b None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:40.943885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1236f-de4e-4229-85a3-0a106f4ef46b None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:40.944325 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1236f-de4e-4229-85a3-0a106f4ef46b None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:40.950913 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 339/675] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:40.960472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd928e8-168e-49a3-a61d-bab24c9245fd None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:40.962111 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd928e8-168e-49a3-a61d-bab24c9245fd None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:40.962912 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd928e8-168e-49a3-a61d-bab24c9245fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:41.023901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-2bd928e8-168e-49a3-a61d-bab24c9245fd None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:41.026476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503677d-f099-4670-b9ee-2ccce1486f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:41.027659 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503677d-f099-4670-b9ee-2ccce1486f40 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:41.028137 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503677d-f099-4670-b9ee-2ccce1486f40 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:41.028635 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503677d-f099-4670-b9ee-2ccce1486f40 None admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:41.031883 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-2bd928e8-168e-49a3-a61d-bab24c9245fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:41.033576 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503677d-f099-4670-b9ee-2ccce1486f40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:41.034095 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503677d-f099-4670-b9ee-2ccce1486f40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:41.037488 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503677d-f099-4670-b9ee-2ccce1486f40 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:41.083604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 337/676] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:50:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:50:41.093388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503677d-f099-4670-b9ee-2ccce1486f40 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:41.199816 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 340/677] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:41.245167 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd928e8-168e-49a3-a61d-bab24c9245fd None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:41.320997 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503677d-f099-4670-b9ee-2ccce1486f40 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:41.390103 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2b110-c627-4a61-b6fd-da95d645da7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:41.391912 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2b110-c627-4a61-b6fd-da95d645da7f None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:41.392721 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2b110-c627-4a61-b6fd-da95d645da7f None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:41.393474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2b110-c627-4a61-b6fd-da95d645da7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:41.395564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2b110-c627-4a61-b6fd-da95d645da7f None admin] RBAC: Adding query filter params (role.id=354a460a8146476989f8a7b4fc1aac93, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=ee97a542470644f89cd665dfdf2f9e92) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:41.396504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2b110-c627-4a61-b6fd-da95d645da7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:41.399698 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2b110-c627-4a61-b6fd-da95d645da7f None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:41.412667 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 338/678] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:50:41 2022] GET /identity/v3/role_assignments?user.id=ee97a542470644f89cd665dfdf2f9e92&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=354a460a8146476989f8a7b4fc1aac93 => generated 608 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:50:41.421888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd928e8-168e-49a3-a61d-bab24c9245fd None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:41.488820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4017a-5c89-43e1-944e-a99a01212ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:41.490618 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4017a-5c89-43e1-944e-a99a01212ad4 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:41.491164 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4017a-5c89-43e1-944e-a99a01212ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:41.491654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4017a-5c89-43e1-944e-a99a01212ad4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:41.510635 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4017a-5c89-43e1-944e-a99a01212ad4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:41.525163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-45a4017a-5c89-43e1-944e-a99a01212ad4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:50:41.525163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:41.525163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:41.525163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:41.525163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:41.525163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:41.525163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:41.525163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:41.525163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:41.525163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:41.525163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:41.525163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:41.525163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:41.525163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:41.525163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:41.525163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:41.527189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:41.527189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:41.527189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:41.527189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:41.527189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:41.527189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:41.527189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:41.527189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:41.527189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:41.527189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:41.527189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:41.527189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:41.527189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:41.527189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:41.527189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:41.527189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:41.528873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:41.528873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:41.528873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:41.528873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:41.528873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:41.528873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:41.528873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:41.528873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:41.528873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:41.528873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:41.528873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:50:41.528873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:41.528873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 341/679] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:50:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:50:41.537526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2b110-c627-4a61-b6fd-da95d645da7f None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:41.709772 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2b110-c627-4a61-b6fd-da95d645da7f None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:41.772462 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf7407-0f40-4c73-b08a-4e3dff2bab5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:41.773336 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf7407-0f40-4c73-b08a-4e3dff2bab5e None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:41.773784 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf7407-0f40-4c73-b08a-4e3dff2bab5e None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:41.774222 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf7407-0f40-4c73-b08a-4e3dff2bab5e None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:41.775592 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf7407-0f40-4c73-b08a-4e3dff2bab5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:41.776085 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf7407-0f40-4c73-b08a-4e3dff2bab5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:41.778404 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf7407-0f40-4c73-b08a-4e3dff2bab5e None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:41.798918 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 339/680] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:50:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:41.803395 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4017a-5c89-43e1-944e-a99a01212ad4 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:41.987450 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e31cf0-872b-45f3-b501-bd0bd294fdfc None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:41.988246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e31cf0-872b-45f3-b501-bd0bd294fdfc None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:41.988246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e31cf0-872b-45f3-b501-bd0bd294fdfc None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:41.992395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 340/681] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:41.999865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a0881-8889-4501-ac73-d99fa797ab6c None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:42.000287 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a0881-8889-4501-ac73-d99fa797ab6c None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:42.000524 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a0881-8889-4501-ac73-d99fa797ab6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:42.026286 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4017a-5c89-43e1-944e-a99a01212ad4 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:42.027618 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-f33a0881-8889-4501-ac73-d99fa797ab6c None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:42.028847 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-f33a0881-8889-4501-ac73-d99fa797ab6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:42.095788 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1d474-f86b-418d-aa5a-2d933b6caa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:42.097067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1d474-f86b-418d-aa5a-2d933b6caa08 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:42.097539 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1d474-f86b-418d-aa5a-2d933b6caa08 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:42.097981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1d474-f86b-418d-aa5a-2d933b6caa08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:42.115617 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 341/682] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:42.120340 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1d474-f86b-418d-aa5a-2d933b6caa08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:42.123429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1d474-f86b-418d-aa5a-2d933b6caa08 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:42.158082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-3ec1d474-f86b-418d-aa5a-2d933b6caa08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:42.158082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:42.158082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:42.158082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:42.158082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:42.158082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:42.158082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:42.158082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:42.158082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:42.158082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:42.158082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:42.158082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:42.158082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:42.158082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:42.158082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:42.159845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:42.159845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:42.159845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:42.159845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:42.159845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:42.159845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:42.159845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:42.159845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:42.159845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:42.159845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:42.159845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:42.159845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:42.159845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:42.159845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:42.159845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:42.159845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:42.159845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:42.161823 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:42.161823 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:42.161823 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:42.161823 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:42.161823 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 342/683] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:50:42.166889 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a0881-8889-4501-ac73-d99fa797ab6c None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:42.178498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1d474-f86b-418d-aa5a-2d933b6caa08 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:42.367376 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a0881-8889-4501-ac73-d99fa797ab6c None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:42.381901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1d474-f86b-418d-aa5a-2d933b6caa08 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:42.432603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1acb9-bbeb-403f-86e4-1c556260789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:42.433289 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1acb9-bbeb-403f-86e4-1c556260789c None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:42.433570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1acb9-bbeb-403f-86e4-1c556260789c None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:42.433895 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1acb9-bbeb-403f-86e4-1c556260789c None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:42.434634 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1acb9-bbeb-403f-86e4-1c556260789c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:42.437870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1acb9-bbeb-403f-86e4-1c556260789c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:42.440368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1acb9-bbeb-403f-86e4-1c556260789c None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:42.458886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01bad4-9d0c-4802-9ef4-582eedb9fa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:42.460254 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01bad4-9d0c-4802-9ef4-582eedb9fa92 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:42.460735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01bad4-9d0c-4802-9ef4-582eedb9fa92 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:42.461215 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01bad4-9d0c-4802-9ef4-582eedb9fa92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:42.484272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 342/684] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:50:42.490528 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1acb9-bbeb-403f-86e4-1c556260789c None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:42.492153 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01bad4-9d0c-4802-9ef4-582eedb9fa92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:42.517021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-2a01bad4-9d0c-4802-9ef4-582eedb9fa92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:42.517021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:42.517021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:42.517021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:42.517021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:42.517021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:42.517021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:42.517021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:42.517021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:42.517021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:42.517021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:42.517021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:42.517021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:42.517021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:42.517021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:42.517021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:42.521068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:42.521068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:42.521068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:42.521068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:42.521068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:42.521068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:42.521068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:42.521068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:42.521068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:42.521068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:42.521068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:42.521068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:42.521068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:42.521068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:42.521068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:42.521068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:42.524247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:42.524247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:42.524247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:42.524247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:42.524247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:42.524247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:42.524247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:42.524247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:42.524247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:42.524247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:42.524247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:42.524247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:42.533149 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 343/685] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:50:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:50:42.536097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01bad4-9d0c-4802-9ef4-582eedb9fa92 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:42.764659 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1acb9-bbeb-403f-86e4-1c556260789c None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:42.775740 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01bad4-9d0c-4802-9ef4-582eedb9fa92 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:42.829142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b63ce-7c08-4d46-9a78-28758918b6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:42.829946 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b63ce-7c08-4d46-9a78-28758918b6f3 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:42.830196 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b63ce-7c08-4d46-9a78-28758918b6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:42.830472 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b63ce-7c08-4d46-9a78-28758918b6f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:42.841076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733edf9-b6f3-4c06-aa0e-02e9bd3c8e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:42.842273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733edf9-b6f3-4c06-aa0e-02e9bd3c8e79 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:42.842757 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733edf9-b6f3-4c06-aa0e-02e9bd3c8e79 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:42.843270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733edf9-b6f3-4c06-aa0e-02e9bd3c8e79 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:42.843618 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b63ce-7c08-4d46-9a78-28758918b6f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:42.844676 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733edf9-b6f3-4c06-aa0e-02e9bd3c8e79 None admin] RBAC: Adding query filter params (name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:42.845093 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b63ce-7c08-4d46-9a78-28758918b6f3 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:42.845343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733edf9-b6f3-4c06-aa0e-02e9bd3c8e79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:42.848015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733edf9-b6f3-4c06-aa0e-02e9bd3c8e79 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:42.870982 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 344/686] 10.222.0.73 () {56 vars in 1103 bytes} [Fri May 13 14:50:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:42.874508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733edf9-b6f3-4c06-aa0e-02e9bd3c8e79 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:42.878972 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-6a7b63ce-7c08-4d46-9a78-28758918b6f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 14:50:42.878972 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:42.878972 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:42.878972 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:42.878972 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:42.878972 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:42.878972 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:42.878972 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:42.878972 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:42.878972 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:42.878972 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:42.878972 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:42.878972 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:50:42.878972 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:50:42.878972 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:50:42.878972 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:50:42.882731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:42.882731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:42.882731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:50:42.882731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:42.882731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:50:42.882731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:42.882731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:42.882731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:42.882731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:42.882731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:42.882731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:42.882731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:42.882731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:42.882731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:42.882731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:42.882731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:42.882731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:42.882731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:42.885790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:42.885790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:42.885790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:50:42.885790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:50:42.885790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:50:42.885790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:50:42.885790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:50:42.885790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:50:42.885790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 14:50:42.885790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:42.885790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 343/687] 10.222.0.73 () {56 vars in 1093 bytes} [Fri May 13 14:50:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:42.894885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b63ce-7c08-4d46-9a78-28758918b6f3 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:43.011086 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b63ce-7c08-4d46-9a78-28758918b6f3 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:43.066950 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338db67-439f-45a0-a63a-c323ee03a9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:43.066950 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338db67-439f-45a0-a63a-c323ee03a9d8 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:43.066950 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338db67-439f-45a0-a63a-c323ee03a9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:43.066950 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338db67-439f-45a0-a63a-c323ee03a9d8 None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:43.067684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338db67-439f-45a0-a63a-c323ee03a9d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:43.067684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338db67-439f-45a0-a63a-c323ee03a9d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:43.067684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338db67-439f-45a0-a63a-c323ee03a9d8 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:43.105623 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 344/688] 10.222.0.73 () {56 vars in 1133 bytes} [Fri May 13 14:50:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:43.123639 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338db67-439f-45a0-a63a-c323ee03a9d8 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:43.252943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733edf9-b6f3-4c06-aa0e-02e9bd3c8e79 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:43.316094 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338db67-439f-45a0-a63a-c323ee03a9d8 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:43.330613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a5fc6-af68-4679-a97d-2e4fdc2f5ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:43.331458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a5fc6-af68-4679-a97d-2e4fdc2f5ee0 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:43.331783 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a5fc6-af68-4679-a97d-2e4fdc2f5ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:43.332638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a5fc6-af68-4679-a97d-2e4fdc2f5ee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:43.354903 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a5fc6-af68-4679-a97d-2e4fdc2f5ee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:43.356385 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a5fc6-af68-4679-a97d-2e4fdc2f5ee0 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:43.393573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-fb9a5fc6-af68-4679-a97d-2e4fdc2f5ee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:43.393573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:43.393573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:43.393573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:43.393573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:43.393573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:43.393573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:43.393573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:43.393573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:43.393573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:43.393573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:43.393573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:43.393573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:43.393573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:43.393573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:43.395364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:43.395364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:43.395364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:43.395364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:43.395364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:43.395364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:43.395364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:43.395364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:43.395364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:43.395364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:43.395364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:43.395364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:43.395364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:43.395364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:43.395364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:43.395364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:43.395364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:43.399086 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:43.399086 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:43.399086 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:43.399086 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:43.399086 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 345/689] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 524 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:43.404778 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a5fc6-af68-4679-a97d-2e4fdc2f5ee0 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:43.406350 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ee89a-9731-4020-90c9-7802079c2d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:43.407083 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ee89a-9731-4020-90c9-7802079c2d6c None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:43.407356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ee89a-9731-4020-90c9-7802079c2d6c None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:43.407599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ee89a-9731-4020-90c9-7802079c2d6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:43.590175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ee89a-9731-4020-90c9-7802079c2d6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:43.592982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ee89a-9731-4020-90c9-7802079c2d6c None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:43.706623 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a5fc6-af68-4679-a97d-2e4fdc2f5ee0 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:43.822511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5b43c-8275-4f5b-a1af-115b7714aa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:43.823458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5b43c-8275-4f5b-a1af-115b7714aa58 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:43.826868 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5b43c-8275-4f5b-a1af-115b7714aa58 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:43.826868 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5b43c-8275-4f5b-a1af-115b7714aa58 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:43.826868 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5b43c-8275-4f5b-a1af-115b7714aa58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:43.826868 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5b43c-8275-4f5b-a1af-115b7714aa58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:43.826868 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5b43c-8275-4f5b-a1af-115b7714aa58 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:43.862659 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 345/690] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:50:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:50:43.873705 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ee89a-9731-4020-90c9-7802079c2d6c None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:43.878992 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 346/691] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:43.893173 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5b43c-8275-4f5b-a1af-115b7714aa58 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:44.064681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ee89a-9731-4020-90c9-7802079c2d6c None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:44.163327 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8619a92-90c5-437d-9a28-8cf389f9fefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:44.164108 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8619a92-90c5-437d-9a28-8cf389f9fefc None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:44.164392 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8619a92-90c5-437d-9a28-8cf389f9fefc None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:44.167118 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8619a92-90c5-437d-9a28-8cf389f9fefc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:44.174896 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5b43c-8275-4f5b-a1af-115b7714aa58 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:44.194207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8619a92-90c5-437d-9a28-8cf389f9fefc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:44.196119 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8619a92-90c5-437d-9a28-8cf389f9fefc None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:44.233278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-c8619a92-90c5-437d-9a28-8cf389f9fefc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:44.233278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:44.233278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:44.233278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:44.233278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:44.233278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:44.233278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:44.233278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:44.233278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:44.233278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:44.233278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:44.233278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:44.233278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:44.233278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:44.233278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:44.235248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:44.235248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:44.235248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:44.235248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:44.235248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:44.235248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:44.235248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:44.235248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:44.235248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:44.235248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:44.235248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:44.235248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:44.235248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:44.235248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:44.235248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:44.235248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:44.235248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:44.237582 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:44.237582 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:44.237582 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:44.237582 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:44.237582 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 346/692] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:44.245257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8619a92-90c5-437d-9a28-8cf389f9fefc None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:44.267255 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4df48a-251d-4b4c-b16a-898658fe137b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:44.268087 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4df48a-251d-4b4c-b16a-898658fe137b None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:44.268415 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4df48a-251d-4b4c-b16a-898658fe137b None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:44.268718 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4df48a-251d-4b4c-b16a-898658fe137b None admin] PATH_INFO: `/v3/users/swift` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:44.283584 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4df48a-251d-4b4c-b16a-898658fe137b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:44.285693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4df48a-251d-4b4c-b16a-898658fe137b None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:44.316024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-9b4df48a-251d-4b4c-b16a-898658fe137b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 14:50:44.316024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:44.316024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:44.316024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:44.316024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:44.316024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:44.316024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:44.316024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:44.316024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:44.316024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:44.316024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:44.316024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:44.316024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:50:44.316024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:50:44.316024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:50:44.316024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:50:44.318490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:44.318490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:44.318490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:50:44.318490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:44.318490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:50:44.318490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:44.318490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:44.318490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:44.318490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:44.318490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:44.318490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:44.318490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:44.318490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:44.318490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:44.318490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:44.318490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:44.318490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:44.318490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:44.320477 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:44.320477 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:44.320477 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:50:44.320477 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:50:44.320477 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:50:44.320477 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:50:44.320477 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:50:44.320477 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:50:44.320477 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 14:50:44.320477 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:44.320477 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 347/693] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:50:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:44.331257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4df48a-251d-4b4c-b16a-898658fe137b None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:44.428456 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8619a92-90c5-437d-9a28-8cf389f9fefc None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:44.469892 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679779e4-5a79-470f-9e98-eea18b8bc0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:44.470586 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679779e4-5a79-470f-9e98-eea18b8bc0a2 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:44.470897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679779e4-5a79-470f-9e98-eea18b8bc0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:44.471178 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679779e4-5a79-470f-9e98-eea18b8bc0a2 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:44.471927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679779e4-5a79-470f-9e98-eea18b8bc0a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:44.472231 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679779e4-5a79-470f-9e98-eea18b8bc0a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:44.474505 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679779e4-5a79-470f-9e98-eea18b8bc0a2 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:44.488930 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 347/694] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:44.499911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679779e4-5a79-470f-9e98-eea18b8bc0a2 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:44.574348 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4df48a-251d-4b4c-b16a-898658fe137b None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:44.633928 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2b784-9891-4907-ac96-933b8789ff67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:44.635029 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2b784-9891-4907-ac96-933b8789ff67 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:44.635495 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2b784-9891-4907-ac96-933b8789ff67 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:44.635977 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2b784-9891-4907-ac96-933b8789ff67 None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:44.637786 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2b784-9891-4907-ac96-933b8789ff67 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:44.637990 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2b784-9891-4907-ac96-933b8789ff67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:44.640516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2b784-9891-4907-ac96-933b8789ff67 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:44.677235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 348/695] 10.222.0.73 () {56 vars in 1135 bytes} [Fri May 13 14:50:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:44.677235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436d685-b73b-4369-8158-29fd09f88e44 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:44.677235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436d685-b73b-4369-8158-29fd09f88e44 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:44.677235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436d685-b73b-4369-8158-29fd09f88e44 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:44.685014 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 349/696] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:44.692090 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436d685-b73b-4369-8158-29fd09f88e44 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:44.731441 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679779e4-5a79-470f-9e98-eea18b8bc0a2 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:44.795486 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786db75a-d10a-4d40-a15b-d1c66e48d36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:44.797232 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786db75a-d10a-4d40-a15b-d1c66e48d36e None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:44.798118 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786db75a-d10a-4d40-a15b-d1c66e48d36e None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:44.798870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786db75a-d10a-4d40-a15b-d1c66e48d36e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:44.811914 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786db75a-d10a-4d40-a15b-d1c66e48d36e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:44.815140 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786db75a-d10a-4d40-a15b-d1c66e48d36e None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:44.843365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-786db75a-d10a-4d40-a15b-d1c66e48d36e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:44.843365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:44.843365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:44.843365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:44.843365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:44.843365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:44.843365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:44.843365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:44.843365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:44.843365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:44.843365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:44.843365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:44.843365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:50:44.843365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:50:44.843365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:50:44.845250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:50:44.845250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:44.845250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:44.845250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:44.845250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:44.845250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:44.845250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:44.845250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:44.845250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:44.845250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:44.845250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:44.845250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:44.845250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:44.845250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:44.845250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:44.845250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:44.845250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:44.855236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:50:44.855236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:50:44.855236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:50:44.855236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:50:44.855236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:50:44.855236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:50:44.855236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:44.855236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:44.855236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 348/697] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:50:44.855236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9586df-a13b-4176-9582-e60f8f419684 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:44.855236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9586df-a13b-4176-9582-e60f8f419684 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:44.857265 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9586df-a13b-4176-9582-e60f8f419684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:44.874495 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436d685-b73b-4369-8158-29fd09f88e44 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:44.877227 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-0d9586df-a13b-4176-9582-e60f8f419684 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:44.878992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-0d9586df-a13b-4176-9582-e60f8f419684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:44.932703 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6c2fd-7ccd-4a18-b817-58d0fcb3514a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:44.933371 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6c2fd-7ccd-4a18-b817-58d0fcb3514a None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:44.933649 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6c2fd-7ccd-4a18-b817-58d0fcb3514a None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:44.933921 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6c2fd-7ccd-4a18-b817-58d0fcb3514a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:45.008692 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 349/698] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:45.010726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d93cb-d5e3-4b3c-b023-c207023b9a49 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:45.011248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d93cb-d5e3-4b3c-b023-c207023b9a49 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:45.011724 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d93cb-d5e3-4b3c-b023-c207023b9a49 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:45.018875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 350/699] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:45.018875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d93cb-d5e3-4b3c-b023-c207023b9a49 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:45.034843 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6c2fd-7ccd-4a18-b817-58d0fcb3514a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:45.038333 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6c2fd-7ccd-4a18-b817-58d0fcb3514a None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:45.166206 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d93cb-d5e3-4b3c-b023-c207023b9a49 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:45.221141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f0288-37bb-4594-b954-82f56d113c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:45.222204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f0288-37bb-4594-b954-82f56d113c99 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:45.222680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f0288-37bb-4594-b954-82f56d113c99 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:45.223152 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f0288-37bb-4594-b954-82f56d113c99 None admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:45.225081 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f0288-37bb-4594-b954-82f56d113c99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:45.225589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f0288-37bb-4594-b954-82f56d113c99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:45.228098 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f0288-37bb-4594-b954-82f56d113c99 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:45.238449 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 350/700] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:50:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 14:50:45.241843 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc193994-e6d7-4fe6-b221-046cdda15876 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:45.242542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc193994-e6d7-4fe6-b221-046cdda15876 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:45.243786 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc193994-e6d7-4fe6-b221-046cdda15876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:45.248664 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 351/701] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:50:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:45.250128 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f0288-37bb-4594-b954-82f56d113c99 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:45.268965 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-fc193994-e6d7-4fe6-b221-046cdda15876 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:45.272061 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-fc193994-e6d7-4fe6-b221-046cdda15876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:45.390865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 351/702] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:45.390865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc193994-e6d7-4fe6-b221-046cdda15876 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:45.424071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f0288-37bb-4594-b954-82f56d113c99 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:45.485133 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999907f3-32e9-41ee-8b45-d511107d69ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:45.486486 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999907f3-32e9-41ee-8b45-d511107d69ab None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:45.487046 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999907f3-32e9-41ee-8b45-d511107d69ab None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:45.487526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999907f3-32e9-41ee-8b45-d511107d69ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:45.506779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc193994-e6d7-4fe6-b221-046cdda15876 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:45.507499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999907f3-32e9-41ee-8b45-d511107d69ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:45.510166 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999907f3-32e9-41ee-8b45-d511107d69ab None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:45.542794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-999907f3-32e9-41ee-8b45-d511107d69ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:45.542794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:45.542794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:45.542794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:45.542794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:45.542794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:45.542794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:45.542794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:45.542794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:45.542794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:45.542794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:45.542794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:45.542794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:45.542794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:45.542794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:45.543777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:45.543777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:45.543777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:45.543777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:45.543777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:45.543777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:45.543777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:45.543777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:45.543777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:45.543777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:45.543777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:45.543777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:45.543777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:45.543777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:45.543777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:45.543777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:45.543777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:45.544661 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:45.544661 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:45.544661 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:45.544661 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:45.544890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8ad0d-0ea9-469c-9698-9a08df97aadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:45.544890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8ad0d-0ea9-469c-9698-9a08df97aadc None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:45.544890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8ad0d-0ea9-469c-9698-9a08df97aadc None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:45.544890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8ad0d-0ea9-469c-9698-9a08df97aadc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:45.545140 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 352/703] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:45.546416 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999907f3-32e9-41ee-8b45-d511107d69ab None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:45.557448 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8ad0d-0ea9-469c-9698-9a08df97aadc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:45.559034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8ad0d-0ea9-469c-9698-9a08df97aadc None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:45.579305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-e2d8ad0d-0ea9-469c-9698-9a08df97aadc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:45.579305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:45.579305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:45.579305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:45.579305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:45.579305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:45.579305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:45.579305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:45.579305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:45.579305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:45.579305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:45.579305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:45.579305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:45.579305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:45.579305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:45.581077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:45.581077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:45.581077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:45.581077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:45.581077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:45.581077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:45.581077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:45.581077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:45.581077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:45.581077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:45.581077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:45.581077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:45.581077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:45.581077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:45.581077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:45.581077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:45.581077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:45.582880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:45.582880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:45.582880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:45.582880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:45.582880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 352/704] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:45.582880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559f1ab-ddc6-4516-8dc1-071ff7d6a829 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:45.582880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559f1ab-ddc6-4516-8dc1-071ff7d6a829 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:45.582880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559f1ab-ddc6-4516-8dc1-071ff7d6a829 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:45.589764 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 353/705] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:45.589764 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559f1ab-ddc6-4516-8dc1-071ff7d6a829 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:45.695993 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999907f3-32e9-41ee-8b45-d511107d69ab None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:45.722100 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559f1ab-ddc6-4516-8dc1-071ff7d6a829 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:45.733377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b282cf-aae1-474f-9992-c656fc170471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:45.734461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b282cf-aae1-474f-9992-c656fc170471 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:45.734994 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b282cf-aae1-474f-9992-c656fc170471 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:45.735486 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b282cf-aae1-474f-9992-c656fc170471 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:45.737018 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b282cf-aae1-474f-9992-c656fc170471 None admin] RBAC: Adding query filter params (role.id=b6fbf976763d4795afbfb53a09ec6f6c, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=52d539202cfb40a48b231713e16a599a) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:45.737563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b282cf-aae1-474f-9992-c656fc170471 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:45.740823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b282cf-aae1-474f-9992-c656fc170471 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:45.750913 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 353/706] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:50:45 2022] GET /identity/v3/role_assignments?user.id=52d539202cfb40a48b231713e16a599a&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=b6fbf976763d4795afbfb53a09ec6f6c => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:45.752580 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b282cf-aae1-474f-9992-c656fc170471 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:45.762147 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc09feb-d4ce-4394-bce9-67bed626dad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:45.763288 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc09feb-d4ce-4394-bce9-67bed626dad0 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:45.763570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc09feb-d4ce-4394-bce9-67bed626dad0 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:45.763841 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc09feb-d4ce-4394-bce9-67bed626dad0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:45.764521 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc09feb-d4ce-4394-bce9-67bed626dad0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:45.765983 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc09feb-d4ce-4394-bce9-67bed626dad0 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:45.781608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-0bc09feb-d4ce-4394-bce9-67bed626dad0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 14:50:45.781608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:45.781608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:50:45.781608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:50:45.781608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:50:45.781608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:50:45.781608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:50:45.781608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:50:45.781608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 14:50:45.781608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:45.781608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:50:45.781608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:45.781608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:45.781608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:45.781608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:45.781608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:45.791762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:45.791762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:45.791762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:45.791762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:45.791762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:45.791762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:45.791762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:45.791762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:50:45.791762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:50:45.791762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:50:45.791762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:50:45.791762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:45.791762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:45.791762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:45.791762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:45.791762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:45.793347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:45.793347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:45.793347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:45.793347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:45.793347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:45.793347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:45.793347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:45.793347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:45.793347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:45.793347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:45.793347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:45.793347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:50:45.793347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:50:45.793347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 14:50:45.793347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:45.793347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 354/707] 10.222.0.73 () {56 vars in 1129 bytes} [Fri May 13 14:50:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:45.795722 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc09feb-d4ce-4394-bce9-67bed626dad0 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:45.912869 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b282cf-aae1-474f-9992-c656fc170471 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:45.958634 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc09feb-d4ce-4394-bce9-67bed626dad0 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:45.964040 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a3fc0-79d3-42eb-94d4-5b143c655f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:45.965276 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a3fc0-79d3-42eb-94d4-5b143c655f0a None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:45.965782 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a3fc0-79d3-42eb-94d4-5b143c655f0a None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:45.966276 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a3fc0-79d3-42eb-94d4-5b143c655f0a None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:45.967982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a3fc0-79d3-42eb-94d4-5b143c655f0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:45.968582 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a3fc0-79d3-42eb-94d4-5b143c655f0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:45.971304 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a3fc0-79d3-42eb-94d4-5b143c655f0a None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:45.994961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 354/708] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:45.994961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c0ae3-1f3f-4bd1-9eec-cd132213ecab None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:45.994961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c0ae3-1f3f-4bd1-9eec-cd132213ecab None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:45.994961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c0ae3-1f3f-4bd1-9eec-cd132213ecab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:46.021215 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-542c0ae3-1f3f-4bd1-9eec-cd132213ecab None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:46.022900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-542c0ae3-1f3f-4bd1-9eec-cd132213ecab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:46.024935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c99db-46d2-4a56-9e78-88e606e34964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:46.025900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c99db-46d2-4a56-9e78-88e606e34964 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:46.026431 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c99db-46d2-4a56-9e78-88e606e34964 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:46.027009 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c99db-46d2-4a56-9e78-88e606e34964 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:46.028263 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c99db-46d2-4a56-9e78-88e606e34964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:46.028804 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c99db-46d2-4a56-9e78-88e606e34964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:46.031253 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c99db-46d2-4a56-9e78-88e606e34964 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:46.054695 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 355/709] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:46.055447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c99db-46d2-4a56-9e78-88e606e34964 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:46.138859 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 355/710] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:46.138859 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c0ae3-1f3f-4bd1-9eec-cd132213ecab None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:46.205187 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c99db-46d2-4a56-9e78-88e606e34964 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:46.246496 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0269314-8d18-44d2-8704-25cc5731186b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:46.247504 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0269314-8d18-44d2-8704-25cc5731186b None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:46.247908 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0269314-8d18-44d2-8704-25cc5731186b None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:46.248347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0269314-8d18-44d2-8704-25cc5731186b None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:46.249199 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0269314-8d18-44d2-8704-25cc5731186b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:46.249670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0269314-8d18-44d2-8704-25cc5731186b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:46.251337 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0269314-8d18-44d2-8704-25cc5731186b None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:46.262932 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 356/711] 10.222.0.73 () {56 vars in 1124 bytes} [Fri May 13 14:50:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:46.262932 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0269314-8d18-44d2-8704-25cc5731186b None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:46.311718 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c0ae3-1f3f-4bd1-9eec-cd132213ecab None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:46.355909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1235d-33ca-43ad-886d-4543400b3c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:46.356861 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1235d-33ca-43ad-886d-4543400b3c00 None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:46.357306 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1235d-33ca-43ad-886d-4543400b3c00 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:46.357737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1235d-33ca-43ad-886d-4543400b3c00 None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:46.358592 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1235d-33ca-43ad-886d-4543400b3c00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:46.360276 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1235d-33ca-43ad-886d-4543400b3c00 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:46.383652 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 356/712] 10.222.0.73 () {60 vars in 1132 bytes} [Fri May 13 14:50:46 2022] POST /identity/v3/users => generated 254 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:50:46.384756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1235d-33ca-43ad-886d-4543400b3c00 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:46.434451 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0269314-8d18-44d2-8704-25cc5731186b None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:46.476247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e066a-5b05-4cc0-bc09-37711edb7df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:46.477061 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e066a-5b05-4cc0-bc09-37711edb7df4 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:46.477336 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e066a-5b05-4cc0-bc09-37711edb7df4 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:46.477603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e066a-5b05-4cc0-bc09-37711edb7df4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:46.489832 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e066a-5b05-4cc0-bc09-37711edb7df4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:46.493067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e066a-5b05-4cc0-bc09-37711edb7df4 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:46.522017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-4e3e066a-5b05-4cc0-bc09-37711edb7df4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:46.522017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:46.522017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:46.522017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:46.522017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:46.522017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:46.522017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:46.522017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:46.522017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:46.522017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:46.522017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:46.522017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:46.522017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:50:46.522017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:50:46.522017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:50:46.524015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:50:46.524015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:46.524015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:46.524015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:46.524015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:46.524015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:46.524015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:46.524015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:46.524015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:46.524015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:46.524015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:46.524015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:46.524015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:46.524015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:46.524015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:46.524015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:46.524015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:46.525959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:50:46.525959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:50:46.525959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:50:46.525959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:50:46.525959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:50:46.525959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:50:46.525959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:46.525959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:46.535445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 357/713] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:46.537691 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e066a-5b05-4cc0-bc09-37711edb7df4 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:46.542106 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1235d-33ca-43ad-886d-4543400b3c00 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:46.582115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0c9b1-a4db-47f3-9f1a-943b7e5faba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:46.583432 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0c9b1-a4db-47f3-9f1a-943b7e5faba6 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:46.583716 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0c9b1-a4db-47f3-9f1a-943b7e5faba6 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:46.583990 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0c9b1-a4db-47f3-9f1a-943b7e5faba6 None admin] PATH_INFO: `/v3/services/network` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:46.584660 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0c9b1-a4db-47f3-9f1a-943b7e5faba6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:46.586759 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0c9b1-a4db-47f3-9f1a-943b7e5faba6 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:46.601363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-85e0c9b1-a4db-47f3-9f1a-943b7e5faba6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 13 14:50:46.601363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:46.601363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:50:46.601363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:50:46.601363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:50:46.601363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:50:46.601363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:50:46.601363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:50:46.601363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 14:50:46.601363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:46.601363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:50:46.601363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:46.601363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:46.601363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:46.601363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:46.601363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:46.601363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:46.603604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:46.603604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:46.603604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:46.603604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:46.603604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:46.603604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:46.603604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:50:46.603604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:50:46.603604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:50:46.603604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:50:46.603604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:46.603604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:46.603604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:46.603604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:46.603604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:46.603604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:46.605474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:46.605474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:46.605474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:46.605474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:46.605474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:46.605474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:46.605474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:46.605474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:46.605474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:46.605474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:46.605474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:50:46.605474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:50:46.605474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 14:50:46.605474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:46.605474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 357/714] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:46 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:46.607422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0c9b1-a4db-47f3-9f1a-943b7e5faba6 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:46.745266 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e066a-5b05-4cc0-bc09-37711edb7df4 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:46.748781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0c9b1-a4db-47f3-9f1a-943b7e5faba6 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:46.810952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b928d03-07c9-4873-b849-516838f15450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:46.812172 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b928d03-07c9-4873-b849-516838f15450 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:46.812676 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b928d03-07c9-4873-b849-516838f15450 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:46.812893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218fd3f-a968-4626-879d-9ebb0136a875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:46.813159 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b928d03-07c9-4873-b849-516838f15450 None admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:46.814002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218fd3f-a968-4626-879d-9ebb0136a875 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:46.814478 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218fd3f-a968-4626-879d-9ebb0136a875 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:46.814647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b928d03-07c9-4873-b849-516838f15450 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:46.814975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218fd3f-a968-4626-879d-9ebb0136a875 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:46.815232 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b928d03-07c9-4873-b849-516838f15450 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:46.816246 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218fd3f-a968-4626-879d-9ebb0136a875 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:46.817100 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218fd3f-a968-4626-879d-9ebb0136a875 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:46.819036 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b928d03-07c9-4873-b849-516838f15450 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:46.820087 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218fd3f-a968-4626-879d-9ebb0136a875 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:46.831574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 358/715] 10.222.0.73 () {56 vars in 1124 bytes} [Fri May 13 14:50:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:46.833229 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218fd3f-a968-4626-879d-9ebb0136a875 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:46.843354 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 358/716] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:50:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:46.865767 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b928d03-07c9-4873-b849-516838f15450 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:47.122118 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218fd3f-a968-4626-879d-9ebb0136a875 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:47.137240 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b928d03-07c9-4873-b849-516838f15450 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:47.193182 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d858f6-4ace-4cd5-bb66-b31422363bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:47.194087 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d858f6-4ace-4cd5-bb66-b31422363bd4 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:47.194585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d858f6-4ace-4cd5-bb66-b31422363bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:47.195118 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d858f6-4ace-4cd5-bb66-b31422363bd4 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:47.195839 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d858f6-4ace-4cd5-bb66-b31422363bd4 None admin] RBAC: Adding query filter params (name=network) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:47.196288 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d858f6-4ace-4cd5-bb66-b31422363bd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:47.198245 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d858f6-4ace-4cd5-bb66-b31422363bd4 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:47.203594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 359/717] 10.222.0.73 () {56 vars in 1112 bytes} [Fri May 13 14:50:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:47.219305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d858f6-4ace-4cd5-bb66-b31422363bd4 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:47.221044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a2cb8-8081-4396-b703-528fc94d2d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:47.222110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a2cb8-8081-4396-b703-528fc94d2d7a None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:47.222862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a2cb8-8081-4396-b703-528fc94d2d7a None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:47.223805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a2cb8-8081-4396-b703-528fc94d2d7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:47.225185 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a2cb8-8081-4396-b703-528fc94d2d7a None admin] RBAC: Adding query filter params (role.id=354a460a8146476989f8a7b4fc1aac93, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=27265a0c2e6b47c09f28b9cd3ac47d28) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:47.225496 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a2cb8-8081-4396-b703-528fc94d2d7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:47.227620 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a2cb8-8081-4396-b703-528fc94d2d7a None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:47.234930 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 359/718] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:50:46 2022] GET /identity/v3/role_assignments?user.id=27265a0c2e6b47c09f28b9cd3ac47d28&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=354a460a8146476989f8a7b4fc1aac93 => generated 608 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:50:47.354999 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d858f6-4ace-4cd5-bb66-b31422363bd4 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:47.406153 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a68eb-66e7-4dd4-a826-b2ac7c7979e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:47.406770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a68eb-66e7-4dd4-a826-b2ac7c7979e9 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:47.407077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a68eb-66e7-4dd4-a826-b2ac7c7979e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:47.407347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a68eb-66e7-4dd4-a826-b2ac7c7979e9 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:47.408081 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a68eb-66e7-4dd4-a826-b2ac7c7979e9 None admin] RBAC: Adding query filter params (type=network) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:47.408383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a68eb-66e7-4dd4-a826-b2ac7c7979e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:47.409993 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a68eb-66e7-4dd4-a826-b2ac7c7979e9 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:47.416092 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 360/719] 10.222.0.73 () {56 vars in 1112 bytes} [Fri May 13 14:50:47 2022] GET /identity/v3/services?type=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:49.717035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a46568-f232-4bd9-97a7-2f9ab37cacb7 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:49.717869 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a46568-f232-4bd9-97a7-2f9ab37cacb7 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:49.718153 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a46568-f232-4bd9-97a7-2f9ab37cacb7 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:49.719785 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 360/720] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:49.736817 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71531a-d670-4071-a939-fc8da2ae9ee7 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:49.737548 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71531a-d670-4071-a939-fc8da2ae9ee7 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:49.737548 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71531a-d670-4071-a939-fc8da2ae9ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:49.767973 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-5e71531a-d670-4071-a939-fc8da2ae9ee7 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:49.769185 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-5e71531a-d670-4071-a939-fc8da2ae9ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:49.843621 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 361/721] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:49.846619 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48930b7a-ec0d-4eae-8a99-043ceb614544 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:49.846934 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48930b7a-ec0d-4eae-8a99-043ceb614544 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:49.847214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48930b7a-ec0d-4eae-8a99-043ceb614544 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:49.849449 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 361/722] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:50:49.855406 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747e951-2c09-40a8-aad9-8d011fd6473f None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:49.855715 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747e951-2c09-40a8-aad9-8d011fd6473f None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:49.855975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747e951-2c09-40a8-aad9-8d011fd6473f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:49.884937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-a747e951-2c09-40a8-aad9-8d011fd6473f None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:49.885240 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a747e951-2c09-40a8-aad9-8d011fd6473f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:49.901570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48930b7a-ec0d-4eae-8a99-043ceb614544 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:49.983019 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 362/723] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:50.014953 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747e951-2c09-40a8-aad9-8d011fd6473f None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:50.136592 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747e951-2c09-40a8-aad9-8d011fd6473f None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:50.156200 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48930b7a-ec0d-4eae-8a99-043ceb614544 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:50.185557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb90cba-5b84-47fa-bb38-dc52143ec65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:50.186384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb90cba-5b84-47fa-bb38-dc52143ec65a None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:50.186658 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb90cba-5b84-47fa-bb38-dc52143ec65a None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:50.186954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb90cba-5b84-47fa-bb38-dc52143ec65a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:50.208872 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb90cba-5b84-47fa-bb38-dc52143ec65a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:50.222736 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8f69a-f105-4088-9102-716f1c906960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:50.224674 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8f69a-f105-4088-9102-716f1c906960 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:50.225186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8f69a-f105-4088-9102-716f1c906960 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:50.225565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-5fb90cba-5b84-47fa-bb38-dc52143ec65a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:50.225565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:50.225565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:50.225565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:50.225565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:50.225565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:50.225565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:50.225565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:50.225565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:50.225565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:50.225565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:50.225565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:50.225565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:50.225565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:50.225565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:50.225565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:50.226516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:50.226516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:50.226516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:50.226516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:50.226516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:50.226516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:50.226516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:50.226516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:50.226516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:50.226516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:50.226516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:50.226516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:50.226516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:50.226516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:50.226516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:50.226516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:50.227459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:50.227459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:50.227459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:50.227459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:50.227459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:50.227459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:50.227459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:50.227459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:50.227459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:50.227459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:50.227459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:50.227459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:50.228603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8f69a-f105-4088-9102-716f1c906960 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:50.228680 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 363/724] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:50:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:50:50.232999 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb90cba-5b84-47fa-bb38-dc52143ec65a None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:50.246938 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8f69a-f105-4088-9102-716f1c906960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:50.262077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-04f8f69a-f105-4088-9102-716f1c906960 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:50:50.262077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:50.262077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:50.262077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:50.262077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:50.262077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:50.262077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:50.262077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:50.262077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:50.262077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:50.262077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:50.262077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:50.262077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:50.262077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:50.262077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:50.262077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:50.264529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:50.264529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:50.264529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:50.264529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:50.264529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:50.264529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:50.264529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:50.264529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:50.264529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:50.264529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:50.264529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:50.264529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:50.264529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:50.264529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:50.264529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:50.264529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:50.266534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:50.266534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:50.266534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:50.266534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:50.266534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:50.266534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:50.266534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:50.266534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:50.266534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:50.266534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:50.266534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:50:50.266534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:50.266534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 362/725] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:50:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:50:50.271183 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8f69a-f105-4088-9102-716f1c906960 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:50.413786 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb90cba-5b84-47fa-bb38-dc52143ec65a None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:50.467276 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53cbd1-c1cb-4443-95d7-920f8257a5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:50.468383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53cbd1-c1cb-4443-95d7-920f8257a5c3 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:50.468863 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53cbd1-c1cb-4443-95d7-920f8257a5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:50.469339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53cbd1-c1cb-4443-95d7-920f8257a5c3 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:50.470657 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53cbd1-c1cb-4443-95d7-920f8257a5c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:50.471220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53cbd1-c1cb-4443-95d7-920f8257a5c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:50.471410 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8f69a-f105-4088-9102-716f1c906960 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:50.473721 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53cbd1-c1cb-4443-95d7-920f8257a5c3 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:50.492752 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 364/726] 10.222.0.73 () {56 vars in 1103 bytes} [Fri May 13 14:50:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:50:50.494758 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331238e-a45f-4e34-928f-464f6f3fbbd4 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:50.495508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331238e-a45f-4e34-928f-464f6f3fbbd4 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:50.495750 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331238e-a45f-4e34-928f-464f6f3fbbd4 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:50.506903 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 365/727] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:50.506903 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331238e-a45f-4e34-928f-464f6f3fbbd4 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:50.554299 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1735a-0d67-4083-af37-dbeafc69cf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:50.555940 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1735a-0d67-4083-af37-dbeafc69cf49 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:50.556691 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1735a-0d67-4083-af37-dbeafc69cf49 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:50.557423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1735a-0d67-4083-af37-dbeafc69cf49 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:50.559115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1735a-0d67-4083-af37-dbeafc69cf49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:50.559979 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1735a-0d67-4083-af37-dbeafc69cf49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:50.562766 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1735a-0d67-4083-af37-dbeafc69cf49 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:50.579580 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 363/728] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:50:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:50.582559 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e8989-0392-42de-8a55-3d620e2e45a9 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:50.583477 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e8989-0392-42de-8a55-3d620e2e45a9 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:50.584242 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e8989-0392-42de-8a55-3d620e2e45a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:50.612663 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-288e8989-0392-42de-8a55-3d620e2e45a9 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:50.615816 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-288e8989-0392-42de-8a55-3d620e2e45a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:50.697999 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331238e-a45f-4e34-928f-464f6f3fbbd4 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:50.732197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 364/729] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:50.734853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e8989-0392-42de-8a55-3d620e2e45a9 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:50.748720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd206a99-50c3-467f-b3dc-9c23f2421307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:50.750095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd206a99-50c3-467f-b3dc-9c23f2421307 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:50.750606 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd206a99-50c3-467f-b3dc-9c23f2421307 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:50.751135 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd206a99-50c3-467f-b3dc-9c23f2421307 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:50.780646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd206a99-50c3-467f-b3dc-9c23f2421307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:50.782183 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd206a99-50c3-467f-b3dc-9c23f2421307 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:50.803206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-bd206a99-50c3-467f-b3dc-9c23f2421307 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:50.803206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:50.803206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:50.803206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:50.803206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:50.803206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:50.803206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:50.803206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:50.803206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:50.803206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:50.803206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:50.803206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:50.803206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:50.803206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:50.803206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:50.805010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:50.805010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:50.805010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:50.805010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:50.805010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:50.805010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:50.805010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:50.805010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:50.805010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:50.805010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:50.805010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:50.805010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:50.805010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:50.805010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:50.805010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:50.805010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:50.805010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:50.806748 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:50.806748 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:50.806748 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:50.806748 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:50.806748 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 366/730] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:50.806748 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506b9a3-e449-4e4a-aa13-c963cf0ec63b None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:50.806748 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506b9a3-e449-4e4a-aa13-c963cf0ec63b None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:50.806748 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506b9a3-e449-4e4a-aa13-c963cf0ec63b None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:50.808398 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 367/731] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:50.809289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506b9a3-e449-4e4a-aa13-c963cf0ec63b None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:50.892114 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e8989-0392-42de-8a55-3d620e2e45a9 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:50.935466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506b9a3-e449-4e4a-aa13-c963cf0ec63b None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:50.935726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4815ed-7144-49ae-8402-e5c61195e62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:50.936378 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4815ed-7144-49ae-8402-e5c61195e62a None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:50.936662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4815ed-7144-49ae-8402-e5c61195e62a None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:50.936938 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4815ed-7144-49ae-8402-e5c61195e62a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:50.951003 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4815ed-7144-49ae-8402-e5c61195e62a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:50.953874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4815ed-7144-49ae-8402-e5c61195e62a None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:50.987437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-ad4815ed-7144-49ae-8402-e5c61195e62a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:50.987437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:50.987437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:50.987437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:50.987437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:50.987437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:50.987437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:50.987437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:50.987437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:50.987437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:50.987437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:50.987437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:50.987437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:50.987437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:50.987437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:50.988631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:50.988631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:50.988631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:50.988631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:50.988631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:50.988631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:50.988631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:50.988631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:50.988631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:50.988631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:50.988631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:50.988631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:50.988631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:50.988631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:50.988631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:50.988631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:50.988631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:50.989839 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:50.989839 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:50.989839 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:50.989839 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:50.990059 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92b0b3-1f7e-4d0f-ba4a-8139380ede5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:50.990059 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92b0b3-1f7e-4d0f-ba4a-8139380ede5c None admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:50.990059 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92b0b3-1f7e-4d0f-ba4a-8139380ede5c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:50.990270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 365/732] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:50.990337 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92b0b3-1f7e-4d0f-ba4a-8139380ede5c None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:50.990881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92b0b3-1f7e-4d0f-ba4a-8139380ede5c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:50.991016 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4815ed-7144-49ae-8402-e5c61195e62a None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:50.993475 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92b0b3-1f7e-4d0f-ba4a-8139380ede5c None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:51.014121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 368/733] 10.222.0.73 () {60 vars in 1141 bytes} [Fri May 13 14:50:50 2022] POST /identity/v3/services => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:50:51.015501 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bd03a-cd3c-4d59-b75b-f2b2eb850754 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:51.015820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bd03a-cd3c-4d59-b75b-f2b2eb850754 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:51.016162 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bd03a-cd3c-4d59-b75b-f2b2eb850754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:51.037149 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-5a5bd03a-cd3c-4d59-b75b-f2b2eb850754 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:51.038338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-5a5bd03a-cd3c-4d59-b75b-f2b2eb850754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:51.134782 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4815ed-7144-49ae-8402-e5c61195e62a None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:51.159239 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 369/734] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:51.159239 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0319b79-afa9-4d05-92be-2f5963efb5ce None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:51.159239 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0319b79-afa9-4d05-92be-2f5963efb5ce None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:51.159239 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0319b79-afa9-4d05-92be-2f5963efb5ce None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:51.159239 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 370/735] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:51.159239 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0319b79-afa9-4d05-92be-2f5963efb5ce None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:51.204475 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc929e-32f4-42bd-94a2-55defbf2c567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:51.205182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc929e-32f4-42bd-94a2-55defbf2c567 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:51.205492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc929e-32f4-42bd-94a2-55defbf2c567 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:51.205754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc929e-32f4-42bd-94a2-55defbf2c567 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:51.206545 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc929e-32f4-42bd-94a2-55defbf2c567 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:51.206879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc929e-32f4-42bd-94a2-55defbf2c567 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:51.208889 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc929e-32f4-42bd-94a2-55defbf2c567 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:51.228327 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 366/736] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:51.228327 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c57a67-cb0d-4f95-a1a3-a25dc939f752 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:51.228327 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c57a67-cb0d-4f95-a1a3-a25dc939f752 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:51.228327 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c57a67-cb0d-4f95-a1a3-a25dc939f752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:51.253258 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-21c57a67-cb0d-4f95-a1a3-a25dc939f752 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:51.255314 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-21c57a67-cb0d-4f95-a1a3-a25dc939f752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:51.305720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0319b79-afa9-4d05-92be-2f5963efb5ce None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:51.347414 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 367/737] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 14:50:51.349301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c57a67-cb0d-4f95-a1a3-a25dc939f752 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:51.361733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e116720-e87e-4da1-b098-6130da8237ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:51.362861 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e116720-e87e-4da1-b098-6130da8237ef None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:51.363402 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e116720-e87e-4da1-b098-6130da8237ef None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:51.363783 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e116720-e87e-4da1-b098-6130da8237ef None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:51.364832 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e116720-e87e-4da1-b098-6130da8237ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:51.365326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e116720-e87e-4da1-b098-6130da8237ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:51.367333 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e116720-e87e-4da1-b098-6130da8237ef None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:51.393966 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 371/738] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:51.393966 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e116720-e87e-4da1-b098-6130da8237ef None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:51.469550 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c57a67-cb0d-4f95-a1a3-a25dc939f752 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:51.511387 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5ea3b-4642-4029-bc38-75dab80c83c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:51.512154 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5ea3b-4642-4029-bc38-75dab80c83c6 None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:51.512440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5ea3b-4642-4029-bc38-75dab80c83c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:51.512706 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5ea3b-4642-4029-bc38-75dab80c83c6 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:51.513485 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5ea3b-4642-4029-bc38-75dab80c83c6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:51.514998 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5ea3b-4642-4029-bc38-75dab80c83c6 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:51.534921 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 368/739] 10.222.0.73 () {60 vars in 1141 bytes} [Fri May 13 14:50:51 2022] POST /identity/v3/services => generated 240 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:50:51.536008 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5ea3b-4642-4029-bc38-75dab80c83c6 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:51.570538 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e116720-e87e-4da1-b098-6130da8237ef None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:51.628271 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d70c38-3f10-4e28-90f0-d91a09403965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:51.629830 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d70c38-3f10-4e28-90f0-d91a09403965 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:51.630247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d70c38-3f10-4e28-90f0-d91a09403965 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:51.630632 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d70c38-3f10-4e28-90f0-d91a09403965 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:51.643499 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d70c38-3f10-4e28-90f0-d91a09403965 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:51.645505 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d70c38-3f10-4e28-90f0-d91a09403965 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:51.666610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-17d70c38-3f10-4e28-90f0-d91a09403965 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:50:51.666610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:51.666610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:51.666610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:51.666610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:51.666610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:51.666610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:51.666610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:51.666610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:51.666610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:51.666610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:51.666610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:51.666610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:50:51.666610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:50:51.666610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:50:51.666610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:50:51.669084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:51.669084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:51.669084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:50:51.669084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:51.669084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:50:51.669084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:51.669084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:51.669084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:51.669084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:51.669084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:51.669084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:51.669084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:51.669084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:51.669084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:51.669084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:51.669084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:51.669084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:51.669084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:51.671263 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:51.671263 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:51.671263 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:50:51.671263 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:50:51.671263 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:50:51.671263 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:50:51.671263 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:50:51.671263 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:50:51.671263 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:50:51.671263 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:51.671263 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 372/740] 10.222.0.73 () {56 vars in 1117 bytes} [Fri May 13 14:50:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:51.672984 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d70c38-3f10-4e28-90f0-d91a09403965 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:51.754347 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5ea3b-4642-4029-bc38-75dab80c83c6 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:51.798009 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d70c38-3f10-4e28-90f0-d91a09403965 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:51.819074 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71dff0-d6f6-495b-b919-680c4f80ff74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:51.820409 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71dff0-d6f6-495b-b919-680c4f80ff74 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:51.822012 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71dff0-d6f6-495b-b919-680c4f80ff74 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:51.822012 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71dff0-d6f6-495b-b919-680c4f80ff74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:51.844181 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71dff0-d6f6-495b-b919-680c4f80ff74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:51.845556 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81759705-17d8-4239-b1c4-29c583049218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:51.846543 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81759705-17d8-4239-b1c4-29c583049218 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:51.847022 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81759705-17d8-4239-b1c4-29c583049218 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:51.847404 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81759705-17d8-4239-b1c4-29c583049218 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:51.856712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81759705-17d8-4239-b1c4-29c583049218 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:51.858402 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81759705-17d8-4239-b1c4-29c583049218 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:51.860794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-4a71dff0-d6f6-495b-b919-680c4f80ff74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:50:51.860794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:51.860794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:51.860794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:51.860794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:51.860794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:51.860794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:51.860794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:51.860794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:51.860794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:51.860794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:51.860794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:51.860794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:51.860794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:51.860794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:51.860794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:51.861857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:51.861857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:51.861857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:51.861857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:51.861857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:51.861857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:51.861857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:51.861857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:51.861857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:51.861857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:51.861857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:51.861857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:51.861857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:51.861857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:51.861857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:51.861857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:51.862702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:51.862702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:51.862702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:51.862702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:51.862702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:51.862702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:51.862702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:51.862702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:51.862702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:51.862702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:51.862702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:50:51.862702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:51.863997 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 369/741] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:50:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:51.864983 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71dff0-d6f6-495b-b919-680c4f80ff74 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:51.880899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-81759705-17d8-4239-b1c4-29c583049218 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 14:50:51.880899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:51.880899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:51.880899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:51.880899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:51.880899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:51.880899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:51.880899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:51.880899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:51.880899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:51.880899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:51.880899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:51.880899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:50:51.880899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:50:51.880899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:50:51.880899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:50:51.886417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:51.886417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:51.886417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:50:51.886417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:51.886417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:50:51.886417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:51.886417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:51.886417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:51.886417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:51.886417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:51.886417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:51.886417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:51.886417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:51.886417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:51.886417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:51.886417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:51.886417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:51.886417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:51.889745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:51.889745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:51.889745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:50:51.889745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:50:51.889745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:50:51.889745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:50:51.889745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:50:51.889745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:50:51.889745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 14:50:51.889745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:51.889745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 373/742] 10.222.0.73 () {56 vars in 1093 bytes} [Fri May 13 14:50:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:51.889745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81759705-17d8-4239-b1c4-29c583049218 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:52.009579 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81759705-17d8-4239-b1c4-29c583049218 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:52.049787 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908718b-9888-48a7-8544-b2cf8454599b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:52.051086 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908718b-9888-48a7-8544-b2cf8454599b None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:52.051476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71dff0-d6f6-495b-b919-680c4f80ff74 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:52.052003 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908718b-9888-48a7-8544-b2cf8454599b None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:52.052513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908718b-9888-48a7-8544-b2cf8454599b None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:52.053646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908718b-9888-48a7-8544-b2cf8454599b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:52.054180 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908718b-9888-48a7-8544-b2cf8454599b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:52.056036 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908718b-9888-48a7-8544-b2cf8454599b None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:52.066079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 374/743] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:50:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:52.069564 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908718b-9888-48a7-8544-b2cf8454599b None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:52.118037 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07ecb7-8c2c-4c53-b013-9cf36c4be161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:52.119212 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07ecb7-8c2c-4c53-b013-9cf36c4be161 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:52.119709 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07ecb7-8c2c-4c53-b013-9cf36c4be161 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:52.120193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07ecb7-8c2c-4c53-b013-9cf36c4be161 None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:52.121803 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07ecb7-8c2c-4c53-b013-9cf36c4be161 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:52.122351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07ecb7-8c2c-4c53-b013-9cf36c4be161 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:52.125137 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07ecb7-8c2c-4c53-b013-9cf36c4be161 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:52.162861 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 370/744] 10.222.0.73 () {56 vars in 1149 bytes} [Fri May 13 14:50:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:52.162861 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07ecb7-8c2c-4c53-b013-9cf36c4be161 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:52.194867 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908718b-9888-48a7-8544-b2cf8454599b None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:52.232798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41d486-b089-4094-b717-69906daa4d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:52.233659 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41d486-b089-4094-b717-69906daa4d3c None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:52.234036 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41d486-b089-4094-b717-69906daa4d3c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:52.234474 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41d486-b089-4094-b717-69906daa4d3c None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:52.235467 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41d486-b089-4094-b717-69906daa4d3c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:52.235843 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41d486-b089-4094-b717-69906daa4d3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:52.237478 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41d486-b089-4094-b717-69906daa4d3c None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:52.265307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 375/745] 10.222.0.73 () {56 vars in 1133 bytes} [Fri May 13 14:50:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:52.266789 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41d486-b089-4094-b717-69906daa4d3c None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:52.388021 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07ecb7-8c2c-4c53-b013-9cf36c4be161 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:52.396327 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41d486-b089-4094-b717-69906daa4d3c None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:52.436226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a5968-c0e2-404c-bb14-cad86ef13ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:52.436993 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a5968-c0e2-404c-bb14-cad86ef13ef4 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:52.437473 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a5968-c0e2-404c-bb14-cad86ef13ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:52.437814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a5968-c0e2-404c-bb14-cad86ef13ef4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:52.453955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696c061-0228-48e3-9837-45b8694e4a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:52.455742 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696c061-0228-48e3-9837-45b8694e4a00 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:52.456514 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696c061-0228-48e3-9837-45b8694e4a00 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:52.457546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696c061-0228-48e3-9837-45b8694e4a00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:52.478521 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696c061-0228-48e3-9837-45b8694e4a00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:52.481830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696c061-0228-48e3-9837-45b8694e4a00 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:52.516270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a5968-c0e2-404c-bb14-cad86ef13ef4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:52.517326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-3696c061-0228-48e3-9837-45b8694e4a00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:52.517326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:52.517326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:52.517326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:52.517326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:52.517326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:52.517326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:52.517326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:52.517326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:52.517326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:52.517326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:52.517326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:52.517326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:52.517326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:52.517326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:52.519645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:52.519645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:52.519645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:52.519645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:52.519645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:52.519645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:52.519645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:52.519645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:52.519645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:52.519645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:52.519645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:52.519645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:52.519645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:52.519645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:52.519645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:52.519645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:52.519645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:52.522323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:52.522323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:52.522323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:52.522323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:52.522766 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a5968-c0e2-404c-bb14-cad86ef13ef4 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:52.527707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 371/746] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:52.529797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696c061-0228-48e3-9837-45b8694e4a00 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:52.636775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 376/747] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:50:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:50:52.637855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a5968-c0e2-404c-bb14-cad86ef13ef4 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:52.647890 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696c061-0228-48e3-9837-45b8694e4a00 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:52.686088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756b83d-81df-476e-8d90-64239874ed79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:52.687484 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756b83d-81df-476e-8d90-64239874ed79 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:52.688036 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756b83d-81df-476e-8d90-64239874ed79 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:52.688516 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756b83d-81df-476e-8d90-64239874ed79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:52.700988 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756b83d-81df-476e-8d90-64239874ed79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:52.702901 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756b83d-81df-476e-8d90-64239874ed79 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:52.721779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-f756b83d-81df-476e-8d90-64239874ed79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:52.721779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:52.721779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:52.721779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:52.721779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:52.721779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:52.721779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:52.721779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:52.721779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:52.721779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:52.721779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:52.721779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:52.721779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:52.721779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:52.721779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:52.722753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:52.722753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:52.722753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:52.722753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:52.722753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:52.722753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:52.722753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:52.722753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:52.722753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:52.722753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:52.722753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:52.722753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:52.722753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:52.722753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:52.722753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:52.722753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:52.722753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:52.723748 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:52.723748 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:52.723748 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:52.723748 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:52.725766 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 372/748] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:52.726892 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756b83d-81df-476e-8d90-64239874ed79 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:52.757175 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a5968-c0e2-404c-bb14-cad86ef13ef4 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:52.796107 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abcfd4-715e-4b07-9d85-b015a34bfcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:52.796721 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abcfd4-715e-4b07-9d85-b015a34bfcde None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:52.796998 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abcfd4-715e-4b07-9d85-b015a34bfcde None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:52.797269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abcfd4-715e-4b07-9d85-b015a34bfcde None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:52.798049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abcfd4-715e-4b07-9d85-b015a34bfcde None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:52.798592 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abcfd4-715e-4b07-9d85-b015a34bfcde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:52.799893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abcfd4-715e-4b07-9d85-b015a34bfcde None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:52.813233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 377/749] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:52.814126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abcfd4-715e-4b07-9d85-b015a34bfcde None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:52.844866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756b83d-81df-476e-8d90-64239874ed79 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:52.889204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476764cf-318f-4207-a052-f17d1776583d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:52.890391 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476764cf-318f-4207-a052-f17d1776583d None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:52.890951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476764cf-318f-4207-a052-f17d1776583d None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:52.891431 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476764cf-318f-4207-a052-f17d1776583d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:52.907976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476764cf-318f-4207-a052-f17d1776583d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:52.909861 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476764cf-318f-4207-a052-f17d1776583d None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:52.933272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-476764cf-318f-4207-a052-f17d1776583d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:52.933272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:52.933272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:52.933272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:52.933272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:52.933272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:52.933272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:52.933272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:52.933272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:52.933272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:52.933272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:52.933272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:52.933272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:52.933272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:52.933272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:52.934246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:52.934246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:52.934246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:52.934246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:52.934246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:52.934246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:52.934246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:52.934246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:52.934246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:52.934246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:52.934246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:52.934246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:52.934246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:52.934246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:52.934246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:52.934246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:52.934246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:52.935197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:52.935197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:52.935197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:52.935197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:52.943119 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 373/750] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:52.943119 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476764cf-318f-4207-a052-f17d1776583d None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:52.973727 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abcfd4-715e-4b07-9d85-b015a34bfcde None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:53.038087 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f13af-e79d-45fe-9628-e8472f965e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:53.039995 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f13af-e79d-45fe-9628-e8472f965e3b None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:53.040726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f13af-e79d-45fe-9628-e8472f965e3b None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:53.041622 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f13af-e79d-45fe-9628-e8472f965e3b None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:53.043548 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f13af-e79d-45fe-9628-e8472f965e3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:53.044560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f13af-e79d-45fe-9628-e8472f965e3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:53.047962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f13af-e79d-45fe-9628-e8472f965e3b None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:53.075321 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 378/751] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:53.078110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f13af-e79d-45fe-9628-e8472f965e3b None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:53.126776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476764cf-318f-4207-a052-f17d1776583d None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:53.166310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bc66a-11b2-4000-8cf9-d0faaa3062e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:53.167136 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bc66a-11b2-4000-8cf9-d0faaa3062e9 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:53.167474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bc66a-11b2-4000-8cf9-d0faaa3062e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:53.167756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bc66a-11b2-4000-8cf9-d0faaa3062e9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:53.176078 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10bc66a-11b2-4000-8cf9-d0faaa3062e9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:53.178125 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10bc66a-11b2-4000-8cf9-d0faaa3062e9 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:53.194854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-f10bc66a-11b2-4000-8cf9-d0faaa3062e9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 14:50:53.194854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:53.194854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:53.194854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:53.194854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:53.194854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:53.194854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:53.194854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:53.194854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:53.194854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:53.194854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:53.194854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:53.194854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:50:53.194854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:50:53.194854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:50:53.194854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:50:53.196768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:53.196768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:53.196768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:50:53.196768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:53.196768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:50:53.196768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:53.196768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:53.196768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:53.196768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:53.196768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:53.196768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:53.196768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:53.196768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:53.196768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:53.196768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:53.196768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:53.196768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:53.196768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:53.198279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:53.198279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:53.198279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:50:53.198279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:50:53.198279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:50:53.198279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:50:53.198279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:50:53.198279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:50:53.198279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 14:50:53.198279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:53.200976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 374/752] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:50:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:53.201996 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bc66a-11b2-4000-8cf9-d0faaa3062e9 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:53.251767 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f13af-e79d-45fe-9628-e8472f965e3b None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:53.289411 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3712fd3-a227-4f62-ae46-e472890d98c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:53.290110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3712fd3-a227-4f62-ae46-e472890d98c7 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:53.290390 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3712fd3-a227-4f62-ae46-e472890d98c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:53.290664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3712fd3-a227-4f62-ae46-e472890d98c7 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:53.291445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3712fd3-a227-4f62-ae46-e472890d98c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:53.291740 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3712fd3-a227-4f62-ae46-e472890d98c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:53.293136 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3712fd3-a227-4f62-ae46-e472890d98c7 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:53.313882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 379/753] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:53.313882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3712fd3-a227-4f62-ae46-e472890d98c7 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:53.430611 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bc66a-11b2-4000-8cf9-d0faaa3062e9 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:53.469675 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3712fd3-a227-4f62-ae46-e472890d98c7 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:53.479378 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da696dd8-2c5f-4d99-9557-89e35f9bae78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:53.481888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da696dd8-2c5f-4d99-9557-89e35f9bae78 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:53.483203 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da696dd8-2c5f-4d99-9557-89e35f9bae78 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:53.484423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da696dd8-2c5f-4d99-9557-89e35f9bae78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:53.503697 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da696dd8-2c5f-4d99-9557-89e35f9bae78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:53.508424 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da696dd8-2c5f-4d99-9557-89e35f9bae78 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:53.510764 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea48ee-fd55-439f-b465-e34e81e44765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:53.511592 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea48ee-fd55-439f-b465-e34e81e44765 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:53.511978 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea48ee-fd55-439f-b465-e34e81e44765 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:53.512350 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea48ee-fd55-439f-b465-e34e81e44765 None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:53.513383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea48ee-fd55-439f-b465-e34e81e44765 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:53.513811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea48ee-fd55-439f-b465-e34e81e44765 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:53.515494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea48ee-fd55-439f-b465-e34e81e44765 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:53.540723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-da696dd8-2c5f-4d99-9557-89e35f9bae78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:53.540723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:53.540723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:53.540723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:53.540723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:53.540723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:53.540723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:53.540723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:53.540723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:53.540723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:53.540723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:53.540723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:53.540723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:50:53.540723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:50:53.540723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:50:53.542765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:50:53.542765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:53.542765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:53.542765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:53.542765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:53.542765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:53.542765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:53.542765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:53.542765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:53.542765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:53.542765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:53.542765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:53.542765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:53.542765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:53.542765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:53.542765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:53.542765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:53.544931 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:50:53.544931 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:50:53.544931 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:50:53.544931 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:50:53.544931 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:50:53.544931 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:50:53.544931 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:53.544931 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:53.548531 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 375/754] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:53.550515 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da696dd8-2c5f-4d99-9557-89e35f9bae78 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:53.696553 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da696dd8-2c5f-4d99-9557-89e35f9bae78 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:53.703237 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 380/755] 10.222.0.73 () {56 vars in 1135 bytes} [Fri May 13 14:50:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:53.705222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea48ee-fd55-439f-b465-e34e81e44765 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:53.739981 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de34ae-f4c3-4789-ad65-5f83f2c0ce8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:53.741314 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de34ae-f4c3-4789-ad65-5f83f2c0ce8d None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:53.741757 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de34ae-f4c3-4789-ad65-5f83f2c0ce8d None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:53.742186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de34ae-f4c3-4789-ad65-5f83f2c0ce8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:53.757894 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de34ae-f4c3-4789-ad65-5f83f2c0ce8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:53.759876 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de34ae-f4c3-4789-ad65-5f83f2c0ce8d None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:53.779298 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-d4de34ae-f4c3-4789-ad65-5f83f2c0ce8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:53.779298 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:53.779298 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:53.779298 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:53.779298 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:53.779298 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:53.779298 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:53.779298 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:53.779298 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:53.779298 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:53.779298 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:53.779298 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:53.779298 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:50:53.779298 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:50:53.779298 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:50:53.780285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:50:53.780285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:53.780285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:53.780285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:53.780285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:53.780285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:53.780285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:53.780285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:53.780285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:53.780285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:53.780285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:53.780285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:53.780285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:53.780285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:53.780285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:53.780285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:53.780285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:53.781193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:50:53.781193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:50:53.781193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:50:53.781193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:50:53.781193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:50:53.781193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:50:53.781193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:53.781193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:53.783530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 376/756] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:53.784648 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de34ae-f4c3-4789-ad65-5f83f2c0ce8d None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:53.914133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea48ee-fd55-439f-b465-e34e81e44765 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:53.929582 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de34ae-f4c3-4789-ad65-5f83f2c0ce8d None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:53.976705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ac566-6886-4752-bcd3-50e922c2244e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:53.977752 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ac566-6886-4752-bcd3-50e922c2244e None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:53.978264 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ac566-6886-4752-bcd3-50e922c2244e None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:53.978753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ac566-6886-4752-bcd3-50e922c2244e None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:53.980160 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ac566-6886-4752-bcd3-50e922c2244e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:53.980668 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ac566-6886-4752-bcd3-50e922c2244e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:53.983248 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ac566-6886-4752-bcd3-50e922c2244e None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:53.983604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37d260-9074-422a-8ff7-88bb9fc9a15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:53.984485 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37d260-9074-422a-8ff7-88bb9fc9a15d None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:53.984955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37d260-9074-422a-8ff7-88bb9fc9a15d None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:53.985460 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37d260-9074-422a-8ff7-88bb9fc9a15d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:54.005587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 381/757] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:50:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:54.007211 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ac566-6886-4752-bcd3-50e922c2244e None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:54.084134 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37d260-9074-422a-8ff7-88bb9fc9a15d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:54.086947 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37d260-9074-422a-8ff7-88bb9fc9a15d None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:54.157641 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ac566-6886-4752-bcd3-50e922c2244e None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:54.208055 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b1ab2-d1b9-4465-aa75-4e5e19d0f03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:54.209583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b1ab2-d1b9-4465-aa75-4e5e19d0f03f None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:54.209988 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b1ab2-d1b9-4465-aa75-4e5e19d0f03f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:54.210314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b1ab2-d1b9-4465-aa75-4e5e19d0f03f None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:54.211158 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b1ab2-d1b9-4465-aa75-4e5e19d0f03f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:54.211639 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b1ab2-d1b9-4465-aa75-4e5e19d0f03f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:54.213996 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b1ab2-d1b9-4465-aa75-4e5e19d0f03f None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:54.231114 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 377/758] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:50:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:50:54.231114 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37d260-9074-422a-8ff7-88bb9fc9a15d None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:54.231678 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 382/759] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:50:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:54.238878 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a22e8-e307-4a84-8f4a-c3d192348331 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:54.238878 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a22e8-e307-4a84-8f4a-c3d192348331 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:54.238878 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a22e8-e307-4a84-8f4a-c3d192348331 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:54.239390 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 383/760] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:54.240115 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a22e8-e307-4a84-8f4a-c3d192348331 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:54.358276 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37d260-9074-422a-8ff7-88bb9fc9a15d None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:54.377372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a22e8-e307-4a84-8f4a-c3d192348331 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:54.402103 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff4751-f40c-4d50-b1b1-d564918f3755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:54.403487 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff4751-f40c-4d50-b1b1-d564918f3755 None admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:54.403892 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff4751-f40c-4d50-b1b1-d564918f3755 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:54.404269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff4751-f40c-4d50-b1b1-d564918f3755 None admin] PATH_INFO: `/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/52d539202cfb40a48b231713e16a599a/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:54.407138 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff4751-f40c-4d50-b1b1-d564918f3755 None admin] RBAC: Authorizing `identity:create_grant(project_id=48788e7517a14ca5b5af9f161512ac9c, user_id=52d539202cfb40a48b231713e16a599a, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:54.409205 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff4751-f40c-4d50-b1b1-d564918f3755 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:54.421429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f0301-91a9-4e08-afae-baca47ac3966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:54.422233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f0301-91a9-4e08-afae-baca47ac3966 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:54.422507 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f0301-91a9-4e08-afae-baca47ac3966 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:54.422773 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f0301-91a9-4e08-afae-baca47ac3966 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:54.426297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 378/761] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:50:54 2022] PUT /identity/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/52d539202cfb40a48b231713e16a599a/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:50:54.427430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55d935-e1ff-463b-b6df-336a95b8d6b4 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:54.427860 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55d935-e1ff-463b-b6df-336a95b8d6b4 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:54.428143 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55d935-e1ff-463b-b6df-336a95b8d6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:54.435085 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f0301-91a9-4e08-afae-baca47ac3966 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:54.437658 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f0301-91a9-4e08-afae-baca47ac3966 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:54.461815 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-1b55d935-e1ff-463b-b6df-336a95b8d6b4 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:54.464002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-1b55d935-e1ff-463b-b6df-336a95b8d6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:54.471152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-2e8f0301-91a9-4e08-afae-baca47ac3966 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:54.471152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:54.471152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:54.471152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:54.471152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:54.471152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:54.471152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:54.471152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:54.471152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:54.471152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:54.471152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:54.471152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:54.471152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:54.471152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:54.471152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:54.472144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:54.472144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:54.472144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:54.472144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:54.472144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:54.472144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:54.472144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:54.472144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:54.472144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:54.472144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:54.472144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:54.472144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:54.472144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:54.472144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:54.472144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:54.472144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:54.472144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:54.473639 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:54.473639 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:54.473639 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:54.473639 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:54.474480 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 384/762] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:54.475996 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f0301-91a9-4e08-afae-baca47ac3966 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:54.574844 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 379/763] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:50:54.574844 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc4aff-5d5c-4d94-949c-cf8f22b59359 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:54.574844 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc4aff-5d5c-4d94-949c-cf8f22b59359 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:54.574844 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc4aff-5d5c-4d94-949c-cf8f22b59359 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:54.574844 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 380/764] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:54.574844 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc4aff-5d5c-4d94-949c-cf8f22b59359 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:54.636227 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f0301-91a9-4e08-afae-baca47ac3966 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:54.679501 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d2b0f-cd75-4082-8820-e4049dadf0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:54.680188 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d2b0f-cd75-4082-8820-e4049dadf0f7 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:54.680470 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d2b0f-cd75-4082-8820-e4049dadf0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:54.680748 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d2b0f-cd75-4082-8820-e4049dadf0f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:54.681634 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d2b0f-cd75-4082-8820-e4049dadf0f7 None admin] RBAC: Adding query filter params (role.id=354a460a8146476989f8a7b4fc1aac93, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=0c04f5fb770d49c0a50f2cfbd77e17e0) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:54.681955 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d2b0f-cd75-4082-8820-e4049dadf0f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:54.683585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d2b0f-cd75-4082-8820-e4049dadf0f7 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:54.690619 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 385/765] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:50:54 2022] GET /identity/v3/role_assignments?user.id=0c04f5fb770d49c0a50f2cfbd77e17e0&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=354a460a8146476989f8a7b4fc1aac93 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:54.692935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82a645-bbe2-40d4-9856-31581c92df9b None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:54.693305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82a645-bbe2-40d4-9856-31581c92df9b None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:54.693587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82a645-bbe2-40d4-9856-31581c92df9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:54.718988 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-8c82a645-bbe2-40d4-9856-31581c92df9b None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:54.720267 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-8c82a645-bbe2-40d4-9856-31581c92df9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:54.746698 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc4aff-5d5c-4d94-949c-cf8f22b59359 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:54.807587 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d6454-a2a5-47c0-860c-0da399a01235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:54.809013 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d6454-a2a5-47c0-860c-0da399a01235 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:54.809715 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d6454-a2a5-47c0-860c-0da399a01235 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:54.810428 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d6454-a2a5-47c0-860c-0da399a01235 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:54.811871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d6454-a2a5-47c0-860c-0da399a01235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:54.812462 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 386/766] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:50:54.812812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d6454-a2a5-47c0-860c-0da399a01235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:54.813561 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82a645-bbe2-40d4-9856-31581c92df9b None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:54.815904 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d6454-a2a5-47c0-860c-0da399a01235 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:54.838764 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 381/767] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:54.846951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d6454-a2a5-47c0-860c-0da399a01235 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:54.979307 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d6454-a2a5-47c0-860c-0da399a01235 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:55.003268 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82a645-bbe2-40d4-9856-31581c92df9b None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:55.022509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d85724-959e-4baf-8fc3-cd5f66a01490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:55.023698 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d85724-959e-4baf-8fc3-cd5f66a01490 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:55.024149 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d85724-959e-4baf-8fc3-cd5f66a01490 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:55.024577 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d85724-959e-4baf-8fc3-cd5f66a01490 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:55.032986 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d85724-959e-4baf-8fc3-cd5f66a01490 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:55.034770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d85724-959e-4baf-8fc3-cd5f66a01490 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:55.051770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-53d85724-959e-4baf-8fc3-cd5f66a01490 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:55.051770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:55.051770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:55.051770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:55.051770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:55.051770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:55.051770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:55.051770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:55.051770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:55.051770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:55.051770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:55.051770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:55.051770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:50:55.051770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:50:55.051770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:50:55.052919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:50:55.052919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:55.052919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:55.052919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:55.052919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:55.052919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:55.052919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:55.052919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:55.052919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:55.052919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:55.052919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:55.052919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:55.052919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:55.052919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:55.052919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:55.052919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:55.052919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:55.053991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:50:55.053991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:50:55.053991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:50:55.053991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:50:55.053991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:50:55.053991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:50:55.053991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:50:55.053991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:55.056360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 382/768] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:50:55.057542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d85724-959e-4baf-8fc3-cd5f66a01490 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:55.080483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15c3b6-008b-46a7-a99c-fa432c4605c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:55.082609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15c3b6-008b-46a7-a99c-fa432c4605c1 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:55.083156 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15c3b6-008b-46a7-a99c-fa432c4605c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:55.083651 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15c3b6-008b-46a7-a99c-fa432c4605c1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:55.084880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15c3b6-008b-46a7-a99c-fa432c4605c1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:55.089149 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15c3b6-008b-46a7-a99c-fa432c4605c1 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:55.112981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-0a15c3b6-008b-46a7-a99c-fa432c4605c1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 14:50:55.112981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:55.112981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:50:55.112981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:50:55.112981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:50:55.112981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:50:55.112981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:50:55.112981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:50:55.112981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 14:50:55.112981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:55.112981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:50:55.112981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:55.112981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:55.112981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:55.112981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:55.112981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:55.114071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:55.114071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:55.114071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:55.114071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:55.114071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:55.114071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:55.114071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:55.114071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:50:55.114071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:50:55.114071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:50:55.114071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:50:55.114071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:55.114071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:55.114071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:55.114071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:55.114071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:55.115351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:55.115351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:55.115351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:55.115351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:55.115351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:55.115351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:55.115351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:55.115351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:55.115351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:55.115351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:55.115351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:55.115351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:50:55.115351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:50:55.115351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 14:50:55.115351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:55.122953 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 387/769] 10.222.0.73 () {56 vars in 1129 bytes} [Fri May 13 14:50:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:55.124560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15c3b6-008b-46a7-a99c-fa432c4605c1 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:55.252404 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d85724-959e-4baf-8fc3-cd5f66a01490 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:55.259391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15c3b6-008b-46a7-a99c-fa432c4605c1 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:55.301517 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212b7f8-fcf8-46c7-9295-b8bfa0090ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:55.302295 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212b7f8-fcf8-46c7-9295-b8bfa0090ddb None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:55.302642 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212b7f8-fcf8-46c7-9295-b8bfa0090ddb None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:55.303027 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212b7f8-fcf8-46c7-9295-b8bfa0090ddb None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:55.303881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212b7f8-fcf8-46c7-9295-b8bfa0090ddb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:55.304254 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212b7f8-fcf8-46c7-9295-b8bfa0090ddb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:55.305761 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212b7f8-fcf8-46c7-9295-b8bfa0090ddb None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:55.320383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 388/770] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:50:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:55.321427 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212b7f8-fcf8-46c7-9295-b8bfa0090ddb None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:55.322920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bf0b3-697c-417c-a394-39a0175a6bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:55.324277 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bf0b3-697c-417c-a394-39a0175a6bac None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:55.324779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bf0b3-697c-417c-a394-39a0175a6bac None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:55.325261 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bf0b3-697c-417c-a394-39a0175a6bac None admin] PATH_INFO: `/v3/services/network` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:55.326610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708bf0b3-697c-417c-a394-39a0175a6bac None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:55.329686 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708bf0b3-697c-417c-a394-39a0175a6bac None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:55.353219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-708bf0b3-697c-417c-a394-39a0175a6bac None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 13 14:50:55.353219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:55.353219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:50:55.353219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:50:55.353219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:50:55.353219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:50:55.353219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:50:55.353219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:50:55.353219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 14:50:55.353219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:55.353219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:50:55.353219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:55.353219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:55.353219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:55.353219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:55.353219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:55.353219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:55.354301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:55.354301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:55.354301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:55.354301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:55.354301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:55.354301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:55.354301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:50:55.354301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:50:55.354301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:50:55.354301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:50:55.354301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:55.354301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:55.354301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:55.354301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:55.354301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:55.354301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:55.355182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:55.355182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:55.355182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:55.355182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:55.355182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:55.355182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:55.355182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:55.355182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:55.355182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:55.355182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:55.355182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:50:55.355182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:50:55.355182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 14:50:55.355182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:55.363206 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 383/771] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:50:55 2022] GET /identity/v3/services/network => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:55.368104 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bf0b3-697c-417c-a394-39a0175a6bac None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:55.431795 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212b7f8-fcf8-46c7-9295-b8bfa0090ddb None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:55.472315 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454393ce-6163-4e26-99b8-599c9fe1c7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:55.473035 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454393ce-6163-4e26-99b8-599c9fe1c7a7 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:55.473314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454393ce-6163-4e26-99b8-599c9fe1c7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:55.473585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454393ce-6163-4e26-99b8-599c9fe1c7a7 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:55.474302 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454393ce-6163-4e26-99b8-599c9fe1c7a7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:55.474607 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454393ce-6163-4e26-99b8-599c9fe1c7a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:55.476049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454393ce-6163-4e26-99b8-599c9fe1c7a7 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:55.481380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 389/772] 10.222.0.73 () {56 vars in 1124 bytes} [Fri May 13 14:50:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:55.482247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454393ce-6163-4e26-99b8-599c9fe1c7a7 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:55.587602 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bf0b3-697c-417c-a394-39a0175a6bac None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:55.607259 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454393ce-6163-4e26-99b8-599c9fe1c7a7 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:55.646152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed886651-5e00-4cee-9f7d-0d924ba6d974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:55.646920 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed886651-5e00-4cee-9f7d-0d924ba6d974 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:55.647208 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed886651-5e00-4cee-9f7d-0d924ba6d974 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:55.647483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed886651-5e00-4cee-9f7d-0d924ba6d974 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:55.648319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed886651-5e00-4cee-9f7d-0d924ba6d974 None admin] RBAC: Adding query filter params (name=network) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:55.648724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed886651-5e00-4cee-9f7d-0d924ba6d974 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:55.650368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed886651-5e00-4cee-9f7d-0d924ba6d974 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:55.650808 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77779e97-a102-4dae-aa4f-204b4c73daae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:55.652294 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77779e97-a102-4dae-aa4f-204b4c73daae None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:55.653218 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77779e97-a102-4dae-aa4f-204b4c73daae None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:55.653704 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77779e97-a102-4dae-aa4f-204b4c73daae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:55.656156 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77779e97-a102-4dae-aa4f-204b4c73daae None admin] RBAC: Adding query filter params (role.id=b6fbf976763d4795afbfb53a09ec6f6c, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=27265a0c2e6b47c09f28b9cd3ac47d28) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:55.656683 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 390/773] 10.222.0.73 () {56 vars in 1112 bytes} [Fri May 13 14:50:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:55.657566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed886651-5e00-4cee-9f7d-0d924ba6d974 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:55.659124 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77779e97-a102-4dae-aa4f-204b4c73daae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:55.660737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77779e97-a102-4dae-aa4f-204b4c73daae None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:55.673599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 384/774] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:50:55 2022] GET /identity/v3/role_assignments?user.id=27265a0c2e6b47c09f28b9cd3ac47d28&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=b6fbf976763d4795afbfb53a09ec6f6c => generated 259 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:55.675317 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77779e97-a102-4dae-aa4f-204b4c73daae None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:55.869003 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77779e97-a102-4dae-aa4f-204b4c73daae None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:55.877039 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed886651-5e00-4cee-9f7d-0d924ba6d974 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:55.923662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc4993-c089-490f-9964-1c877b87d084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:55.923662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc4993-c089-490f-9964-1c877b87d084 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:55.923662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc4993-c089-490f-9964-1c877b87d084 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:55.923662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc4993-c089-490f-9964-1c877b87d084 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:55.924478 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc4993-c089-490f-9964-1c877b87d084 None admin] RBAC: Adding query filter params (type=network) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:55.924478 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc4993-c089-490f-9964-1c877b87d084 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:55.925011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc4993-c089-490f-9964-1c877b87d084 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:55.939606 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 385/775] 10.222.0.73 () {56 vars in 1112 bytes} [Fri May 13 14:50:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:55.945993 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc4993-c089-490f-9964-1c877b87d084 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:55.972908 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764476c9-9d66-4121-884b-af6dd45129ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:55.973752 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764476c9-9d66-4121-884b-af6dd45129ed None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:55.974097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764476c9-9d66-4121-884b-af6dd45129ed None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:55.974382 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764476c9-9d66-4121-884b-af6dd45129ed None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:55.975218 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764476c9-9d66-4121-884b-af6dd45129ed None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:55.975518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764476c9-9d66-4121-884b-af6dd45129ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:55.976926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764476c9-9d66-4121-884b-af6dd45129ed None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:55.982749 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 391/776] 10.222.0.73 () {56 vars in 1124 bytes} [Fri May 13 14:50:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:55.989929 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764476c9-9d66-4121-884b-af6dd45129ed None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:56.120913 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764476c9-9d66-4121-884b-af6dd45129ed None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:56.126870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc4993-c089-490f-9964-1c877b87d084 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:56.177563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1541d9-52d0-47a7-8eee-519650e488aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:56.178474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1541d9-52d0-47a7-8eee-519650e488aa None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:56.178881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1541d9-52d0-47a7-8eee-519650e488aa None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:56.179260 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1541d9-52d0-47a7-8eee-519650e488aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:56.180405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1541d9-52d0-47a7-8eee-519650e488aa None admin] RBAC: Adding query filter params (interface=public, service_id=3fa7dc74559b49f18f9a5a5b3dfccd6c, region_id=RegionOne) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:56.180833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1541d9-52d0-47a7-8eee-519650e488aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:56.182897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1541d9-52d0-47a7-8eee-519650e488aa None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:56.186415 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54d761-d1f9-4b3b-b3d0-eb83c829e437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:56.187151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54d761-d1f9-4b3b-b3d0-eb83c829e437 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:56.187461 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54d761-d1f9-4b3b-b3d0-eb83c829e437 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:56.187779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54d761-d1f9-4b3b-b3d0-eb83c829e437 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:56.188585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac54d761-d1f9-4b3b-b3d0-eb83c829e437 None admin] RBAC: Adding query filter params (interface=public, service_id=fb5512ec0f7c4e2fbaba6021f00a4702, region_id=RegionOne) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:56.188892 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac54d761-d1f9-4b3b-b3d0-eb83c829e437 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:56.190301 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac54d761-d1f9-4b3b-b3d0-eb83c829e437 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:56.196759 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 386/777] 10.222.0.73 () {56 vars in 1251 bytes} [Fri May 13 14:50:55 2022] GET /identity/v3/endpoints?service_id=3fa7dc74559b49f18f9a5a5b3dfccd6c&interface=public®ion_id=RegionOne => generated 194 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:56.202284 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1541d9-52d0-47a7-8eee-519650e488aa None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:56.213556 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 392/778] 10.222.0.73 () {56 vars in 1251 bytes} [Fri May 13 14:50:55 2022] GET /identity/v3/endpoints?service_id=fb5512ec0f7c4e2fbaba6021f00a4702&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:56.223955 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54d761-d1f9-4b3b-b3d0-eb83c829e437 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:56.462399 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1541d9-52d0-47a7-8eee-519650e488aa None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:56.526297 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54d761-d1f9-4b3b-b3d0-eb83c829e437 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:56.540857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965a0bd-10c6-47ed-9447-bcf1043b3f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:56.541529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965a0bd-10c6-47ed-9447-bcf1043b3f11 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:56.541852 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965a0bd-10c6-47ed-9447-bcf1043b3f11 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:56.542140 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965a0bd-10c6-47ed-9447-bcf1043b3f11 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:56.542776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965a0bd-10c6-47ed-9447-bcf1043b3f11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:56.544236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965a0bd-10c6-47ed-9447-bcf1043b3f11 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:56.551801 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 387/779] 10.222.0.73 () {56 vars in 1087 bytes} [Fri May 13 14:50:56 2022] GET /identity/v3/services => generated 772 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:56.615745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ea94f-0112-4975-8293-b197c421dac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:56.616445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ea94f-0112-4975-8293-b197c421dac7 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:56.616726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ea94f-0112-4975-8293-b197c421dac7 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:56.617001 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ea94f-0112-4975-8293-b197c421dac7 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:56.617724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ea94f-0112-4975-8293-b197c421dac7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:56.619191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ea94f-0112-4975-8293-b197c421dac7 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:56.626004 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 393/780] 10.222.0.73 () {56 vars in 1087 bytes} [Fri May 13 14:50:56 2022] GET /identity/v3/services => generated 772 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:57.712983 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1add45-c9ef-4e94-80ef-12dc9e37cdfb None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:57.713701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1add45-c9ef-4e94-80ef-12dc9e37cdfb None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:57.713882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1add45-c9ef-4e94-80ef-12dc9e37cdfb None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:57.717134 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 388/781] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:57.725233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f781ce6-727c-4083-9b3b-426f4eb3b534 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:57.725964 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f781ce6-727c-4083-9b3b-426f4eb3b534 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:57.726207 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f781ce6-727c-4083-9b3b-426f4eb3b534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:57.761075 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-0f781ce6-727c-4083-9b3b-426f4eb3b534 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:57.763202 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-0f781ce6-727c-4083-9b3b-426f4eb3b534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:57.878261 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea9aa9-0c19-4624-9632-a180e79c0afb None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:57.878723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea9aa9-0c19-4624-9632-a180e79c0afb None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:57.879805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea9aa9-0c19-4624-9632-a180e79c0afb None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:57.882797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 389/782] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:57.893371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b60094-6678-4a42-af72-73d96cce50ef None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:57.893796 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b60094-6678-4a42-af72-73d96cce50ef None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:57.894205 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b60094-6678-4a42-af72-73d96cce50ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:57.902587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 394/783] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:50:57.936832 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-e9b60094-6678-4a42-af72-73d96cce50ef None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:57.939158 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-e9b60094-6678-4a42-af72-73d96cce50ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:57.953562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f781ce6-727c-4083-9b3b-426f4eb3b534 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:58.072797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 390/784] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:50:58.109519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b60094-6678-4a42-af72-73d96cce50ef None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:58.212553 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f781ce6-727c-4083-9b3b-426f4eb3b534 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:58.251439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede4218-fd2e-4404-bb21-82f366cde063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:58.252244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede4218-fd2e-4404-bb21-82f366cde063 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:58.252517 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede4218-fd2e-4404-bb21-82f366cde063 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:58.252804 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede4218-fd2e-4404-bb21-82f366cde063 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:58.284165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede4218-fd2e-4404-bb21-82f366cde063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:58.306076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-6ede4218-fd2e-4404-bb21-82f366cde063 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:50:58.306076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:58.306076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:58.306076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:58.306076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:58.306076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:58.306076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:58.306076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:58.306076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:58.306076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:58.306076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:58.306076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:58.306076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:58.306076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:58.306076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:58.306076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:58.307694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:58.307694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:58.307694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:58.307694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:58.307694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:58.307694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:58.307694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:58.307694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:58.307694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:58.307694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:58.307694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:58.307694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:58.307694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:58.307694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:58.307694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:58.307694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:58.309311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:58.309311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:58.309311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:58.309311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:58.309311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:58.309311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:58.309311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:58.309311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:58.309311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:58.309311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:58.309311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:50:58.309311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:58.309311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 395/785] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:50:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:58.314943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede4218-fd2e-4404-bb21-82f366cde063 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:58.318941 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b60094-6678-4a42-af72-73d96cce50ef None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:58.405193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46698555-4fc1-4ada-a8a6-2d72f266a760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:58.406564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46698555-4fc1-4ada-a8a6-2d72f266a760 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:58.407011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46698555-4fc1-4ada-a8a6-2d72f266a760 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:58.407494 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46698555-4fc1-4ada-a8a6-2d72f266a760 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:58.460419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46698555-4fc1-4ada-a8a6-2d72f266a760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:58.465900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede4218-fd2e-4404-bb21-82f366cde063 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:58.482916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-46698555-4fc1-4ada-a8a6-2d72f266a760 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:58.482916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:58.482916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:58.482916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:58.482916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:58.482916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:58.482916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:58.482916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:58.482916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:58.482916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:58.482916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:58.482916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:58.482916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:58.482916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:58.482916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:58.482916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:58.484110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:58.484110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:58.484110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:58.484110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:58.484110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:58.484110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:58.484110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:58.484110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:58.484110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:58.484110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:58.484110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:58.484110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:58.484110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:58.484110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:58.484110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:58.484110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:58.485062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:58.485062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:58.485062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:58.485062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:58.485062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:58.485062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:58.485062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:58.485062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:58.485062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:58.485062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:58.485062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:50:58.485062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:58.490135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 391/786] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:50:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:50:58.496569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46698555-4fc1-4ada-a8a6-2d72f266a760 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:58.508556 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab30d7-b583-450e-ba6a-687701bffd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:58.509548 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab30d7-b583-450e-ba6a-687701bffd04 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:58.509979 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab30d7-b583-450e-ba6a-687701bffd04 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:58.510394 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab30d7-b583-450e-ba6a-687701bffd04 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:58.511363 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab30d7-b583-450e-ba6a-687701bffd04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:58.511841 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab30d7-b583-450e-ba6a-687701bffd04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:58.513403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab30d7-b583-450e-ba6a-687701bffd04 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:58.527097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 396/787] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:50:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:58.530548 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab30d7-b583-450e-ba6a-687701bffd04 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:58.646715 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab30d7-b583-450e-ba6a-687701bffd04 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:58.685284 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfb029-8134-495b-9acf-2b49b3ffc701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:58.686349 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfb029-8134-495b-9acf-2b49b3ffc701 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:58.686782 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfb029-8134-495b-9acf-2b49b3ffc701 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:58.687225 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfb029-8134-495b-9acf-2b49b3ffc701 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:58.700651 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bfb029-8134-495b-9acf-2b49b3ffc701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:58.702411 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bfb029-8134-495b-9acf-2b49b3ffc701 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:58.721753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-69bfb029-8134-495b-9acf-2b49b3ffc701 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:58.721753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:58.721753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:58.721753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:58.721753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:58.721753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:58.721753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:58.721753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:58.721753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:58.721753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:58.721753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:58.721753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:58.721753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:58.721753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:58.721753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:58.722994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:58.722994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:58.722994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:58.722994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:58.722994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:58.722994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:58.722994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:58.722994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:58.722994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:50:58.722994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:58.722994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:58.722994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:58.722994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:58.722994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:58.722994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:58.722994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:58.722994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:58.723904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:58.723904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:58.723904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:58.723904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:50:58.726422 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 397/788] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:50:58.733178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfb029-8134-495b-9acf-2b49b3ffc701 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:58.815762 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46698555-4fc1-4ada-a8a6-2d72f266a760 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:58.859007 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f6ae2-889d-4a3c-898e-af4b48c165a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:58.859821 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f6ae2-889d-4a3c-898e-af4b48c165a4 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:58.860113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f6ae2-889d-4a3c-898e-af4b48c165a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:58.860425 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f6ae2-889d-4a3c-898e-af4b48c165a4 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:58.861638 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f6ae2-889d-4a3c-898e-af4b48c165a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:58.861996 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f6ae2-889d-4a3c-898e-af4b48c165a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:58.863994 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f6ae2-889d-4a3c-898e-af4b48c165a4 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:58.875364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 392/789] 10.222.0.73 () {56 vars in 1103 bytes} [Fri May 13 14:50:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:58.881887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f6ae2-889d-4a3c-898e-af4b48c165a4 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:58.952955 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfb029-8134-495b-9acf-2b49b3ffc701 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:59.005770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f6ae2-889d-4a3c-898e-af4b48c165a4 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:59.047516 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff9744-4fdd-4e7e-85f8-e04710e4b80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:59.048456 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff9744-4fdd-4e7e-85f8-e04710e4b80f None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:59.048747 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff9744-4fdd-4e7e-85f8-e04710e4b80f None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:59.049025 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff9744-4fdd-4e7e-85f8-e04710e4b80f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:59.062855 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff9744-4fdd-4e7e-85f8-e04710e4b80f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:59.064491 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff9744-4fdd-4e7e-85f8-e04710e4b80f None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:59.064889 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ef91b-78ef-49d5-9b91-4dceaeb10181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:59.065805 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ef91b-78ef-49d5-9b91-4dceaeb10181 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:59.066850 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ef91b-78ef-49d5-9b91-4dceaeb10181 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:59.067286 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ef91b-78ef-49d5-9b91-4dceaeb10181 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:59.068141 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ef91b-78ef-49d5-9b91-4dceaeb10181 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:59.068571 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ef91b-78ef-49d5-9b91-4dceaeb10181 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:59.070067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ef91b-78ef-49d5-9b91-4dceaeb10181 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:59.083206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 398/790] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:59.084727 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb29c4f-6c3e-4b73-8c5f-abae1f19e216 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:59.085170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-c4ff9744-4fdd-4e7e-85f8-e04710e4b80f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:59.085170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:59.085170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:59.085170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:59.085170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:59.085170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:59.085170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:59.085170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:59.085170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:59.085170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:59.085170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:59.085170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:59.085170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:50:59.085170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:50:59.085170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:50:59.086806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:50:59.086806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:59.086806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:59.086806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:59.086806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:59.086806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:59.086806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:59.086806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:59.086806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:59.086806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:59.086806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:59.086806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:59.086806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:59.086806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:59.086806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:59.086806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:59.086806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:59.088654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:50:59.088654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:50:59.088654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:50:59.088654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:59.088654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 393/791] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:50:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:59.098909 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb29c4f-6c3e-4b73-8c5f-abae1f19e216 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:59.098909 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb29c4f-6c3e-4b73-8c5f-abae1f19e216 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:59.099336 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff9744-4fdd-4e7e-85f8-e04710e4b80f None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:59.099511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 399/792] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:50:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:50:59.099511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb29c4f-6c3e-4b73-8c5f-abae1f19e216 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:59.268247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb29c4f-6c3e-4b73-8c5f-abae1f19e216 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:59.277324 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff9744-4fdd-4e7e-85f8-e04710e4b80f None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:59.344308 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645c363-65f9-4467-918a-76fdc0ad6b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:59.344574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66e04e-0a2c-42d8-b309-02230c710567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:59.345364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66e04e-0a2c-42d8-b309-02230c710567 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:59.345824 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66e04e-0a2c-42d8-b309-02230c710567 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:59.346091 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645c363-65f9-4467-918a-76fdc0ad6b28 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:59.346282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66e04e-0a2c-42d8-b309-02230c710567 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:59.346760 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645c363-65f9-4467-918a-76fdc0ad6b28 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:59.347352 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645c363-65f9-4467-918a-76fdc0ad6b28 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:59.348039 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66e04e-0a2c-42d8-b309-02230c710567 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:59.348549 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66e04e-0a2c-42d8-b309-02230c710567 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:59.351227 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66e04e-0a2c-42d8-b309-02230c710567 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:59.361722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645c363-65f9-4467-918a-76fdc0ad6b28 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:59.364982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645c363-65f9-4467-918a-76fdc0ad6b28 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:59.374290 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 400/793] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:59.377173 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002441a-10d8-46db-81a1-d6294b433bc5 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:59.377628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002441a-10d8-46db-81a1-d6294b433bc5 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:59.378151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002441a-10d8-46db-81a1-d6294b433bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:59.392920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-4645c363-65f9-4467-918a-76fdc0ad6b28 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 14:50:59.392920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:59.392920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:59.392920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:59.392920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:59.392920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:59.392920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:59.392920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:59.392920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:59.392920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:59.392920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:59.392920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:59.392920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:50:59.392920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:50:59.392920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:50:59.392920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:50:59.395976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:59.395976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:59.395976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:50:59.395976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:59.395976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:50:59.395976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:59.395976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:59.395976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:59.395976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:59.395976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:59.395976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:59.395976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:59.395976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:59.395976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:59.395976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:59.395976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:59.395976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:59.395976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:59.399156 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:59.399156 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:59.399156 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:50:59.399156 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:50:59.399156 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:50:59.399156 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:50:59.399156 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:50:59.399156 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:50:59.399156 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 14:50:59.399156 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:59.411157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 394/794] 10.222.0.73 () {56 vars in 1093 bytes} [Fri May 13 14:50:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:59.411157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645c363-65f9-4467-918a-76fdc0ad6b28 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:59.411557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-6002441a-10d8-46db-81a1-d6294b433bc5 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:50:59.411557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-6002441a-10d8-46db-81a1-d6294b433bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:50:59.552857 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 401/795] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:50:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:50:59.554336 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002441a-10d8-46db-81a1-d6294b433bc5 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:59.596080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645c363-65f9-4467-918a-76fdc0ad6b28 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:59.657716 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170ec12-ba01-4ce6-9eed-8b8424b58573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:59.659095 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170ec12-ba01-4ce6-9eed-8b8424b58573 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:59.659557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170ec12-ba01-4ce6-9eed-8b8424b58573 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:59.660064 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170ec12-ba01-4ce6-9eed-8b8424b58573 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:59.674018 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170ec12-ba01-4ce6-9eed-8b8424b58573 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:59.677251 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170ec12-ba01-4ce6-9eed-8b8424b58573 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:59.704871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-8170ec12-ba01-4ce6-9eed-8b8424b58573 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:50:59.704871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:59.704871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:59.704871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:59.704871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:59.704871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:59.704871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:59.704871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:59.704871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:59.704871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:59.704871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:59.704871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:59.704871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:50:59.704871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:50:59.704871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:50:59.704871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:50:59.709110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:59.709110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:59.709110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:50:59.709110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:59.709110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:50:59.709110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:50:59.709110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:59.709110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:59.709110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:59.709110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:59.709110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:59.709110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:59.709110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:59.709110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:59.709110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:59.709110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:59.709110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:59.709110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:59.724089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:59.724089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:59.724089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:50:59.724089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:50:59.724089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:50:59.724089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:50:59.724089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:50:59.724089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:50:59.724089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:50:59.724089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:59.724089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 395/796] 10.222.0.73 () {56 vars in 1117 bytes} [Fri May 13 14:50:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:59.724089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170ec12-ba01-4ce6-9eed-8b8424b58573 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:59.766767 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002441a-10d8-46db-81a1-d6294b433bc5 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:59.817467 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b9395-08ee-45e0-9fe9-cb7c4164ae43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:59.818561 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b9395-08ee-45e0-9fe9-cb7c4164ae43 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:59.819085 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b9395-08ee-45e0-9fe9-cb7c4164ae43 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:59.819563 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b9395-08ee-45e0-9fe9-cb7c4164ae43 None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:59.820646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b9395-08ee-45e0-9fe9-cb7c4164ae43 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:50:59.821176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b9395-08ee-45e0-9fe9-cb7c4164ae43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:50:59.822959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b9395-08ee-45e0-9fe9-cb7c4164ae43 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:50:59.851061 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 402/797] 10.222.0.73 () {56 vars in 1133 bytes} [Fri May 13 14:50:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:50:59.852479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b9395-08ee-45e0-9fe9-cb7c4164ae43 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:50:59.889747 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170ec12-ba01-4ce6-9eed-8b8424b58573 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:59.953933 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94edb2c-9501-4208-b79f-fd536726c159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:50:59.955181 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94edb2c-9501-4208-b79f-fd536726c159 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:50:59.955992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94edb2c-9501-4208-b79f-fd536726c159 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:50:59.956691 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94edb2c-9501-4208-b79f-fd536726c159 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:50:59.975929 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94edb2c-9501-4208-b79f-fd536726c159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:50:59.990060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-c94edb2c-9501-4208-b79f-fd536726c159 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:50:59.990060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:50:59.990060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:50:59.990060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:50:59.990060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:50:59.990060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:50:59.990060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:50:59.990060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:50:59.990060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:50:59.990060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:50:59.990060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:50:59.990060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:50:59.990060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:50:59.990060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:50:59.990060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:50:59.990060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:50:59.991870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:50:59.991870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:50:59.991870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:50:59.991870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:50:59.991870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:50:59.991870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:50:59.991870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:50:59.991870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:50:59.991870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:50:59.991870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:50:59.991870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:50:59.991870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:50:59.991870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:50:59.991870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:50:59.991870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:50:59.991870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:50:59.993689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:50:59.993689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:50:59.993689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:50:59.993689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:50:59.993689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:50:59.993689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:50:59.993689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:50:59.993689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:50:59.993689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:50:59.993689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:50:59.993689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:50:59.993689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:50:59.994850 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b9395-08ee-45e0-9fe9-cb7c4164ae43 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:50:59.997449 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 396/798] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:50:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:50:59.999146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94edb2c-9501-4208-b79f-fd536726c159 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:00.030333 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092eb95-6fbd-423e-aa0c-96fcb0038935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:00.031127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092eb95-6fbd-423e-aa0c-96fcb0038935 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:00.031570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092eb95-6fbd-423e-aa0c-96fcb0038935 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:00.032067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092eb95-6fbd-423e-aa0c-96fcb0038935 None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:00.033131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092eb95-6fbd-423e-aa0c-96fcb0038935 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:00.033611 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092eb95-6fbd-423e-aa0c-96fcb0038935 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:00.035960 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092eb95-6fbd-423e-aa0c-96fcb0038935 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:00.060966 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 403/799] 10.222.0.73 () {56 vars in 1149 bytes} [Fri May 13 14:50:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:00.062202 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092eb95-6fbd-423e-aa0c-96fcb0038935 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:00.176282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092eb95-6fbd-423e-aa0c-96fcb0038935 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:00.190757 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94edb2c-9501-4208-b79f-fd536726c159 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:00.216047 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1bfbd-24df-4e0a-b298-8a650c2dd6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:00.219782 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1bfbd-24df-4e0a-b298-8a650c2dd6ec None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:00.221614 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1bfbd-24df-4e0a-b298-8a650c2dd6ec None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:00.222093 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1bfbd-24df-4e0a-b298-8a650c2dd6ec None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:00.223148 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1bfbd-24df-4e0a-b298-8a650c2dd6ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:00.223619 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1bfbd-24df-4e0a-b298-8a650c2dd6ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:00.225188 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1bfbd-24df-4e0a-b298-8a650c2dd6ec None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:00.235216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 404/800] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:51:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:00.236651 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1bfbd-24df-4e0a-b298-8a650c2dd6ec None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:00.258619 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b7f48-bde6-4359-b3e8-e7a9f69be30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:00.259797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b7f48-bde6-4359-b3e8-e7a9f69be30f None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:00.260557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b7f48-bde6-4359-b3e8-e7a9f69be30f None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:00.260793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b7f48-bde6-4359-b3e8-e7a9f69be30f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:00.358364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1bfbd-24df-4e0a-b298-8a650c2dd6ec None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:00.369224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b7f48-bde6-4359-b3e8-e7a9f69be30f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:00.372131 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b7f48-bde6-4359-b3e8-e7a9f69be30f None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:00.402273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54730a7d-34f9-44ab-9c90-9b1d58591f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:00.403415 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54730a7d-34f9-44ab-9c90-9b1d58591f83 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:00.403825 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54730a7d-34f9-44ab-9c90-9b1d58591f83 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:00.404244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54730a7d-34f9-44ab-9c90-9b1d58591f83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:00.417597 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54730a7d-34f9-44ab-9c90-9b1d58591f83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:00.419405 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54730a7d-34f9-44ab-9c90-9b1d58591f83 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:00.440134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-54730a7d-34f9-44ab-9c90-9b1d58591f83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:00.440134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:00.440134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:00.440134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:00.440134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:00.440134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:00.440134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:00.440134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:00.440134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:00.440134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:00.440134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:00.440134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:00.440134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:51:00.440134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:51:00.440134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:51:00.442701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:51:00.442701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:00.442701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:00.442701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:00.442701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:00.442701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:00.442701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:00.442701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:00.442701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:00.442701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:00.442701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:00.442701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:00.442701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:00.442701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:00.442701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:00.442701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:00.442701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:00.445383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:51:00.445383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:51:00.445383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:00.445383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:00.445383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 405/801] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:00.445383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54730a7d-34f9-44ab-9c90-9b1d58591f83 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:00.558545 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 397/802] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:50:59 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:51:00.560963 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64d430-bf7d-487f-9390-942e9d01fa92 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:00.561450 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64d430-bf7d-487f-9390-942e9d01fa92 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:00.561927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64d430-bf7d-487f-9390-942e9d01fa92 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:00.564700 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 398/803] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:00.568439 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64d430-bf7d-487f-9390-942e9d01fa92 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:00.594671 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54730a7d-34f9-44ab-9c90-9b1d58591f83 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:00.655587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c3032-69f1-4d77-8bbe-08d0facef335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:00.656465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c3032-69f1-4d77-8bbe-08d0facef335 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:00.656747 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c3032-69f1-4d77-8bbe-08d0facef335 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:00.657027 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c3032-69f1-4d77-8bbe-08d0facef335 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:00.672298 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c3032-69f1-4d77-8bbe-08d0facef335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:00.674242 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c3032-69f1-4d77-8bbe-08d0facef335 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:00.695476 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-867c3032-69f1-4d77-8bbe-08d0facef335 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:00.695476 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:00.695476 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:00.695476 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:00.695476 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:00.695476 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:00.695476 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:00.695476 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:00.695476 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:00.695476 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:00.695476 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:00.695476 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:00.695476 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:51:00.695476 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:51:00.695476 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:51:00.697265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:51:00.697265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:00.697265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:00.697265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:00.697265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:00.697265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:00.697265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:00.697265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:00.697265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:00.697265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:00.697265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:00.697265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:00.697265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:00.697265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:00.697265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:00.697265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:00.697265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:00.699362 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:51:00.699362 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:51:00.699362 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:00.699362 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:00.699362 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 406/804] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:00.699362 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c3032-69f1-4d77-8bbe-08d0facef335 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:00.747918 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64d430-bf7d-487f-9390-942e9d01fa92 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:00.808718 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501e92d-c47a-464b-8831-1d30c5330f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:00.809790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501e92d-c47a-464b-8831-1d30c5330f4c None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:00.810233 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501e92d-c47a-464b-8831-1d30c5330f4c None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:00.810663 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501e92d-c47a-464b-8831-1d30c5330f4c None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:00.811925 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501e92d-c47a-464b-8831-1d30c5330f4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:00.812418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501e92d-c47a-464b-8831-1d30c5330f4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:00.814842 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501e92d-c47a-464b-8831-1d30c5330f4c None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:00.836866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 399/805] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:00.839174 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783a9e2-f3d2-41c9-9aa8-0e465e0940f0 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:00.839666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783a9e2-f3d2-41c9-9aa8-0e465e0940f0 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:00.840140 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783a9e2-f3d2-41c9-9aa8-0e465e0940f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:00.868094 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-7783a9e2-f3d2-41c9-9aa8-0e465e0940f0 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:00.870168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-7783a9e2-f3d2-41c9-9aa8-0e465e0940f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:00.873358 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c3032-69f1-4d77-8bbe-08d0facef335 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:00.934714 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7368b6c-eb57-485b-a3f5-82abe5b89844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:00.936080 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7368b6c-eb57-485b-a3f5-82abe5b89844 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:00.936477 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7368b6c-eb57-485b-a3f5-82abe5b89844 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:00.936917 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7368b6c-eb57-485b-a3f5-82abe5b89844 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:00.956393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7368b6c-eb57-485b-a3f5-82abe5b89844 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:00.958120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7368b6c-eb57-485b-a3f5-82abe5b89844 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:00.976512 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 400/806] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:00.977895 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783a9e2-f3d2-41c9-9aa8-0e465e0940f0 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:00.981319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-e7368b6c-eb57-485b-a3f5-82abe5b89844 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:00.981319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:00.981319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:00.981319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:00.981319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:00.981319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:00.981319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:00.981319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:00.981319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:00.981319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:00.981319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:00.981319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:00.981319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:51:00.981319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:51:00.981319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:51:00.982629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:51:00.982629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:00.982629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:00.982629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:00.982629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:00.982629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:00.982629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:00.982629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:00.982629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:00.982629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:00.982629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:00.982629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:00.982629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:00.982629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:00.982629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:00.982629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:00.982629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:00.983718 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:51:00.983718 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:51:00.983718 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:00.983718 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:00.983718 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 407/807] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:00.985184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7368b6c-eb57-485b-a3f5-82abe5b89844 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:01.134167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783a9e2-f3d2-41c9-9aa8-0e465e0940f0 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:01.148588 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7368b6c-eb57-485b-a3f5-82abe5b89844 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:01.189829 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ca7a0-2456-486b-b857-5ab024d1f022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:01.190890 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ca7a0-2456-486b-b857-5ab024d1f022 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:01.191573 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ca7a0-2456-486b-b857-5ab024d1f022 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:01.191993 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ca7a0-2456-486b-b857-5ab024d1f022 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:01.193242 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ca7a0-2456-486b-b857-5ab024d1f022 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:01.193669 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ca7a0-2456-486b-b857-5ab024d1f022 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:01.196089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ca7a0-2456-486b-b857-5ab024d1f022 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:01.203483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c5691-272b-419c-b77e-ba5f9fdc09cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:01.204775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c5691-272b-419c-b77e-ba5f9fdc09cd None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:01.205216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c5691-272b-419c-b77e-ba5f9fdc09cd None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:01.205652 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c5691-272b-419c-b77e-ba5f9fdc09cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:01.220484 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 401/808] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:01.220681 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c5691-272b-419c-b77e-ba5f9fdc09cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:01.220797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c5b69-7477-4f73-8e35-4d8ebb4d26e0 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:01.220797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c5b69-7477-4f73-8e35-4d8ebb4d26e0 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:01.220797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c5b69-7477-4f73-8e35-4d8ebb4d26e0 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:01.221039 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c5691-272b-419c-b77e-ba5f9fdc09cd None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:01.222862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 402/809] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:01.222862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c5b69-7477-4f73-8e35-4d8ebb4d26e0 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:01.236177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-840c5691-272b-419c-b77e-ba5f9fdc09cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:01.236177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:01.236177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:01.236177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:01.236177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:01.236177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:01.236177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:01.236177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:01.236177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:01.236177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:01.236177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:01.236177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:01.236177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:51:01.236177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:51:01.236177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:51:01.238372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:51:01.238372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:01.238372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:01.238372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:01.238372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:01.238372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:01.238372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:01.238372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:01.238372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:01.238372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:01.238372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:01.238372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:01.238372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:01.238372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:01.238372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:01.238372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:01.238372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:01.239670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:51:01.239670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:51:01.239670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:51:01.239670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:51:01.239670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:51:01.239670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:51:01.239670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:01.239670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:01.239670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 408/810] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:51:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:01.239670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c5691-272b-419c-b77e-ba5f9fdc09cd None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:01.341634 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c5b69-7477-4f73-8e35-4d8ebb4d26e0 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:01.346543 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c5691-272b-419c-b77e-ba5f9fdc09cd None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:01.376500 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6b63c-2d26-48f8-959d-c5782f835e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:01.377184 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6b63c-2d26-48f8-959d-c5782f835e19 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:01.377455 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6b63c-2d26-48f8-959d-c5782f835e19 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:01.377727 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6b63c-2d26-48f8-959d-c5782f835e19 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:01.378449 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6b63c-2d26-48f8-959d-c5782f835e19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:01.379318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6b63c-2d26-48f8-959d-c5782f835e19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:01.380738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6b63c-2d26-48f8-959d-c5782f835e19 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:01.383046 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1425fc-287f-43c8-9f8c-42c5dd9acf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:01.384186 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1425fc-287f-43c8-9f8c-42c5dd9acf14 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:01.384561 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1425fc-287f-43c8-9f8c-42c5dd9acf14 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:01.384935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1425fc-287f-43c8-9f8c-42c5dd9acf14 None admin] PATH_INFO: `/v3/services/network` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:01.385719 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1425fc-287f-43c8-9f8c-42c5dd9acf14 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:01.387248 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1425fc-287f-43c8-9f8c-42c5dd9acf14 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:01.393918 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 403/811] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:01.394919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6b63c-2d26-48f8-959d-c5782f835e19 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:01.400665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-af1425fc-287f-43c8-9f8c-42c5dd9acf14 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 13 14:51:01.400665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:01.400665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:51:01.400665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:51:01.400665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:51:01.400665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:51:01.400665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:51:01.400665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:01.400665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 14:51:01.400665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:01.400665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:51:01.400665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:01.400665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:01.400665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:01.400665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:01.400665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:01.400665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:01.402638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:01.402638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:01.402638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:01.402638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:01.402638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:01.402638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:01.402638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:51:01.402638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:51:01.402638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:51:01.402638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:51:01.402638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:01.402638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:01.402638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:01.402638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:01.402638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:01.402638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:01.404643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:01.404643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:01.404643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:01.404643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:01.404643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:01.404643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:01.404643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:01.404643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:01.404643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:01.404643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:01.404643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:51:01.404643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:01.404643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 14:51:01.404643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:01.404643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 409/812] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:51:01 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:01.406211 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ba75f-d37a-449e-aab9-9d4e2fcf1c4f None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:01.406211 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ba75f-d37a-449e-aab9-9d4e2fcf1c4f None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:01.406211 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ba75f-d37a-449e-aab9-9d4e2fcf1c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:01.422264 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-528ba75f-d37a-449e-aab9-9d4e2fcf1c4f None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:01.423546 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-528ba75f-d37a-449e-aab9-9d4e2fcf1c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:01.499823 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 410/813] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:01.501016 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ba75f-d37a-449e-aab9-9d4e2fcf1c4f None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:01.520875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6b63c-2d26-48f8-959d-c5782f835e19 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:01.557782 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34541951-c812-42d8-8e71-028662965164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:01.558570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34541951-c812-42d8-8e71-028662965164 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:01.558879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34541951-c812-42d8-8e71-028662965164 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:01.559154 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34541951-c812-42d8-8e71-028662965164 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:01.568370 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34541951-c812-42d8-8e71-028662965164 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:01.569852 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34541951-c812-42d8-8e71-028662965164 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:01.586793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-34541951-c812-42d8-8e71-028662965164 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 14:51:01.586793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:01.586793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:01.586793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:01.586793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:01.586793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:01.586793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:01.586793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:01.586793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:01.586793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:01.586793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:01.586793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:01.586793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:51:01.586793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:51:01.586793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:51:01.586793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:51:01.587875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:01.587875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:01.587875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:51:01.587875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:51:01.587875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:51:01.587875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:51:01.587875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:01.587875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:01.587875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:01.587875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:01.587875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:01.587875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:01.587875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:01.587875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:01.587875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:01.587875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:01.587875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:01.587875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:01.588815 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:01.588815 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:01.588815 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:51:01.588815 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:51:01.588815 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:51:01.588815 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:51:01.588815 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:51:01.588815 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:51:01.588815 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 14:51:01.588815 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:01.588815 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 404/814] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:51:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:01.590550 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34541951-c812-42d8-8e71-028662965164 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:01.626549 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ba75f-d37a-449e-aab9-9d4e2fcf1c4f None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:01.663008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e5654-5c87-4e9e-8598-8ad9809d82ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:01.663691 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e5654-5c87-4e9e-8598-8ad9809d82ad None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:01.664002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e5654-5c87-4e9e-8598-8ad9809d82ad None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:01.664255 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e5654-5c87-4e9e-8598-8ad9809d82ad None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:01.665059 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e5654-5c87-4e9e-8598-8ad9809d82ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:01.665364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e5654-5c87-4e9e-8598-8ad9809d82ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:01.666866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e5654-5c87-4e9e-8598-8ad9809d82ad None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:01.681294 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 411/815] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:51:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:01.682178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e5654-5c87-4e9e-8598-8ad9809d82ad None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:01.704919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34541951-c812-42d8-8e71-028662965164 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:01.747228 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc18ae8-73fa-40b5-b6ca-c7dd4707dc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:01.748202 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc18ae8-73fa-40b5-b6ca-c7dd4707dc28 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:01.748552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc18ae8-73fa-40b5-b6ca-c7dd4707dc28 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:01.748905 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc18ae8-73fa-40b5-b6ca-c7dd4707dc28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:01.758748 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc18ae8-73fa-40b5-b6ca-c7dd4707dc28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:01.760788 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc18ae8-73fa-40b5-b6ca-c7dd4707dc28 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:01.777647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-4dc18ae8-73fa-40b5-b6ca-c7dd4707dc28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:01.777647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:01.777647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:01.777647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:01.777647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:01.777647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:01.777647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:01.777647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:01.777647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:01.777647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:01.777647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:01.777647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:01.777647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:51:01.777647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:51:01.777647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:51:01.779430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:51:01.779430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:01.779430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:01.779430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:01.779430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:01.779430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:01.779430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:01.779430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:01.779430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:01.779430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:01.779430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:01.779430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:01.779430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:01.779430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:01.779430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:01.779430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:01.779430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:01.781273 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:51:01.781273 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:51:01.781273 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:51:01.781273 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:51:01.781273 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:51:01.781273 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:51:01.781273 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:01.781273 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:01.781273 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 405/816] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:51:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:01.782224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc18ae8-73fa-40b5-b6ca-c7dd4707dc28 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:01.811454 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e5654-5c87-4e9e-8598-8ad9809d82ad None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:01.856853 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cc63a-14ec-495a-af64-510f6ff8f17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:01.857715 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cc63a-14ec-495a-af64-510f6ff8f17f None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:01.858064 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cc63a-14ec-495a-af64-510f6ff8f17f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:01.858417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cc63a-14ec-495a-af64-510f6ff8f17f None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:01.859442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cc63a-14ec-495a-af64-510f6ff8f17f None admin] RBAC: Adding query filter params (name=network) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:01.859909 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cc63a-14ec-495a-af64-510f6ff8f17f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:01.861487 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cc63a-14ec-495a-af64-510f6ff8f17f None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:01.868094 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 412/817] 10.222.0.73 () {56 vars in 1112 bytes} [Fri May 13 14:51:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:01.869189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cc63a-14ec-495a-af64-510f6ff8f17f None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:01.922680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc18ae8-73fa-40b5-b6ca-c7dd4707dc28 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:01.974135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958b1ae-c431-4479-94a8-d6bd6cb8b4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:01.975086 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958b1ae-c431-4479-94a8-d6bd6cb8b4a8 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:01.975437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958b1ae-c431-4479-94a8-d6bd6cb8b4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:01.975770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958b1ae-c431-4479-94a8-d6bd6cb8b4a8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:01.976499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958b1ae-c431-4479-94a8-d6bd6cb8b4a8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:01.978194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958b1ae-c431-4479-94a8-d6bd6cb8b4a8 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:01.991560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-a958b1ae-c431-4479-94a8-d6bd6cb8b4a8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 14:51:01.991560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:01.991560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:51:01.991560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:51:01.991560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:51:01.991560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:51:01.991560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:51:01.991560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:01.991560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 14:51:01.991560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:01.991560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:51:01.991560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:01.991560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:01.991560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:01.991560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:01.991560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:01.993666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:01.993666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:01.993666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:01.993666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:01.993666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:01.993666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:01.993666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:01.993666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:51:01.993666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:51:01.993666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:51:01.993666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:51:01.993666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:01.993666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:01.993666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:01.993666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:01.993666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:01.995356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:01.995356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:01.995356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:01.995356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:01.995356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:01.995356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:01.995356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:01.995356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:01.995356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:01.995356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:01.995356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:01.995356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:51:01.995356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:01.995356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 14:51:01.995356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:01.995356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 406/818] 10.222.0.73 () {56 vars in 1129 bytes} [Fri May 13 14:51:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:01.996993 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958b1ae-c431-4479-94a8-d6bd6cb8b4a8 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:02.031854 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cc63a-14ec-495a-af64-510f6ff8f17f None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:02.084801 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fb56b-3f2e-4052-8801-b0a1dbe36ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:02.085874 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fb56b-3f2e-4052-8801-b0a1dbe36ecc None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:02.086317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fb56b-3f2e-4052-8801-b0a1dbe36ecc None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:02.086762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fb56b-3f2e-4052-8801-b0a1dbe36ecc None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:02.088256 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fb56b-3f2e-4052-8801-b0a1dbe36ecc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:02.088776 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fb56b-3f2e-4052-8801-b0a1dbe36ecc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:02.091206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fb56b-3f2e-4052-8801-b0a1dbe36ecc None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:02.115459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 413/819] 10.222.0.73 () {56 vars in 1135 bytes} [Fri May 13 14:51:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:02.116981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fb56b-3f2e-4052-8801-b0a1dbe36ecc None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:02.146716 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958b1ae-c431-4479-94a8-d6bd6cb8b4a8 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:02.208922 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0ab75-9841-464f-956c-a3de1034e98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:02.210532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0ab75-9841-464f-956c-a3de1034e98a None admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:02.211067 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0ab75-9841-464f-956c-a3de1034e98a None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:02.211550 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0ab75-9841-464f-956c-a3de1034e98a None admin] PATH_INFO: `/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/0c04f5fb770d49c0a50f2cfbd77e17e0/roles/354a460a8146476989f8a7b4fc1aac93` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:02.229346 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fb56b-3f2e-4052-8801-b0a1dbe36ecc None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:02.238316 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0ab75-9841-464f-956c-a3de1034e98a None admin] RBAC: Authorizing `identity:create_grant(project_id=48788e7517a14ca5b5af9f161512ac9c, user_id=0c04f5fb770d49c0a50f2cfbd77e17e0, role_id=354a460a8146476989f8a7b4fc1aac93)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:02.241152 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0ab75-9841-464f-956c-a3de1034e98a None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:02.259409 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 407/820] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:51:01 2022] PUT /identity/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/0c04f5fb770d49c0a50f2cfbd77e17e0/roles/354a460a8146476989f8a7b4fc1aac93 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:51:02.260257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0ab75-9841-464f-956c-a3de1034e98a None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:02.270424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f73c72-66a8-444b-bde5-ec3e34ee9eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:02.271387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f73c72-66a8-444b-bde5-ec3e34ee9eda None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:02.271806 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f73c72-66a8-444b-bde5-ec3e34ee9eda None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:02.272249 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f73c72-66a8-444b-bde5-ec3e34ee9eda None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:02.273233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f73c72-66a8-444b-bde5-ec3e34ee9eda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:02.273693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f73c72-66a8-444b-bde5-ec3e34ee9eda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:02.275441 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f73c72-66a8-444b-bde5-ec3e34ee9eda None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:02.296288 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 414/821] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:51:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:02.296288 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f73c72-66a8-444b-bde5-ec3e34ee9eda None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:02.382852 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0ab75-9841-464f-956c-a3de1034e98a None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:02.429923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971e7ef-9a13-43b4-9dc6-2eb46bf2bae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:02.430898 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971e7ef-9a13-43b4-9dc6-2eb46bf2bae7 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:02.431335 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971e7ef-9a13-43b4-9dc6-2eb46bf2bae7 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:02.431757 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971e7ef-9a13-43b4-9dc6-2eb46bf2bae7 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:02.432424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f73c72-66a8-444b-bde5-ec3e34ee9eda None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:02.432757 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971e7ef-9a13-43b4-9dc6-2eb46bf2bae7 None admin] RBAC: Adding query filter params (type=network) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:02.433206 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971e7ef-9a13-43b4-9dc6-2eb46bf2bae7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:02.434964 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971e7ef-9a13-43b4-9dc6-2eb46bf2bae7 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:02.441870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 408/822] 10.222.0.73 () {56 vars in 1112 bytes} [Fri May 13 14:51:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:02.442770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971e7ef-9a13-43b4-9dc6-2eb46bf2bae7 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:02.491597 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23faa4e5-2145-412c-9373-23a1d0075a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:02.492373 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faa4e5-2145-412c-9373-23a1d0075a2b None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:02.492544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faa4e5-2145-412c-9373-23a1d0075a2b None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:02.492848 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faa4e5-2145-412c-9373-23a1d0075a2b None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:02.493576 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23faa4e5-2145-412c-9373-23a1d0075a2b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:02.493874 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23faa4e5-2145-412c-9373-23a1d0075a2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:02.495343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23faa4e5-2145-412c-9373-23a1d0075a2b None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:02.507892 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 415/823] 10.222.0.73 () {56 vars in 1124 bytes} [Fri May 13 14:51:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:02.507892 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23faa4e5-2145-412c-9373-23a1d0075a2b None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:02.601902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971e7ef-9a13-43b4-9dc6-2eb46bf2bae7 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:02.682307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23faa4e5-2145-412c-9373-23a1d0075a2b None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:02.747451 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00480f65-725f-40b4-b62c-1eadbc2ddcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:02.748681 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00480f65-725f-40b4-b62c-1eadbc2ddcad None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:02.749170 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00480f65-725f-40b4-b62c-1eadbc2ddcad None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:02.749658 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00480f65-725f-40b4-b62c-1eadbc2ddcad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:02.751390 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00480f65-725f-40b4-b62c-1eadbc2ddcad None admin] RBAC: Adding query filter params (role.id=b6fbf976763d4795afbfb53a09ec6f6c, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=52d539202cfb40a48b231713e16a599a) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:02.751957 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00480f65-725f-40b4-b62c-1eadbc2ddcad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:02.755316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00480f65-725f-40b4-b62c-1eadbc2ddcad None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:02.775029 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 416/824] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:51:02 2022] GET /identity/v3/role_assignments?user.id=52d539202cfb40a48b231713e16a599a&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=b6fbf976763d4795afbfb53a09ec6f6c => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:02.775029 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00480f65-725f-40b4-b62c-1eadbc2ddcad None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:02.856944 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3b51c-22d9-497d-9119-9a2ab984af06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:02.858224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3b51c-22d9-497d-9119-9a2ab984af06 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:02.858697 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3b51c-22d9-497d-9119-9a2ab984af06 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:02.859202 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3b51c-22d9-497d-9119-9a2ab984af06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:02.879852 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3b51c-22d9-497d-9119-9a2ab984af06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:02.882746 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3b51c-22d9-497d-9119-9a2ab984af06 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:02.917833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-dda3b51c-22d9-497d-9119-9a2ab984af06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:02.917833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:02.917833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:02.917833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:02.917833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:02.917833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:02.917833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:02.917833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:02.917833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:02.917833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:02.917833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:02.917833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:02.917833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:51:02.917833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:51:02.917833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:51:02.918814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:51:02.918814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:02.918814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:02.918814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:02.918814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:02.918814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:02.918814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:02.918814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:02.918814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:02.918814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:02.918814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:02.918814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:02.918814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:02.918814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:02.918814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:02.918814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:02.918814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:02.919749 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:51:02.919749 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:51:02.919749 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:02.919749 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:02.920583 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 409/825] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 478 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:02.922458 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3b51c-22d9-497d-9119-9a2ab984af06 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:02.993659 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00480f65-725f-40b4-b62c-1eadbc2ddcad None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:03.047559 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a84580-187e-4356-aa5f-2351a6692ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:03.048738 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a84580-187e-4356-aa5f-2351a6692ab8 None admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:03.049119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a84580-187e-4356-aa5f-2351a6692ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:03.049584 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a84580-187e-4356-aa5f-2351a6692ab8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:03.051003 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a84580-187e-4356-aa5f-2351a6692ab8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:03.053448 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a84580-187e-4356-aa5f-2351a6692ab8 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:03.095528 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3b51c-22d9-497d-9119-9a2ab984af06 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:03.099913 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 417/826] 10.222.0.73 () {60 vars in 1144 bytes} [Fri May 13 14:51:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:51:03.101904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a84580-187e-4356-aa5f-2351a6692ab8 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:03.152011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b006e-ebaa-4048-9d76-269d63b9c718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:03.152846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b006e-ebaa-4048-9d76-269d63b9c718 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:03.153139 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b006e-ebaa-4048-9d76-269d63b9c718 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:03.153501 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b006e-ebaa-4048-9d76-269d63b9c718 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:03.154456 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b006e-ebaa-4048-9d76-269d63b9c718 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:03.155113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b006e-ebaa-4048-9d76-269d63b9c718 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:03.157002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b006e-ebaa-4048-9d76-269d63b9c718 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:03.164088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 410/827] 10.222.0.73 () {56 vars in 1124 bytes} [Fri May 13 14:51:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:03.173090 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b006e-ebaa-4048-9d76-269d63b9c718 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:03.452958 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b006e-ebaa-4048-9d76-269d63b9c718 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:03.461220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a84580-187e-4356-aa5f-2351a6692ab8 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:03.542732 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f344b8d-6799-4efe-92f0-31b16962ed3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:03.543085 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e17d0-ec32-4270-a8dc-19bd07ec538d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:03.543975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e17d0-ec32-4270-a8dc-19bd07ec538d None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:03.544444 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e17d0-ec32-4270-a8dc-19bd07ec538d None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:03.544929 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e17d0-ec32-4270-a8dc-19bd07ec538d None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:03.545843 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f344b8d-6799-4efe-92f0-31b16962ed3f None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:03.546575 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e17d0-ec32-4270-a8dc-19bd07ec538d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:03.546956 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f344b8d-6799-4efe-92f0-31b16962ed3f None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:03.547984 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f344b8d-6799-4efe-92f0-31b16962ed3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:03.548284 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e17d0-ec32-4270-a8dc-19bd07ec538d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:03.550135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f344b8d-6799-4efe-92f0-31b16962ed3f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:03.551942 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e17d0-ec32-4270-a8dc-19bd07ec538d None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:03.554467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f344b8d-6799-4efe-92f0-31b16962ed3f None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:03.578490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 418/828] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 477 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:03.585648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e17d0-ec32-4270-a8dc-19bd07ec538d None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:03.601022 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 411/829] 10.222.0.73 () {60 vars in 1144 bytes} [Fri May 13 14:51:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:51:03.762391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e17d0-ec32-4270-a8dc-19bd07ec538d None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:03.823395 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed877f7-b1d7-49c2-92cd-461863174129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:03.824439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed877f7-b1d7-49c2-92cd-461863174129 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:03.824774 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed877f7-b1d7-49c2-92cd-461863174129 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:03.825046 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed877f7-b1d7-49c2-92cd-461863174129 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:03.835648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed877f7-b1d7-49c2-92cd-461863174129 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:03.837208 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed877f7-b1d7-49c2-92cd-461863174129 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:03.861550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-bed877f7-b1d7-49c2-92cd-461863174129 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:03.861550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:03.861550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:03.861550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:03.861550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:03.861550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:03.861550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:03.861550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:03.861550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:03.861550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:03.861550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:03.861550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:03.861550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:51:03.861550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:51:03.861550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:51:03.863855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:51:03.863855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:03.863855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:03.863855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:03.863855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:03.863855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:03.863855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:03.863855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:03.863855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:03.863855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:03.863855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:03.863855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:03.863855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:03.863855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:03.863855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:03.863855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:03.863855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:03.865657 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:51:03.865657 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:51:03.865657 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:51:03.865657 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:51:03.865657 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:51:03.865657 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:51:03.865657 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:03.865657 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:03.867117 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 419/830] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:51:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:03.872030 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f344b8d-6799-4efe-92f0-31b16962ed3f None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:04.002723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f344b8d-6799-4efe-92f0-31b16962ed3f None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:04.049614 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d97e2-de2d-4f34-81df-765859162a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:04.050203 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d97e2-de2d-4f34-81df-765859162a33 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:04.050533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d97e2-de2d-4f34-81df-765859162a33 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:04.050787 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d97e2-de2d-4f34-81df-765859162a33 None admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:04.051672 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d97e2-de2d-4f34-81df-765859162a33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:04.052082 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d97e2-de2d-4f34-81df-765859162a33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:04.053663 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d97e2-de2d-4f34-81df-765859162a33 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:04.072711 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 412/831] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:51:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:04.074100 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed877f7-b1d7-49c2-92cd-461863174129 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:04.187743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed877f7-b1d7-49c2-92cd-461863174129 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:04.226534 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a6a8e-1c4f-458a-8d8c-43ede631827c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:04.227568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a6a8e-1c4f-458a-8d8c-43ede631827c None admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:04.227862 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a6a8e-1c4f-458a-8d8c-43ede631827c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:04.228131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a6a8e-1c4f-458a-8d8c-43ede631827c None admin] PATH_INFO: `/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/27265a0c2e6b47c09f28b9cd3ac47d28/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:04.230297 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a6a8e-1c4f-458a-8d8c-43ede631827c None admin] RBAC: Authorizing `identity:create_grant(project_id=48788e7517a14ca5b5af9f161512ac9c, user_id=27265a0c2e6b47c09f28b9cd3ac47d28, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:04.231790 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a6a8e-1c4f-458a-8d8c-43ede631827c None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:04.254228 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 420/832] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:51:04 2022] PUT /identity/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/27265a0c2e6b47c09f28b9cd3ac47d28/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:51:05.574906 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f00ba8-2db1-442f-9176-4ff9a80ef0dd None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:05.575739 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f00ba8-2db1-442f-9176-4ff9a80ef0dd None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:05.575886 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f00ba8-2db1-442f-9176-4ff9a80ef0dd None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:05.578902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 413/833] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:05.588046 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978df6b5-491d-4fed-af01-6dcf12d7628a None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:05.588987 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978df6b5-491d-4fed-af01-6dcf12d7628a None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:05.588987 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978df6b5-491d-4fed-af01-6dcf12d7628a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:05.619012 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-978df6b5-491d-4fed-af01-6dcf12d7628a None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:05.621048 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-978df6b5-491d-4fed-af01-6dcf12d7628a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:05.754210 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 421/834] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:05.794706 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f00ba8-2db1-442f-9176-4ff9a80ef0dd None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:05.993028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f00ba8-2db1-442f-9176-4ff9a80ef0dd None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:06.060989 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d0331-f73e-4132-a74b-89ee4c25dacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:06.062418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d0331-f73e-4132-a74b-89ee4c25dacd None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:06.062950 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d0331-f73e-4132-a74b-89ee4c25dacd None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:06.063446 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d0331-f73e-4132-a74b-89ee4c25dacd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:06.084802 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d0331-f73e-4132-a74b-89ee4c25dacd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:51:06.100498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-d47d0331-f73e-4132-a74b-89ee4c25dacd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:51:06.100498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:06.100498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:06.100498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:06.100498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:06.100498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:06.100498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:06.100498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:06.100498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:06.100498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:06.100498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:06.100498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:06.100498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:51:06.100498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:51:06.100498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:51:06.100498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:51:06.102271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:51:06.102271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:51:06.102271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:51:06.102271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:51:06.102271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:06.102271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:06.102271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:06.102271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:06.102271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:06.102271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:06.102271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:06.102271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:06.102271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:06.102271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:06.102271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:06.102271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:06.105724 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:06.105724 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:06.105724 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:06.105724 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:06.105724 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:51:06.105724 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:51:06.105724 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:51:06.105724 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:51:06.105724 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:51:06.105724 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:51:06.105724 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:51:06.105724 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:06.105724 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 414/835] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:51:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:06.112462 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978df6b5-491d-4fed-af01-6dcf12d7628a None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:06.314857 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978df6b5-491d-4fed-af01-6dcf12d7628a None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:06.354850 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170ef56-07fa-47b3-9029-cf2041ac30f2 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:06.355325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170ef56-07fa-47b3-9029-cf2041ac30f2 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:06.355588 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170ef56-07fa-47b3-9029-cf2041ac30f2 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:06.359460 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 415/836] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:06.369884 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81d502-02db-43da-aa1c-79e9e55d62bc None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:06.370492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81d502-02db-43da-aa1c-79e9e55d62bc None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:06.371069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81d502-02db-43da-aa1c-79e9e55d62bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:06.381596 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2361847-c8bc-4c55-81de-69586a9ca6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:06.382309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2361847-c8bc-4c55-81de-69586a9ca6e4 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:06.382593 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2361847-c8bc-4c55-81de-69586a9ca6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:06.382909 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2361847-c8bc-4c55-81de-69586a9ca6e4 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:06.383735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2361847-c8bc-4c55-81de-69586a9ca6e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:06.384048 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2361847-c8bc-4c55-81de-69586a9ca6e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:06.385581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2361847-c8bc-4c55-81de-69586a9ca6e4 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:06.396841 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 422/837] 10.222.0.73 () {56 vars in 1103 bytes} [Fri May 13 14:51:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:06.401742 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-5a81d502-02db-43da-aa1c-79e9e55d62bc None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:06.403269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-5a81d502-02db-43da-aa1c-79e9e55d62bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:06.405439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2361847-c8bc-4c55-81de-69586a9ca6e4 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:06.510870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 416/838] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:06.553477 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81d502-02db-43da-aa1c-79e9e55d62bc None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:06.630715 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2361847-c8bc-4c55-81de-69586a9ca6e4 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:06.681011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f98a6-ae3e-4882-8ddd-f3383b136d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:06.682123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f98a6-ae3e-4882-8ddd-f3383b136d06 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:06.682576 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f98a6-ae3e-4882-8ddd-f3383b136d06 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:06.683071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f98a6-ae3e-4882-8ddd-f3383b136d06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:06.701345 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f98a6-ae3e-4882-8ddd-f3383b136d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:06.703937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f98a6-ae3e-4882-8ddd-f3383b136d06 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:06.719388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81d502-02db-43da-aa1c-79e9e55d62bc None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:06.734166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-d08f98a6-ae3e-4882-8ddd-f3383b136d06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:06.734166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:06.734166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:06.734166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:06.734166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:06.734166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:06.734166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:06.734166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:06.734166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:06.734166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:06.734166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:06.734166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:06.734166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:51:06.734166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:51:06.734166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:51:06.736002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:51:06.736002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:06.736002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:06.736002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:06.736002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:06.736002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:06.736002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:06.736002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:06.736002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:06.736002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:06.736002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:06.736002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:06.736002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:06.736002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:06.736002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:06.736002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:06.736002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:06.737883 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:51:06.737883 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:51:06.737883 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:06.737883 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:06.737883 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 423/839] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:06.737883 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37af3e5-df8b-4ad5-aea1-5cfb59a0a986 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:06.737883 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37af3e5-df8b-4ad5-aea1-5cfb59a0a986 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:06.738685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37af3e5-df8b-4ad5-aea1-5cfb59a0a986 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:06.740097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 424/840] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:06.748234 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d7f6a-0753-472c-b9c9-4e7037748a55 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:06.748598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d7f6a-0753-472c-b9c9-4e7037748a55 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:06.748938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d7f6a-0753-472c-b9c9-4e7037748a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:06.768860 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-915d7f6a-0753-472c-b9c9-4e7037748a55 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:06.770870 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-915d7f6a-0753-472c-b9c9-4e7037748a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:06.779582 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f29aff-2241-468a-be30-82cf2d86b12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:06.780799 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f29aff-2241-468a-be30-82cf2d86b12a None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:06.781717 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f29aff-2241-468a-be30-82cf2d86b12a None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:06.782194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f29aff-2241-468a-be30-82cf2d86b12a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:06.783447 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f29aff-2241-468a-be30-82cf2d86b12a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:06.785700 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f29aff-2241-468a-be30-82cf2d86b12a None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:06.800028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-11f29aff-2241-468a-be30-82cf2d86b12a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 14:51:06.800028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:06.800028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:51:06.800028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:51:06.800028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:51:06.800028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:51:06.800028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:51:06.800028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:06.800028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 14:51:06.800028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:06.800028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:51:06.800028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:06.800028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:06.800028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:06.800028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:06.800028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:06.800028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:06.801504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:06.801504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:06.801504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:06.801504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:06.801504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:06.801504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:06.801504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:51:06.801504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:51:06.801504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:51:06.801504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:51:06.801504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:06.801504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:06.801504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:06.801504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:06.801504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:06.801504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:06.804120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:06.804120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:06.804120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:06.804120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:06.804120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:06.804120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:06.804120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:06.804120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:06.804120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:06.804120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:06.804120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:51:06.804120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:06.804120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 14:51:06.804120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:06.804120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 417/841] 10.222.0.73 () {56 vars in 1114 bytes} [Fri May 13 14:51:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:06.805726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f29aff-2241-468a-be30-82cf2d86b12a None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:06.874528 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 425/842] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:06.875778 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d7f6a-0753-472c-b9c9-4e7037748a55 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:06.969127 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f29aff-2241-468a-be30-82cf2d86b12a None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:07.010390 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a27790-582f-4a81-8273-cc9909cc7afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:07.011096 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a27790-582f-4a81-8273-cc9909cc7afa None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:07.011381 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a27790-582f-4a81-8273-cc9909cc7afa None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:07.011809 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a27790-582f-4a81-8273-cc9909cc7afa None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:07.012738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a27790-582f-4a81-8273-cc9909cc7afa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:07.012931 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a27790-582f-4a81-8273-cc9909cc7afa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:07.014336 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a27790-582f-4a81-8273-cc9909cc7afa None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:07.032637 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 418/843] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:07.034078 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a27790-582f-4a81-8273-cc9909cc7afa None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:07.044838 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d7f6a-0753-472c-b9c9-4e7037748a55 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:07.087456 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a19d6-5769-46db-9526-c192d933bf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:07.088270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a19d6-5769-46db-9526-c192d933bf44 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:07.088596 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a19d6-5769-46db-9526-c192d933bf44 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:07.088844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a19d6-5769-46db-9526-c192d933bf44 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:07.089558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a19d6-5769-46db-9526-c192d933bf44 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:07.089864 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a19d6-5769-46db-9526-c192d933bf44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:07.091316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a19d6-5769-46db-9526-c192d933bf44 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:07.102867 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 426/844] 10.222.0.73 () {56 vars in 1114 bytes} [Fri May 13 14:51:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:07.102867 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a19d6-5769-46db-9526-c192d933bf44 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:07.220017 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a27790-582f-4a81-8273-cc9909cc7afa None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:07.272596 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a19d6-5769-46db-9526-c192d933bf44 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:07.287366 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9cb63-1dae-4076-8649-b94619f0bc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:07.288700 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9cb63-1dae-4076-8649-b94619f0bc3d None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:07.289352 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9cb63-1dae-4076-8649-b94619f0bc3d None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:07.289920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9cb63-1dae-4076-8649-b94619f0bc3d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:07.291391 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9cb63-1dae-4076-8649-b94619f0bc3d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:07.294242 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9cb63-1dae-4076-8649-b94619f0bc3d None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:07.318342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-40e9cb63-1dae-4076-8649-b94619f0bc3d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 14:51:07.318342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:07.318342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:51:07.318342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:51:07.318342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:51:07.318342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:51:07.318342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:51:07.318342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:07.318342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 14:51:07.318342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:07.318342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:51:07.318342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:07.318342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:07.318342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:07.318342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:07.318342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:07.319542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:07.319542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:07.319542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:07.319542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:07.319542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:07.319542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:07.319542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:07.319542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:51:07.319542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:51:07.319542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:51:07.319542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:51:07.319542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:07.319542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:07.319542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:07.319542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:07.319542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:07.320395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:07.320395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:07.320395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:07.320395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:07.320395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:07.320395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:07.320395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:07.320395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:07.320395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:07.320395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:07.320395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:07.320395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:51:07.320395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:07.320395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 14:51:07.320395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:07.326764 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 419/845] 10.222.0.73 () {56 vars in 1132 bytes} [Fri May 13 14:51:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:07.326764 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9cb63-1dae-4076-8649-b94619f0bc3d None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:07.344949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18246d74-8edf-415b-96a0-fff76586751b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:07.346368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18246d74-8edf-415b-96a0-fff76586751b None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:07.346887 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18246d74-8edf-415b-96a0-fff76586751b None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:07.347928 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18246d74-8edf-415b-96a0-fff76586751b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:07.361629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18246d74-8edf-415b-96a0-fff76586751b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:07.365054 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18246d74-8edf-415b-96a0-fff76586751b None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:07.394165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-18246d74-8edf-415b-96a0-fff76586751b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:51:07.394165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:07.394165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:07.394165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:07.394165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:07.394165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:07.394165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:07.394165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:07.394165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:07.394165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:07.394165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:07.394165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:07.394165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:51:07.394165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:51:07.394165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:51:07.394165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:51:07.395508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:07.395508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:07.395508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:51:07.395508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:51:07.395508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:51:07.395508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:51:07.395508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:07.395508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:07.395508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:07.395508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:07.395508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:07.395508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:07.395508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:07.395508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:07.395508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:07.395508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:07.395508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:07.395508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:07.401927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:07.401927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:07.401927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:51:07.401927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:51:07.401927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:51:07.401927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:51:07.401927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:51:07.401927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:51:07.401927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:51:07.401927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:07.401927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 427/846] 10.222.0.73 () {56 vars in 1117 bytes} [Fri May 13 14:51:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:07.401927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18246d74-8edf-415b-96a0-fff76586751b None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:07.511918 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9cb63-1dae-4076-8649-b94619f0bc3d None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:07.543084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18246d74-8edf-415b-96a0-fff76586751b None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:07.576468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95549d10-276a-4fcf-9c1d-7e60f9de45e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:07.577574 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95549d10-276a-4fcf-9c1d-7e60f9de45e8 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:07.577987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95549d10-276a-4fcf-9c1d-7e60f9de45e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:07.578441 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95549d10-276a-4fcf-9c1d-7e60f9de45e8 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:07.579768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95549d10-276a-4fcf-9c1d-7e60f9de45e8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:07.580293 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95549d10-276a-4fcf-9c1d-7e60f9de45e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:07.582989 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d0bc0-05a5-480a-8d3b-056077cae654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:07.583299 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95549d10-276a-4fcf-9c1d-7e60f9de45e8 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:07.583752 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d0bc0-05a5-480a-8d3b-056077cae654 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:07.584079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d0bc0-05a5-480a-8d3b-056077cae654 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:07.584360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d0bc0-05a5-480a-8d3b-056077cae654 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:07.585082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d0bc0-05a5-480a-8d3b-056077cae654 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:07.585399 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d0bc0-05a5-480a-8d3b-056077cae654 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:07.586811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d0bc0-05a5-480a-8d3b-056077cae654 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:07.602860 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 420/847] 10.222.0.73 () {56 vars in 1114 bytes} [Fri May 13 14:51:07 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:07.603155 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 428/848] 10.222.0.73 () {56 vars in 1126 bytes} [Fri May 13 14:51:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:07.603318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95549d10-276a-4fcf-9c1d-7e60f9de45e8 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:07.603465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f2205-fe89-4e75-be14-ec2c3c5c4e21 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:07.603465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f2205-fe89-4e75-be14-ec2c3c5c4e21 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:07.603465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f2205-fe89-4e75-be14-ec2c3c5c4e21 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:07.603465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 429/849] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:07.603465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f2205-fe89-4e75-be14-ec2c3c5c4e21 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:07.751654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f2205-fe89-4e75-be14-ec2c3c5c4e21 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:07.766748 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95549d10-276a-4fcf-9c1d-7e60f9de45e8 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:07.803030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65748a0-4ee2-4739-9697-342b8a2a0ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:07.804100 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65748a0-4ee2-4739-9697-342b8a2a0ea1 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:07.804526 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65748a0-4ee2-4739-9697-342b8a2a0ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:07.804933 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65748a0-4ee2-4739-9697-342b8a2a0ea1 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:07.805824 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65748a0-4ee2-4739-9697-342b8a2a0ea1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:07.806343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65748a0-4ee2-4739-9697-342b8a2a0ea1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:07.808358 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65748a0-4ee2-4739-9697-342b8a2a0ea1 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:07.811248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923b4b6-a56d-481a-a33b-d4f9d69c7b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:07.811965 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923b4b6-a56d-481a-a33b-d4f9d69c7b29 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:07.812259 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923b4b6-a56d-481a-a33b-d4f9d69c7b29 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:07.812526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923b4b6-a56d-481a-a33b-d4f9d69c7b29 None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:07.813410 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923b4b6-a56d-481a-a33b-d4f9d69c7b29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:07.813738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923b4b6-a56d-481a-a33b-d4f9d69c7b29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:07.827359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923b4b6-a56d-481a-a33b-d4f9d69c7b29 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:07.827581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 430/850] 10.222.0.73 () {56 vars in 1126 bytes} [Fri May 13 14:51:07 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:07.827581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6f5cf-f2e8-4fa5-b2a5-66bba8661c6f None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:07.827581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6f5cf-f2e8-4fa5-b2a5-66bba8661c6f None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:07.827581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6f5cf-f2e8-4fa5-b2a5-66bba8661c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:07.844457 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 421/851] 10.222.0.73 () {56 vars in 1149 bytes} [Fri May 13 14:51:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:07.846132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923b4b6-a56d-481a-a33b-d4f9d69c7b29 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:07.855946 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-4eb6f5cf-f2e8-4fa5-b2a5-66bba8661c6f None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:07.858343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-4eb6f5cf-f2e8-4fa5-b2a5-66bba8661c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:08.023952 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 431/852] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:08.052463 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923b4b6-a56d-481a-a33b-d4f9d69c7b29 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:08.062994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6f5cf-f2e8-4fa5-b2a5-66bba8661c6f None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:08.096538 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15620bab-10d4-40c9-a392-90c517720a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:08.098039 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15620bab-10d4-40c9-a392-90c517720a06 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:08.098672 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15620bab-10d4-40c9-a392-90c517720a06 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:08.099131 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15620bab-10d4-40c9-a392-90c517720a06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:08.194883 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15620bab-10d4-40c9-a392-90c517720a06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:08.197673 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15620bab-10d4-40c9-a392-90c517720a06 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:08.232339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6f5cf-f2e8-4fa5-b2a5-66bba8661c6f None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:08.275823 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb23db-a44e-4bc0-ab5a-4ec7787e0cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:08.276545 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb23db-a44e-4bc0-ab5a-4ec7787e0cb1 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:08.276823 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb23db-a44e-4bc0-ab5a-4ec7787e0cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:08.277108 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb23db-a44e-4bc0-ab5a-4ec7787e0cb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:08.291628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb23db-a44e-4bc0-ab5a-4ec7787e0cb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:51:08.300544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-3eeb23db-a44e-4bc0-ab5a-4ec7787e0cb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:51:08.300544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:08.300544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:08.300544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:08.300544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:08.300544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:08.300544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:08.300544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:08.300544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:08.300544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:08.300544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:08.300544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:08.300544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:51:08.300544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:51:08.300544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:51:08.300544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:51:08.302436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:51:08.302436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:51:08.302436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:51:08.302436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:51:08.302436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:08.302436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:08.302436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:08.302436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:08.302436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:08.302436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:08.302436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:08.302436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:08.302436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:08.302436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:08.302436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:08.302436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:08.303943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:08.303943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:08.303943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:08.303943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:08.303943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:51:08.303943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:51:08.303943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:51:08.303943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:51:08.303943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:51:08.303943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:51:08.303943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:51:08.303943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:08.303943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 432/853] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:51:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:08.313755 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb23db-a44e-4bc0-ab5a-4ec7787e0cb1 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:08.403004 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 422/854] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:51:07 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:51:08.408575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15620bab-10d4-40c9-a392-90c517720a06 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:08.433233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb23db-a44e-4bc0-ab5a-4ec7787e0cb1 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:08.473545 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1f7fa-831f-4826-910b-94576bca7fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:08.474238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1f7fa-831f-4826-910b-94576bca7fb1 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:08.474523 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1f7fa-831f-4826-910b-94576bca7fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:08.474801 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1f7fa-831f-4826-910b-94576bca7fb1 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:08.475606 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1f7fa-831f-4826-910b-94576bca7fb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:08.475913 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1f7fa-831f-4826-910b-94576bca7fb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:08.477405 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1f7fa-831f-4826-910b-94576bca7fb1 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:08.488121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 433/855] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:51:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:08.497112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1f7fa-831f-4826-910b-94576bca7fb1 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:08.601497 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15620bab-10d4-40c9-a392-90c517720a06 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:08.664534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df812c-e8a5-4873-8aac-81331207cb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:08.665849 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df812c-e8a5-4873-8aac-81331207cb40 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:08.666315 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df812c-e8a5-4873-8aac-81331207cb40 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:08.666803 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df812c-e8a5-4873-8aac-81331207cb40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:08.675798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1f7fa-831f-4826-910b-94576bca7fb1 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:08.687338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df812c-e8a5-4873-8aac-81331207cb40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:08.692582 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df812c-e8a5-4873-8aac-81331207cb40 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:08.726076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-f4df812c-e8a5-4873-8aac-81331207cb40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:08.726076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:08.726076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:08.726076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:08.726076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:08.726076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:08.726076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:08.726076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:08.726076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:08.726076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:08.726076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:08.726076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:08.726076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:51:08.726076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:51:08.726076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:51:08.727900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:51:08.727900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:08.727900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:08.727900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:08.727900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:08.727900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:08.727900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:08.727900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:08.727900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:08.727900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:08.727900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:08.727900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:08.727900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:08.727900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:08.727900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:08.727900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:08.727900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:08.729738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:51:08.729738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:51:08.729738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:08.729738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:08.737659 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 423/856] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:08.740068 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df812c-e8a5-4873-8aac-81331207cb40 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:08.745481 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7155bd-36cf-4f62-8f76-83ad20e1b89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:08.747328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7155bd-36cf-4f62-8f76-83ad20e1b89c None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:08.748150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7155bd-36cf-4f62-8f76-83ad20e1b89c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:08.748903 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7155bd-36cf-4f62-8f76-83ad20e1b89c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:08.768887 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7155bd-36cf-4f62-8f76-83ad20e1b89c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:08.772785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7155bd-36cf-4f62-8f76-83ad20e1b89c None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:08.805445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-0d7155bd-36cf-4f62-8f76-83ad20e1b89c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:08.805445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:08.805445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:08.805445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:08.805445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:08.805445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:08.805445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:08.805445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:08.805445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:08.805445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:08.805445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:08.805445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:08.805445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:51:08.805445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:51:08.805445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:51:08.807270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:51:08.807270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:08.807270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:08.807270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:08.807270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:08.807270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:08.807270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:08.807270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:08.807270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:08.807270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:08.807270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:08.807270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:08.807270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:08.807270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:08.807270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:08.807270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:08.807270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:08.808960 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:51:08.808960 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:51:08.808960 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:08.808960 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:08.818984 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 434/857] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:08.822874 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7155bd-36cf-4f62-8f76-83ad20e1b89c None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:08.954498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df812c-e8a5-4873-8aac-81331207cb40 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:09.002853 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7155bd-36cf-4f62-8f76-83ad20e1b89c None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:09.020617 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b3c64-6e5c-48ff-8b59-f36e0bb84832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:09.021689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b3c64-6e5c-48ff-8b59-f36e0bb84832 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:09.022444 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b3c64-6e5c-48ff-8b59-f36e0bb84832 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:09.022958 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b3c64-6e5c-48ff-8b59-f36e0bb84832 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:09.024726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b3c64-6e5c-48ff-8b59-f36e0bb84832 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:09.024960 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b3c64-6e5c-48ff-8b59-f36e0bb84832 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:09.027902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b3c64-6e5c-48ff-8b59-f36e0bb84832 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:09.063027 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 424/858] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:09.065614 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b3c64-6e5c-48ff-8b59-f36e0bb84832 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:09.069271 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be595425-d165-499b-9474-5f39a57448ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:09.070786 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be595425-d165-499b-9474-5f39a57448ac None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:09.071590 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be595425-d165-499b-9474-5f39a57448ac None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:09.072320 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be595425-d165-499b-9474-5f39a57448ac None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:09.073919 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be595425-d165-499b-9474-5f39a57448ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:09.074730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be595425-d165-499b-9474-5f39a57448ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:09.077497 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be595425-d165-499b-9474-5f39a57448ac None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:09.107037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 435/859] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:09.111353 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be595425-d165-499b-9474-5f39a57448ac None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:09.258958 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be595425-d165-499b-9474-5f39a57448ac None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:09.290913 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b3c64-6e5c-48ff-8b59-f36e0bb84832 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:09.299527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d7d4a-5146-42ec-849f-bb995b349606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:09.300377 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d7d4a-5146-42ec-849f-bb995b349606 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:09.300659 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d7d4a-5146-42ec-849f-bb995b349606 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:09.300933 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d7d4a-5146-42ec-849f-bb995b349606 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:09.309305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d7d4a-5146-42ec-849f-bb995b349606 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:09.310779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d7d4a-5146-42ec-849f-bb995b349606 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:09.326962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-b23d7d4a-5146-42ec-849f-bb995b349606 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 14:51:09.326962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:09.326962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:09.326962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:09.326962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:09.326962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:09.326962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:09.326962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:09.326962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:09.326962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:09.326962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:09.326962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:09.326962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:51:09.326962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:51:09.326962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:51:09.326962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:51:09.327970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:09.327970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:09.327970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:51:09.327970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:51:09.327970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:51:09.327970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:51:09.327970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:09.327970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:09.327970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:09.327970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:09.327970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:09.327970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:09.327970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:09.327970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:09.327970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:09.327970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:09.327970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:09.327970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:09.328976 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:09.328976 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:09.328976 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:51:09.328976 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:51:09.328976 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:51:09.328976 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:51:09.328976 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:51:09.328976 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:51:09.328976 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 14:51:09.328976 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:09.328976 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 436/860] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:51:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:09.339651 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d7d4a-5146-42ec-849f-bb995b349606 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:09.356349 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33e95d-b86b-4ee9-8df2-0f7e9f12c6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:09.357279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33e95d-b86b-4ee9-8df2-0f7e9f12c6c5 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:09.357646 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33e95d-b86b-4ee9-8df2-0f7e9f12c6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:09.357930 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33e95d-b86b-4ee9-8df2-0f7e9f12c6c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:09.366204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33e95d-b86b-4ee9-8df2-0f7e9f12c6c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:09.367815 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33e95d-b86b-4ee9-8df2-0f7e9f12c6c5 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:09.385771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-1b33e95d-b86b-4ee9-8df2-0f7e9f12c6c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:09.385771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:09.385771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:09.385771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:09.385771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:09.385771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:09.385771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:09.385771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:09.385771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:09.385771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:09.385771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:09.385771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:09.385771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:51:09.385771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:51:09.385771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:51:09.387507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:51:09.387507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:09.387507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:09.387507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:09.387507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:09.387507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:09.387507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:09.387507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:09.387507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:09.387507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:09.387507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:09.387507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:09.387507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:09.387507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:09.387507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:09.387507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:09.387507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:09.389300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:51:09.389300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:51:09.389300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:51:09.389300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:51:09.389300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:51:09.389300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:51:09.389300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:09.389300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:09.389300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 425/861] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:51:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:09.397453 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33e95d-b86b-4ee9-8df2-0f7e9f12c6c5 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:09.552132 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d7d4a-5146-42ec-849f-bb995b349606 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:09.594558 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33e95d-b86b-4ee9-8df2-0f7e9f12c6c5 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:09.609665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd409759-fa35-4275-89ca-42037118609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:09.610655 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd409759-fa35-4275-89ca-42037118609a None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:09.611123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd409759-fa35-4275-89ca-42037118609a None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:09.611588 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd409759-fa35-4275-89ca-42037118609a None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:09.613743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd409759-fa35-4275-89ca-42037118609a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:09.614257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd409759-fa35-4275-89ca-42037118609a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:09.616235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd409759-fa35-4275-89ca-42037118609a None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:09.642861 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 437/862] 10.222.0.73 () {56 vars in 1135 bytes} [Fri May 13 14:51:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:09.646686 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd409759-fa35-4275-89ca-42037118609a None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:09.660408 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb8753-a81d-48d6-bdf6-abc3e9297bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:09.662187 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb8753-a81d-48d6-bdf6-abc3e9297bf2 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:09.662716 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb8753-a81d-48d6-bdf6-abc3e9297bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:09.663248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb8753-a81d-48d6-bdf6-abc3e9297bf2 None admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:09.664279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb8753-a81d-48d6-bdf6-abc3e9297bf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:09.664891 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb8753-a81d-48d6-bdf6-abc3e9297bf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:09.667237 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb8753-a81d-48d6-bdf6-abc3e9297bf2 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:09.683467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 426/863] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:51:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:09.692575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb8753-a81d-48d6-bdf6-abc3e9297bf2 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:09.807413 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb8753-a81d-48d6-bdf6-abc3e9297bf2 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:09.846665 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a542e9e-1751-4d8b-a621-062b1020fed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:09.848313 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a542e9e-1751-4d8b-a621-062b1020fed6 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:09.848813 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a542e9e-1751-4d8b-a621-062b1020fed6 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:09.849292 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a542e9e-1751-4d8b-a621-062b1020fed6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:09.850341 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a542e9e-1751-4d8b-a621-062b1020fed6 None admin] RBAC: Adding query filter params (role.id=354a460a8146476989f8a7b4fc1aac93, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=0c04f5fb770d49c0a50f2cfbd77e17e0) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:09.850887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a542e9e-1751-4d8b-a621-062b1020fed6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:09.852573 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a542e9e-1751-4d8b-a621-062b1020fed6 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:09.858521 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd409759-fa35-4275-89ca-42037118609a None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:09.867396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 427/864] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:51:09 2022] GET /identity/v3/role_assignments?user.id=0c04f5fb770d49c0a50f2cfbd77e17e0&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=354a460a8146476989f8a7b4fc1aac93 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:09.963342 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb64d43-dc24-4603-a4d3-b15457c5316a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:09.964501 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb64d43-dc24-4603-a4d3-b15457c5316a None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:09.965074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb64d43-dc24-4603-a4d3-b15457c5316a None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:09.965571 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb64d43-dc24-4603-a4d3-b15457c5316a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:10.111208 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb64d43-dc24-4603-a4d3-b15457c5316a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:10.114063 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb64d43-dc24-4603-a4d3-b15457c5316a None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:10.274697 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 438/865] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:51:09 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:51:10.284998 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a542e9e-1751-4d8b-a621-062b1020fed6 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:10.440284 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf9d12-40a9-4bd0-b2e1-3908fb491c8f None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:10.441184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf9d12-40a9-4bd0-b2e1-3908fb491c8f None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:10.441624 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf9d12-40a9-4bd0-b2e1-3908fb491c8f None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:10.443648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 439/866] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:51:10.449641 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d585143-af1b-4150-be04-d8f764e41c79 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:10.449971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d585143-af1b-4150-be04-d8f764e41c79 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:10.450380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d585143-af1b-4150-be04-d8f764e41c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:10.470872 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-2d585143-af1b-4150-be04-d8f764e41c79 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:10.472280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-2d585143-af1b-4150-be04-d8f764e41c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:10.502928 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a542e9e-1751-4d8b-a621-062b1020fed6 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:10.563220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 440/867] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:51:10.577957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a436b-e456-40e5-8c65-9ce7a717f439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:10.579228 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a436b-e456-40e5-8c65-9ce7a717f439 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:10.579714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a436b-e456-40e5-8c65-9ce7a717f439 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:10.580222 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a436b-e456-40e5-8c65-9ce7a717f439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:10.584397 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d585143-af1b-4150-be04-d8f764e41c79 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:10.598532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a436b-e456-40e5-8c65-9ce7a717f439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:10.602222 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a436b-e456-40e5-8c65-9ce7a717f439 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:10.642400 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-aa9a436b-e456-40e5-8c65-9ce7a717f439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:10.642400 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:10.642400 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:10.642400 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:10.642400 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:10.642400 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:10.642400 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:10.642400 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:10.642400 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:10.642400 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:10.642400 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:10.642400 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:10.642400 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:51:10.642400 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:51:10.642400 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:51:10.644645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:51:10.644645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:10.644645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:10.644645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:10.644645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:10.644645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:10.644645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:10.644645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:10.644645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:10.644645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:10.644645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:10.644645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:10.644645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:10.644645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:10.644645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:10.644645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:10.644645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:10.645761 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:51:10.645761 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:51:10.645761 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:10.645761 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:10.650405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 428/868] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:10.656683 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a436b-e456-40e5-8c65-9ce7a717f439 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:10.740109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d585143-af1b-4150-be04-d8f764e41c79 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:10.784694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db6af8-d095-47a0-b461-4e2e60be8444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:10.785545 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db6af8-d095-47a0-b461-4e2e60be8444 None admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:10.785830 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db6af8-d095-47a0-b461-4e2e60be8444 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:10.786182 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db6af8-d095-47a0-b461-4e2e60be8444 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:10.787054 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db6af8-d095-47a0-b461-4e2e60be8444 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:10.788548 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db6af8-d095-47a0-b461-4e2e60be8444 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:10.808265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 441/869] 10.222.0.73 () {60 vars in 1141 bytes} [Fri May 13 14:51:10 2022] POST /identity/v3/services => generated 251 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:51:10.863479 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a436b-e456-40e5-8c65-9ce7a717f439 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:10.894438 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc5c18-d645-44dd-9dcd-db2f68b23c89 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:10.895327 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc5c18-d645-44dd-9dcd-db2f68b23c89 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:10.895327 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc5c18-d645-44dd-9dcd-db2f68b23c89 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:10.897394 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 442/870] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:10.903161 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354c535-cb8b-4154-9785-ffe33835a623 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:10.903447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354c535-cb8b-4154-9785-ffe33835a623 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:10.903708 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354c535-cb8b-4154-9785-ffe33835a623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:10.928693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-e354c535-cb8b-4154-9785-ffe33835a623 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:10.930397 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e354c535-cb8b-4154-9785-ffe33835a623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:10.960918 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a6f0b-ddc1-4f03-a9ac-e4ac621b195f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:10.962113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a6f0b-ddc1-4f03-a9ac-e4ac621b195f None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:10.962626 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a6f0b-ddc1-4f03-a9ac-e4ac621b195f None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:10.963156 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a6f0b-ddc1-4f03-a9ac-e4ac621b195f None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:10.964601 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a6f0b-ddc1-4f03-a9ac-e4ac621b195f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:10.965148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a6f0b-ddc1-4f03-a9ac-e4ac621b195f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:10.967971 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a6f0b-ddc1-4f03-a9ac-e4ac621b195f None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:10.994949 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 429/871] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:11.005000 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a6f0b-ddc1-4f03-a9ac-e4ac621b195f None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:11.029228 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 443/872] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:10 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:51:11.053234 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354c535-cb8b-4154-9785-ffe33835a623 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:11.195272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a6f0b-ddc1-4f03-a9ac-e4ac621b195f None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:11.203720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354c535-cb8b-4154-9785-ffe33835a623 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:11.243235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9613c75-1935-4c4f-91d8-d10f228a4dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:11.243927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9613c75-1935-4c4f-91d8-d10f228a4dba None admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:11.244213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9613c75-1935-4c4f-91d8-d10f228a4dba None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:11.244485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9613c75-1935-4c4f-91d8-d10f228a4dba None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:11.245351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9613c75-1935-4c4f-91d8-d10f228a4dba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:11.246715 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9613c75-1935-4c4f-91d8-d10f228a4dba None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:11.267786 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5930f-a468-41e5-bd8b-40ffe7b7753c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:11.271102 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5930f-a468-41e5-bd8b-40ffe7b7753c None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:11.274018 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5930f-a468-41e5-bd8b-40ffe7b7753c None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:11.274682 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5930f-a468-41e5-bd8b-40ffe7b7753c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:11.286877 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 444/873] 10.222.0.73 () {60 vars in 1141 bytes} [Fri May 13 14:51:11 2022] POST /identity/v3/services => generated 269 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:51:11.298772 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5930f-a468-41e5-bd8b-40ffe7b7753c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:11.301974 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5930f-a468-41e5-bd8b-40ffe7b7753c None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:11.330838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-42e5930f-a468-41e5-bd8b-40ffe7b7753c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:11.330838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:11.330838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:11.330838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:11.330838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:11.330838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:11.330838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:11.330838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:11.330838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:11.330838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:11.330838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:11.330838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:11.330838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:51:11.330838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:51:11.330838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:51:11.331910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:51:11.331910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:11.331910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:11.331910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:11.331910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:11.331910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:11.331910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:11.331910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:11.331910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:11.331910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:11.331910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:11.331910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:11.331910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:11.331910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:11.331910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:11.331910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:11.331910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:11.332893 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:51:11.332893 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:51:11.332893 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:51:11.332893 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:51:11.332893 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:51:11.332893 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:51:11.332893 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:11.332893 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:11.339007 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 430/874] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:51:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:11.343876 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9613c75-1935-4c4f-91d8-d10f228a4dba None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:11.541172 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9613c75-1935-4c4f-91d8-d10f228a4dba None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:11.582031 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f125d-da1c-4952-85b5-a81e6bd97d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:11.582699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f125d-da1c-4952-85b5-a81e6bd97d15 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:11.583009 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f125d-da1c-4952-85b5-a81e6bd97d15 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:11.583281 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f125d-da1c-4952-85b5-a81e6bd97d15 None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:11.584092 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f125d-da1c-4952-85b5-a81e6bd97d15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:11.584394 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f125d-da1c-4952-85b5-a81e6bd97d15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:11.585866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f125d-da1c-4952-85b5-a81e6bd97d15 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:11.600855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 445/875] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:51:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:11.606840 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5930f-a468-41e5-bd8b-40ffe7b7753c None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:11.721155 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5930f-a468-41e5-bd8b-40ffe7b7753c None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:11.760470 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fe2da-2f2a-4ba5-91f7-2f8904f07163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:11.761157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fe2da-2f2a-4ba5-91f7-2f8904f07163 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:11.761461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fe2da-2f2a-4ba5-91f7-2f8904f07163 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:11.761735 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fe2da-2f2a-4ba5-91f7-2f8904f07163 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:11.762565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3fe2da-2f2a-4ba5-91f7-2f8904f07163 None admin] RBAC: Adding query filter params (role.id=b6fbf976763d4795afbfb53a09ec6f6c, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=27265a0c2e6b47c09f28b9cd3ac47d28) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:11.762904 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3fe2da-2f2a-4ba5-91f7-2f8904f07163 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:11.764402 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3fe2da-2f2a-4ba5-91f7-2f8904f07163 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:11.775097 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 431/876] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:51:11 2022] GET /identity/v3/role_assignments?user.id=27265a0c2e6b47c09f28b9cd3ac47d28&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=b6fbf976763d4795afbfb53a09ec6f6c => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:12.542425 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85306286-2a82-447d-a7d4-97bb53e7c978 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:12.543242 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85306286-2a82-447d-a7d4-97bb53e7c978 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:12.543242 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85306286-2a82-447d-a7d4-97bb53e7c978 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:12.544757 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 446/877] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:12.551526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51677d1b-069c-4bf5-9065-04aa2dc06a02 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:12.552451 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51677d1b-069c-4bf5-9065-04aa2dc06a02 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:12.552451 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51677d1b-069c-4bf5-9065-04aa2dc06a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:12.571424 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-51677d1b-069c-4bf5-9065-04aa2dc06a02 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:12.572661 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-51677d1b-069c-4bf5-9065-04aa2dc06a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:12.656469 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 432/878] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:12.680765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85306286-2a82-447d-a7d4-97bb53e7c978 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:12.802974 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85306286-2a82-447d-a7d4-97bb53e7c978 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:12.847250 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96c6e7-2de9-4233-9e28-7cb96a8a861f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:12.848139 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96c6e7-2de9-4233-9e28-7cb96a8a861f None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:12.848428 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96c6e7-2de9-4233-9e28-7cb96a8a861f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:12.848706 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96c6e7-2de9-4233-9e28-7cb96a8a861f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:12.862069 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96c6e7-2de9-4233-9e28-7cb96a8a861f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:51:12.871558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-3b96c6e7-2de9-4233-9e28-7cb96a8a861f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:51:12.871558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:12.871558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:12.871558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:12.871558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:12.871558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:12.871558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:12.871558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:12.871558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:12.871558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:12.871558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:12.871558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:12.871558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:51:12.871558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:51:12.871558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:51:12.871558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:51:12.874901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:51:12.874901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:51:12.874901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:51:12.874901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:51:12.874901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:12.874901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:12.874901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:12.874901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:12.874901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:12.874901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:12.874901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:12.874901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:12.874901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:12.874901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:12.874901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:12.874901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:12.879423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:12.879423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:12.879423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:12.879423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:12.879423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:51:12.879423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:51:12.879423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:51:12.879423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:51:12.879423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:51:12.879423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:51:12.879423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:51:12.879423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:12.879423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 447/879] 10.222.0.73 () {56 vars in 1120 bytes} [Fri May 13 14:51:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:12.882101 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51677d1b-069c-4bf5-9065-04aa2dc06a02 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:13.070284 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51677d1b-069c-4bf5-9065-04aa2dc06a02 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:13.113242 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee365f-9853-4e47-902d-6673d0ffa3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:13.113945 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee365f-9853-4e47-902d-6673d0ffa3b8 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:13.114238 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee365f-9853-4e47-902d-6673d0ffa3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:13.114491 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee365f-9853-4e47-902d-6673d0ffa3b8 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:13.115304 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee365f-9853-4e47-902d-6673d0ffa3b8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:13.115821 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee365f-9853-4e47-902d-6673d0ffa3b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:13.117037 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee365f-9853-4e47-902d-6673d0ffa3b8 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:13.126487 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 433/880] 10.222.0.73 () {56 vars in 1115 bytes} [Fri May 13 14:51:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:13.132980 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96c6e7-2de9-4233-9e28-7cb96a8a861f None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:13.239064 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd2d11-cbd7-475f-b7ae-65a46aecb66a None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:13.239585 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd2d11-cbd7-475f-b7ae-65a46aecb66a None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:13.239966 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd2d11-cbd7-475f-b7ae-65a46aecb66a None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:13.241833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 434/881] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:51:13.247216 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972e02f-a18e-4c03-9574-f6fb750ad75c None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:13.247638 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972e02f-a18e-4c03-9574-f6fb750ad75c None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:13.247826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96c6e7-2de9-4233-9e28-7cb96a8a861f None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:13.247973 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972e02f-a18e-4c03-9574-f6fb750ad75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:13.273580 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-d972e02f-a18e-4c03-9574-f6fb750ad75c None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:13.274808 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-d972e02f-a18e-4c03-9574-f6fb750ad75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:13.290179 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af4a3e-87c3-4f52-ab30-01bb42c75724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:13.291223 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af4a3e-87c3-4f52-ab30-01bb42c75724 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:13.291970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af4a3e-87c3-4f52-ab30-01bb42c75724 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:13.292263 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af4a3e-87c3-4f52-ab30-01bb42c75724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:13.307519 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af4a3e-87c3-4f52-ab30-01bb42c75724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:13.309621 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af4a3e-87c3-4f52-ab30-01bb42c75724 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:13.332435 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-b4af4a3e-87c3-4f52-ab30-01bb42c75724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:13.332435 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:13.332435 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:13.332435 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:13.332435 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:13.332435 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:13.332435 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:13.332435 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:13.332435 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:13.332435 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:13.332435 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:13.332435 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:13.332435 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:51:13.332435 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:51:13.332435 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:51:13.335836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:51:13.335836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:13.335836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:13.335836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:13.335836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:13.335836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:13.335836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:13.335836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:13.335836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:13.335836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:13.335836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:13.335836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:13.335836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:13.335836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:13.335836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:13.335836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:13.335836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:13.339539 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:51:13.339539 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:51:13.339539 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:13.339539 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:13.339539 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 448/882] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:13.340238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af4a3e-87c3-4f52-ab30-01bb42c75724 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:13.365028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 435/883] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:51:13.388628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972e02f-a18e-4c03-9574-f6fb750ad75c None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:13.466736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af4a3e-87c3-4f52-ab30-01bb42c75724 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:13.502553 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972e02f-a18e-4c03-9574-f6fb750ad75c None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:13.511668 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6e720-ec51-4907-90b0-8fa7e79fcd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:13.512360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6e720-ec51-4907-90b0-8fa7e79fcd45 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:13.513231 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6e720-ec51-4907-90b0-8fa7e79fcd45 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:13.513576 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6e720-ec51-4907-90b0-8fa7e79fcd45 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:13.514327 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6e720-ec51-4907-90b0-8fa7e79fcd45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:13.514684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6e720-ec51-4907-90b0-8fa7e79fcd45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:13.516697 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6e720-ec51-4907-90b0-8fa7e79fcd45 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:13.536181 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 449/884] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:13.542635 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6e720-ec51-4907-90b0-8fa7e79fcd45 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:13.554587 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3843689-5ac6-4adc-84bf-f06f97779b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:13.556206 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3843689-5ac6-4adc-84bf-f06f97779b27 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:13.556489 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3843689-5ac6-4adc-84bf-f06f97779b27 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:13.556744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3843689-5ac6-4adc-84bf-f06f97779b27 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:13.557414 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3843689-5ac6-4adc-84bf-f06f97779b27 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:13.560141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3843689-5ac6-4adc-84bf-f06f97779b27 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:13.581569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-d3843689-5ac6-4adc-84bf-f06f97779b27 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 14:51:13.581569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:13.581569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:51:13.581569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:51:13.581569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:51:13.581569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:51:13.581569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:51:13.581569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:13.581569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 14:51:13.581569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:13.581569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:51:13.581569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:13.581569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:13.581569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:13.581569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:13.581569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:13.581569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:13.585422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:13.585422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:13.585422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:13.585422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:13.585422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:13.585422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:13.585422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:51:13.585422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:51:13.585422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:51:13.585422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:51:13.585422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:13.585422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:13.585422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:13.585422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:13.585422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:13.585422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:13.587526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:13.587526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:13.587526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:13.587526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:13.587526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:13.587526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:13.587526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:13.587526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:13.587526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:13.587526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:13.587526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:51:13.587526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:13.587526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 14:51:13.587526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:13.599680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 436/885] 10.222.0.73 () {56 vars in 1114 bytes} [Fri May 13 14:51:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:13.599680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3843689-5ac6-4adc-84bf-f06f97779b27 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:13.705460 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3843689-5ac6-4adc-84bf-f06f97779b27 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:13.708803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6e720-ec51-4907-90b0-8fa7e79fcd45 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:13.744371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962e062-0d1d-4974-b340-759c0a8900c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:13.745071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962e062-0d1d-4974-b340-759c0a8900c1 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:13.745334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962e062-0d1d-4974-b340-759c0a8900c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:13.745620 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962e062-0d1d-4974-b340-759c0a8900c1 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:13.746342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962e062-0d1d-4974-b340-759c0a8900c1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:13.746649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962e062-0d1d-4974-b340-759c0a8900c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:13.748101 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962e062-0d1d-4974-b340-759c0a8900c1 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:13.759093 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 437/886] 10.222.0.73 () {56 vars in 1114 bytes} [Fri May 13 14:51:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:13.759986 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962e062-0d1d-4974-b340-759c0a8900c1 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:13.770598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e520e0-730f-491b-8cc6-76d8db05acd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:13.772063 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e520e0-730f-491b-8cc6-76d8db05acd3 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:13.772549 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e520e0-730f-491b-8cc6-76d8db05acd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:13.772894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e520e0-730f-491b-8cc6-76d8db05acd3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:13.783413 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e520e0-730f-491b-8cc6-76d8db05acd3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:13.786672 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e520e0-730f-491b-8cc6-76d8db05acd3 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:13.814600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-67e520e0-730f-491b-8cc6-76d8db05acd3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:51:13.814600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:13.814600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:13.814600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:13.814600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:13.814600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:13.814600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:13.814600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:13.814600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:13.814600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:13.814600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:13.814600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:13.814600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:51:13.814600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:51:13.814600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:51:13.814600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:51:13.818803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:13.818803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:13.818803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:51:13.818803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:51:13.818803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:51:13.818803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:51:13.818803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:13.818803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:13.818803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:13.818803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:13.818803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:13.818803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:13.818803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:13.818803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:13.818803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:13.818803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:13.818803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:13.818803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:13.822458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:13.822458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:13.822458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:51:13.822458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:51:13.822458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:51:13.822458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:51:13.822458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:51:13.822458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:51:13.822458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:51:13.822458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:13.822458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 450/887] 10.222.0.73 () {56 vars in 1117 bytes} [Fri May 13 14:51:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:13.833578 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e520e0-730f-491b-8cc6-76d8db05acd3 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:13.877342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962e062-0d1d-4974-b340-759c0a8900c1 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:13.954202 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e520e0-730f-491b-8cc6-76d8db05acd3 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:13.957669 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ca39e-de82-4cbc-9fb5-85bb00fb7598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:13.959183 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ca39e-de82-4cbc-9fb5-85bb00fb7598 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:13.959950 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ca39e-de82-4cbc-9fb5-85bb00fb7598 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:13.960661 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ca39e-de82-4cbc-9fb5-85bb00fb7598 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:13.962259 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ca39e-de82-4cbc-9fb5-85bb00fb7598 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:13.963071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ca39e-de82-4cbc-9fb5-85bb00fb7598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:13.966117 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ca39e-de82-4cbc-9fb5-85bb00fb7598 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:13.983029 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 438/888] 10.222.0.73 () {56 vars in 1114 bytes} [Fri May 13 14:51:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:13.987466 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ca39e-de82-4cbc-9fb5-85bb00fb7598 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:13.996717 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7797a-d0be-4e21-98b7-fda6e9d080a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:13.996717 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7797a-d0be-4e21-98b7-fda6e9d080a0 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:13.997200 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7797a-d0be-4e21-98b7-fda6e9d080a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:13.997200 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7797a-d0be-4e21-98b7-fda6e9d080a0 None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:13.997963 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7797a-d0be-4e21-98b7-fda6e9d080a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:13.998274 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7797a-d0be-4e21-98b7-fda6e9d080a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:13.999886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7797a-d0be-4e21-98b7-fda6e9d080a0 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:14.022109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 451/889] 10.222.0.73 () {56 vars in 1149 bytes} [Fri May 13 14:51:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:14.028112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7797a-d0be-4e21-98b7-fda6e9d080a0 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:14.154294 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7797a-d0be-4e21-98b7-fda6e9d080a0 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:14.193409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63be7a-5d76-4d9c-9e23-5129e74d2fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:14.193958 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ca39e-de82-4cbc-9fb5-85bb00fb7598 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:14.194166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63be7a-5d76-4d9c-9e23-5129e74d2fbb None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:14.194325 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63be7a-5d76-4d9c-9e23-5129e74d2fbb None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:14.194604 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63be7a-5d76-4d9c-9e23-5129e74d2fbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:14.252451 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3724d3-8ce5-4a38-98eb-71274cf82cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:14.254308 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3724d3-8ce5-4a38-98eb-71274cf82cf6 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:14.254975 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3724d3-8ce5-4a38-98eb-71274cf82cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:14.255592 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3724d3-8ce5-4a38-98eb-71274cf82cf6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:14.256972 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3724d3-8ce5-4a38-98eb-71274cf82cf6 None admin] RBAC: Adding query filter params (interface=public, service_id=cb931c564ad94e9fa0302bf075e50158, region_id=RegionOne) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:14.257616 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3724d3-8ce5-4a38-98eb-71274cf82cf6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:14.259892 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3724d3-8ce5-4a38-98eb-71274cf82cf6 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:14.274356 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63be7a-5d76-4d9c-9e23-5129e74d2fbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:14.274356 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63be7a-5d76-4d9c-9e23-5129e74d2fbb None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:14.275240 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 439/890] 10.222.0.73 () {56 vars in 1251 bytes} [Fri May 13 14:51:13 2022] GET /identity/v3/endpoints?service_id=cb931c564ad94e9fa0302bf075e50158&interface=public®ion_id=RegionOne => generated 194 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:14.276786 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3724d3-8ce5-4a38-98eb-71274cf82cf6 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:14.381671 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 452/891] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:51:14 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 13 14:51:14.386432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ac631-81c7-45f3-95d3-55b333edfdb3 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:14.386724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ac631-81c7-45f3-95d3-55b333edfdb3 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:14.387071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ac631-81c7-45f3-95d3-55b333edfdb3 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:14.388757 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 453/892] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:14.394252 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ac631-81c7-45f3-95d3-55b333edfdb3 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:14.444750 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3724d3-8ce5-4a38-98eb-71274cf82cf6 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:14.505654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2439ca3-fcc8-42dd-a79e-ace5402d1829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:14.506516 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2439ca3-fcc8-42dd-a79e-ace5402d1829 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:14.506961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2439ca3-fcc8-42dd-a79e-ace5402d1829 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:14.507287 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2439ca3-fcc8-42dd-a79e-ace5402d1829 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:14.507414 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ac631-81c7-45f3-95d3-55b333edfdb3 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:14.508353 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2439ca3-fcc8-42dd-a79e-ace5402d1829 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:14.511150 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2439ca3-fcc8-42dd-a79e-ace5402d1829 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:14.527211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 440/893] 10.222.0.73 () {56 vars in 1087 bytes} [Fri May 13 14:51:14 2022] GET /identity/v3/services => generated 1268 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:51:14.529647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1cc48-4d80-4d0f-8c68-85520d2494b2 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:14.530127 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1cc48-4d80-4d0f-8c68-85520d2494b2 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:14.530653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1cc48-4d80-4d0f-8c68-85520d2494b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:14.554685 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-a4d1cc48-4d80-4d0f-8c68-85520d2494b2 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:14.556209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559df90e-7e59-4f73-a381-e5a64fa0b0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:14.557175 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559df90e-7e59-4f73-a381-e5a64fa0b0d3 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:14.557454 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559df90e-7e59-4f73-a381-e5a64fa0b0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:14.557725 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559df90e-7e59-4f73-a381-e5a64fa0b0d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:14.558301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-a4d1cc48-4d80-4d0f-8c68-85520d2494b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:14.574129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559df90e-7e59-4f73-a381-e5a64fa0b0d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:14.575926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559df90e-7e59-4f73-a381-e5a64fa0b0d3 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:14.602765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-559df90e-7e59-4f73-a381-e5a64fa0b0d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:14.602765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:14.602765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:14.602765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:14.602765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:14.602765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:14.602765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:14.602765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:14.602765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:14.602765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:14.602765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:14.602765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:14.602765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:51:14.602765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:51:14.602765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:51:14.603808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:51:14.603808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:14.603808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:14.603808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:14.603808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:14.603808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:14.603808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:14.603808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:14.603808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:14.603808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:14.603808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:14.603808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:14.603808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:14.603808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:14.603808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:14.603808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:14.603808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:14.604734 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:51:14.604734 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:51:14.604734 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:14.604734 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:14.604734 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 454/894] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:14.617306 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559df90e-7e59-4f73-a381-e5a64fa0b0d3 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:14.644972 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 441/895] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:14.672657 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1cc48-4d80-4d0f-8c68-85520d2494b2 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:14.748783 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559df90e-7e59-4f73-a381-e5a64fa0b0d3 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:14.790143 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dbd15-a9f2-475b-a7c2-ffd303953475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:14.791037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dbd15-a9f2-475b-a7c2-ffd303953475 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:14.791417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dbd15-a9f2-475b-a7c2-ffd303953475 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:14.791784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dbd15-a9f2-475b-a7c2-ffd303953475 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:14.792650 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709dbd15-a9f2-475b-a7c2-ffd303953475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:14.793110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709dbd15-a9f2-475b-a7c2-ffd303953475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:14.794794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709dbd15-a9f2-475b-a7c2-ffd303953475 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:14.797266 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1cc48-4d80-4d0f-8c68-85520d2494b2 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:14.814079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 455/896] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:14.815942 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dbd15-a9f2-475b-a7c2-ffd303953475 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:14.841711 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a169f92-5530-42fb-8ed1-c79f3d1ee26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:14.842543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a169f92-5530-42fb-8ed1-c79f3d1ee26d None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:14.842848 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a169f92-5530-42fb-8ed1-c79f3d1ee26d None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:14.843319 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a169f92-5530-42fb-8ed1-c79f3d1ee26d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:14.843996 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a169f92-5530-42fb-8ed1-c79f3d1ee26d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:14.845468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a169f92-5530-42fb-8ed1-c79f3d1ee26d None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:14.859910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-7a169f92-5530-42fb-8ed1-c79f3d1ee26d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 14:51:14.859910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:14.859910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:51:14.859910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:51:14.859910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:51:14.859910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:51:14.859910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:51:14.859910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:14.859910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 14:51:14.859910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:14.859910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:51:14.859910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:14.859910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:14.859910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:14.859910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:14.859910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:14.861835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:14.861835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:14.861835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:14.861835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:14.861835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:14.861835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:14.861835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:14.861835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:51:14.861835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:51:14.861835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:51:14.861835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:51:14.861835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:14.861835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:14.861835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:14.861835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:14.861835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:14.865360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:14.865360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:14.865360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:14.865360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:14.865360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:14.865360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:14.865360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:14.865360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:14.865360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:14.865360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:14.865360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:14.865360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:51:14.865360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:14.865360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 14:51:14.865360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:14.865360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 442/897] 10.222.0.73 () {56 vars in 1132 bytes} [Fri May 13 14:51:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:14.868108 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a169f92-5530-42fb-8ed1-c79f3d1ee26d None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:14.950676 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dbd15-a9f2-475b-a7c2-ffd303953475 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:15.005438 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4dce6-6dbe-44d9-b076-60158ad4d728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:15.006449 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4dce6-6dbe-44d9-b076-60158ad4d728 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:15.006927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4dce6-6dbe-44d9-b076-60158ad4d728 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:15.007365 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4dce6-6dbe-44d9-b076-60158ad4d728 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:15.015264 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a169f92-5530-42fb-8ed1-c79f3d1ee26d None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:15.019524 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4dce6-6dbe-44d9-b076-60158ad4d728 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:15.021099 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4dce6-6dbe-44d9-b076-60158ad4d728 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:15.037532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-c4e4dce6-6dbe-44d9-b076-60158ad4d728 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:15.037532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:15.037532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:15.037532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:15.037532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:15.037532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:15.037532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:15.037532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:15.037532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:15.037532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:15.037532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:15.037532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:15.037532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:51:15.037532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:51:15.037532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:51:15.039685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:51:15.039685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:15.039685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:15.039685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:15.039685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:15.039685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:15.039685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:15.039685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:15.039685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:15.039685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:15.039685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:15.039685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:15.039685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:15.039685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:15.039685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:15.039685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:15.039685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:15.041412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:51:15.041412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:51:15.041412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:51:15.041412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:51:15.041412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:51:15.041412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:51:15.041412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:15.041412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:15.043776 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 456/898] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:51:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:15.045360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72dd83-3c0d-4d24-9db5-3d2c2b003a46 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:15.045643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72dd83-3c0d-4d24-9db5-3d2c2b003a46 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:15.046060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72dd83-3c0d-4d24-9db5-3d2c2b003a46 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:15.050879 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 457/899] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:15.050879 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72dd83-3c0d-4d24-9db5-3d2c2b003a46 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:15.067717 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d8836-8c1e-4551-91ac-3d9f98d63301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:15.068748 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d8836-8c1e-4551-91ac-3d9f98d63301 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:15.069227 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d8836-8c1e-4551-91ac-3d9f98d63301 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:15.069640 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d8836-8c1e-4551-91ac-3d9f98d63301 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:15.070576 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d8836-8c1e-4551-91ac-3d9f98d63301 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:15.071073 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d8836-8c1e-4551-91ac-3d9f98d63301 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:15.073123 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d8836-8c1e-4551-91ac-3d9f98d63301 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:15.079193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 443/900] 10.222.0.73 () {56 vars in 1126 bytes} [Fri May 13 14:51:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:15.080483 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da69f1-9490-4a9e-bcba-1445a71ee11e None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:15.080799 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da69f1-9490-4a9e-bcba-1445a71ee11e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:15.081588 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da69f1-9490-4a9e-bcba-1445a71ee11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:15.103719 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-b4da69f1-9490-4a9e-bcba-1445a71ee11e None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:15.104951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-b4da69f1-9490-4a9e-bcba-1445a71ee11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:15.180370 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 444/901] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:15.181586 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da69f1-9490-4a9e-bcba-1445a71ee11e None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:15.215073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72dd83-3c0d-4d24-9db5-3d2c2b003a46 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:15.264925 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c943fd-974c-480c-9f22-f94ef94d0d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:15.265540 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c943fd-974c-480c-9f22-f94ef94d0d8f None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:15.265815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c943fd-974c-480c-9f22-f94ef94d0d8f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:15.266088 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c943fd-974c-480c-9f22-f94ef94d0d8f None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:15.266923 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c943fd-974c-480c-9f22-f94ef94d0d8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:15.267237 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c943fd-974c-480c-9f22-f94ef94d0d8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:15.268729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c943fd-974c-480c-9f22-f94ef94d0d8f None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:15.285079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 458/902] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:51:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:15.285957 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c943fd-974c-480c-9f22-f94ef94d0d8f None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:15.326758 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da69f1-9490-4a9e-bcba-1445a71ee11e None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:15.389178 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4f86f-fdd8-433e-b3e2-db08660b0206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:15.389856 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4f86f-fdd8-433e-b3e2-db08660b0206 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:15.390141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4f86f-fdd8-433e-b3e2-db08660b0206 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:15.390410 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4f86f-fdd8-433e-b3e2-db08660b0206 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:15.391148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4f86f-fdd8-433e-b3e2-db08660b0206 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:15.391450 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4f86f-fdd8-433e-b3e2-db08660b0206 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:15.392838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4f86f-fdd8-433e-b3e2-db08660b0206 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:15.399096 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 445/903] 10.222.0.73 () {56 vars in 1126 bytes} [Fri May 13 14:51:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:15.400047 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4f86f-fdd8-433e-b3e2-db08660b0206 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:15.418157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c943fd-974c-480c-9f22-f94ef94d0d8f None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:15.463971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308613d-8632-4c14-ab31-26b839b6b911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:15.464806 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308613d-8632-4c14-ab31-26b839b6b911 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:15.465083 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308613d-8632-4c14-ab31-26b839b6b911 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:15.465353 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308613d-8632-4c14-ab31-26b839b6b911 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:15.466012 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308613d-8632-4c14-ab31-26b839b6b911 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:15.467423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308613d-8632-4c14-ab31-26b839b6b911 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:15.480975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-2308613d-8632-4c14-ab31-26b839b6b911 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:51:15.480975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:15.480975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:51:15.480975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:51:15.480975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:51:15.480975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:51:15.480975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:51:15.480975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:15.480975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:51:15.480975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:15.480975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:51:15.480975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:15.480975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:15.480975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:15.480975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:15.480975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:15.480975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:15.483191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:15.483191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:15.483191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:15.483191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:15.483191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:15.483191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:15.483191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:51:15.483191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:51:15.483191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:51:15.483191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:51:15.483191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:15.483191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:15.483191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:15.483191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:15.483191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:15.483191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:15.484851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:15.484851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:15.484851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:15.484851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:15.484851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:15.484851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:15.484851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:15.484851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:15.484851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:15.484851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:15.484851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:51:15.484851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:15.484851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:51:15.484851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:15.484851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 459/904] 10.222.0.73 () {56 vars in 1126 bytes} [Fri May 13 14:51:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:15.486479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308613d-8632-4c14-ab31-26b839b6b911 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:15.567494 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4f86f-fdd8-433e-b3e2-db08660b0206 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:15.605663 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308613d-8632-4c14-ab31-26b839b6b911 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:15.609328 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d054e5-ebf7-4425-a887-8051c62947cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:15.609825 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d054e5-ebf7-4425-a887-8051c62947cb None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:15.610107 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d054e5-ebf7-4425-a887-8051c62947cb None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:15.610419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d054e5-ebf7-4425-a887-8051c62947cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:15.611370 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d054e5-ebf7-4425-a887-8051c62947cb None admin] RBAC: Adding query filter params (role.id=a77c06fbc15841b2943535dab76a36b5, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=0c04f5fb770d49c0a50f2cfbd77e17e0) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:15.611679 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d054e5-ebf7-4425-a887-8051c62947cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:15.613750 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d054e5-ebf7-4425-a887-8051c62947cb None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:15.620453 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 446/905] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:51:15 2022] GET /identity/v3/role_assignments?user.id=0c04f5fb770d49c0a50f2cfbd77e17e0&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=a77c06fbc15841b2943535dab76a36b5 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:15.621310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d054e5-ebf7-4425-a887-8051c62947cb None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:15.646705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac409a2b-5f55-4798-8f4d-b852d100ce7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:15.647570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac409a2b-5f55-4798-8f4d-b852d100ce7e None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:15.647882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac409a2b-5f55-4798-8f4d-b852d100ce7e None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:15.648161 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac409a2b-5f55-4798-8f4d-b852d100ce7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:15.649142 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac409a2b-5f55-4798-8f4d-b852d100ce7e None admin] RBAC: Adding query filter params (interface=public, service_id=025195f7e32649848ae817c4c15120fa, region_id=RegionOne) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:15.649456 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac409a2b-5f55-4798-8f4d-b852d100ce7e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:15.651183 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac409a2b-5f55-4798-8f4d-b852d100ce7e None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:15.657861 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 460/906] 10.222.0.73 () {56 vars in 1251 bytes} [Fri May 13 14:51:15 2022] GET /identity/v3/endpoints?service_id=025195f7e32649848ae817c4c15120fa&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:15.666526 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac409a2b-5f55-4798-8f4d-b852d100ce7e None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:15.767872 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d054e5-ebf7-4425-a887-8051c62947cb None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:15.808153 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65170251-1e06-449a-ac70-d76627bccddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:15.809010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65170251-1e06-449a-ac70-d76627bccddc None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:15.809407 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65170251-1e06-449a-ac70-d76627bccddc None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:15.809756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65170251-1e06-449a-ac70-d76627bccddc None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:15.810550 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65170251-1e06-449a-ac70-d76627bccddc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:15.810957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65170251-1e06-449a-ac70-d76627bccddc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:15.812433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65170251-1e06-449a-ac70-d76627bccddc None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:15.819028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 447/907] 10.222.0.73 () {56 vars in 1122 bytes} [Fri May 13 14:51:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:15.828244 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65170251-1e06-449a-ac70-d76627bccddc None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:15.868666 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac409a2b-5f55-4798-8f4d-b852d100ce7e None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:15.935105 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1c017-5d63-4e89-8cd5-814da60e5d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:15.936651 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1c017-5d63-4e89-8cd5-814da60e5d3e None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:15.937451 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1c017-5d63-4e89-8cd5-814da60e5d3e None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:15.938214 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1c017-5d63-4e89-8cd5-814da60e5d3e None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:15.939832 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1c017-5d63-4e89-8cd5-814da60e5d3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:15.943227 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1c017-5d63-4e89-8cd5-814da60e5d3e None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:15.947144 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65170251-1e06-449a-ac70-d76627bccddc None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:15.956711 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 461/908] 10.222.0.73 () {56 vars in 1087 bytes} [Fri May 13 14:51:15 2022] GET /identity/v3/services => generated 1268 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:51:15.993404 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1abe80-14f9-427e-8964-8f9eda1349a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:15.994135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1abe80-14f9-427e-8964-8f9eda1349a9 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:15.994424 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1abe80-14f9-427e-8964-8f9eda1349a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:15.994678 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1abe80-14f9-427e-8964-8f9eda1349a9 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:15.995436 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1abe80-14f9-427e-8964-8f9eda1349a9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:15.995809 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1abe80-14f9-427e-8964-8f9eda1349a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:15.997428 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1abe80-14f9-427e-8964-8f9eda1349a9 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:16.003853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 448/909] 10.222.0.73 () {56 vars in 1122 bytes} [Fri May 13 14:51:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:17.864392 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0715fd3-b7b4-4cad-ba79-79c83da3867a None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:17.865194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0715fd3-b7b4-4cad-ba79-79c83da3867a None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:17.865194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0715fd3-b7b4-4cad-ba79-79c83da3867a None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:17.866624 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 462/910] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:17.873030 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d4519-1fae-4caf-9765-103c2977255e None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:17.873979 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d4519-1fae-4caf-9765-103c2977255e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:17.873979 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d4519-1fae-4caf-9765-103c2977255e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:17.891849 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-a60d4519-1fae-4caf-9765-103c2977255e None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:17.893124 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-a60d4519-1fae-4caf-9765-103c2977255e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:17.983539 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 449/911] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:51:18.006858 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0715fd3-b7b4-4cad-ba79-79c83da3867a None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:18.122029 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0715fd3-b7b4-4cad-ba79-79c83da3867a None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:18.160943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb36ac-b951-4ff4-8a13-0bb26134856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:18.161769 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb36ac-b951-4ff4-8a13-0bb26134856e None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:18.162054 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb36ac-b951-4ff4-8a13-0bb26134856e None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:18.162289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb36ac-b951-4ff4-8a13-0bb26134856e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:18.163097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb36ac-b951-4ff4-8a13-0bb26134856e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:18.164631 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb36ac-b951-4ff4-8a13-0bb26134856e None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:18.178236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-25bb36ac-b951-4ff4-8a13-0bb26134856e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 14:51:18.178236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:18.178236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:51:18.178236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:51:18.178236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:51:18.178236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:51:18.178236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:51:18.178236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:18.178236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 14:51:18.178236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:18.178236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:51:18.178236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:18.178236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:18.178236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:18.178236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:18.178236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:18.178236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:18.181967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:18.181967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:18.181967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:18.181967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:18.181967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:18.181967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:18.181967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:51:18.181967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:51:18.181967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:51:18.181967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:51:18.181967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:18.181967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:18.181967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:18.181967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:18.181967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:18.181967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:18.185232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:18.185232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:18.185232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:18.185232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:18.185232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:18.185232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:18.185232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:18.185232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:18.185232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:18.185232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:18.185232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:51:18.185232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:18.185232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 14:51:18.185232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:18.185232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 463/912] 10.222.0.73 () {56 vars in 1114 bytes} [Fri May 13 14:51:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:18.192552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d4519-1fae-4caf-9765-103c2977255e None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:18.296124 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d4519-1fae-4caf-9765-103c2977255e None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:18.335733 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e89821-48ab-4f79-9429-5b47e700fd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:18.336418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e89821-48ab-4f79-9429-5b47e700fd6c None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:18.336698 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e89821-48ab-4f79-9429-5b47e700fd6c None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:18.336967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e89821-48ab-4f79-9429-5b47e700fd6c None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:18.337670 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e89821-48ab-4f79-9429-5b47e700fd6c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:18.337973 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e89821-48ab-4f79-9429-5b47e700fd6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:18.339393 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e89821-48ab-4f79-9429-5b47e700fd6c None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:18.345230 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 450/913] 10.222.0.73 () {56 vars in 1114 bytes} [Fri May 13 14:51:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:18.350853 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb36ac-b951-4ff4-8a13-0bb26134856e None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:18.409705 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940285a-85f5-4c0d-871d-21bc078a354f None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:18.410092 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940285a-85f5-4c0d-871d-21bc078a354f None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:18.410356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940285a-85f5-4c0d-871d-21bc078a354f None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:18.411864 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 451/914] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:18.417731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0686e-f3b3-4257-9427-05e0c2125db1 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:18.418172 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0686e-f3b3-4257-9427-05e0c2125db1 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:18.418413 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0686e-f3b3-4257-9427-05e0c2125db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:18.437206 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-67f0686e-f3b3-4257-9427-05e0c2125db1 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:18.438535 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-67f0686e-f3b3-4257-9427-05e0c2125db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:18.467649 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb36ac-b951-4ff4-8a13-0bb26134856e None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:18.506017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab6057-1106-4ed2-8bb3-cc6a40f0251d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:18.506701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab6057-1106-4ed2-8bb3-cc6a40f0251d None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:18.507022 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab6057-1106-4ed2-8bb3-cc6a40f0251d None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:18.507301 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab6057-1106-4ed2-8bb3-cc6a40f0251d None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:18.508028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab6057-1106-4ed2-8bb3-cc6a40f0251d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:18.508324 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab6057-1106-4ed2-8bb3-cc6a40f0251d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:18.509720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab6057-1106-4ed2-8bb3-cc6a40f0251d None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:18.520035 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 464/916] 10.222.0.73 () {56 vars in 1114 bytes} [Fri May 13 14:51:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:18.521327 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab6057-1106-4ed2-8bb3-cc6a40f0251d None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:18.521925 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 452/916] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:51:18.541446 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0686e-f3b3-4257-9427-05e0c2125db1 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:18.636850 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab6057-1106-4ed2-8bb3-cc6a40f0251d None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:18.656103 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0686e-f3b3-4257-9427-05e0c2125db1 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:18.674451 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50c4ec-f7c8-4eae-9eb5-518eaa3fc696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:18.675648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50c4ec-f7c8-4eae-9eb5-518eaa3fc696 None admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:18.675939 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50c4ec-f7c8-4eae-9eb5-518eaa3fc696 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:18.676178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50c4ec-f7c8-4eae-9eb5-518eaa3fc696 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:18.676939 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50c4ec-f7c8-4eae-9eb5-518eaa3fc696 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:18.678413 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50c4ec-f7c8-4eae-9eb5-518eaa3fc696 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:18.699091 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7369f6-bb02-4c03-b7b3-510b34bb688b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:18.699914 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7369f6-bb02-4c03-b7b3-510b34bb688b None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:18.700165 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7369f6-bb02-4c03-b7b3-510b34bb688b None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:18.700438 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7369f6-bb02-4c03-b7b3-510b34bb688b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:18.701165 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7369f6-bb02-4c03-b7b3-510b34bb688b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:18.702718 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7369f6-bb02-4c03-b7b3-510b34bb688b None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:18.706969 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 465/917] 10.222.0.73 () {60 vars in 1144 bytes} [Fri May 13 14:51:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:51:18.723752 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebd9d2-405b-4b0f-a1cd-d53f77346184 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:18.723752 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebd9d2-405b-4b0f-a1cd-d53f77346184 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:18.723752 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebd9d2-405b-4b0f-a1cd-d53f77346184 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:18.723752 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 466/918] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:51:18.726474 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54b2e6-f089-47ae-8a41-ada4c836cc70 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:18.727045 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54b2e6-f089-47ae-8a41-ada4c836cc70 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:18.727636 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54b2e6-f089-47ae-8a41-ada4c836cc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:18.730792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-5e7369f6-bb02-4c03-b7b3-510b34bb688b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 14:51:18.730792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:18.730792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:51:18.730792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:51:18.730792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:51:18.730792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:51:18.730792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:51:18.730792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:18.730792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 14:51:18.730792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:18.730792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:51:18.730792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:18.730792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:18.730792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:18.730792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:18.730792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:18.731875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:18.731875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:18.731875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:18.731875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:18.731875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:18.731875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:18.731875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:18.731875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:51:18.731875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:51:18.731875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:51:18.731875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:51:18.731875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:18.731875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:18.731875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:18.731875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:18.731875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:18.732756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:18.732756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:18.732756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:18.732756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:18.732756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:18.732756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:18.732756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:18.732756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:18.732756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:18.732756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:18.732756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:18.732756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:51:18.732756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:18.732756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 14:51:18.732756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:18.735418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 453/919] 10.222.0.73 () {56 vars in 1132 bytes} [Fri May 13 14:51:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:18.741472 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7369f6-bb02-4c03-b7b3-510b34bb688b None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:18.763474 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-aa54b2e6-f089-47ae-8a41-ada4c836cc70 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:18.766157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-aa54b2e6-f089-47ae-8a41-ada4c836cc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:18.924983 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 467/920] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:51:18.960818 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54b2e6-f089-47ae-8a41-ada4c836cc70 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:18.967075 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7369f6-bb02-4c03-b7b3-510b34bb688b None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:19.029349 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663937e8-b7ac-41b4-95da-067f83fea617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:19.030656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663937e8-b7ac-41b4-95da-067f83fea617 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:19.031051 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663937e8-b7ac-41b4-95da-067f83fea617 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:19.031461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663937e8-b7ac-41b4-95da-067f83fea617 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:19.032776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663937e8-b7ac-41b4-95da-067f83fea617 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:19.033324 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663937e8-b7ac-41b4-95da-067f83fea617 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:19.036594 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663937e8-b7ac-41b4-95da-067f83fea617 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:19.045046 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 454/921] 10.222.0.73 () {56 vars in 1126 bytes} [Fri May 13 14:51:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:19.053860 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663937e8-b7ac-41b4-95da-067f83fea617 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:19.141050 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54b2e6-f089-47ae-8a41-ada4c836cc70 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:19.187625 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede80aa0-0e8e-4f95-b7bf-9c6084004003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:19.188369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede80aa0-0e8e-4f95-b7bf-9c6084004003 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:19.188650 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede80aa0-0e8e-4f95-b7bf-9c6084004003 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:19.188928 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede80aa0-0e8e-4f95-b7bf-9c6084004003 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:19.203302 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede80aa0-0e8e-4f95-b7bf-9c6084004003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:51:19.214309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-ede80aa0-0e8e-4f95-b7bf-9c6084004003 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:51:19.214309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:19.214309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:19.214309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:19.214309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:19.214309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:19.214309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:19.214309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:19.214309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:19.214309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:19.214309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:19.214309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:19.214309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:51:19.214309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:51:19.214309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:51:19.214309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:51:19.215914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:51:19.215914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:51:19.215914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:51:19.215914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:51:19.215914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:19.215914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:19.215914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:19.215914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:19.215914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:19.215914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:19.215914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:19.215914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:19.215914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:19.215914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:19.215914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:19.215914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:19.217700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:19.217700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:19.217700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:19.217700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:19.217700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:51:19.217700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:51:19.217700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:51:19.217700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:51:19.217700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:51:19.217700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:51:19.217700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:51:19.217700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:19.217700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 468/922] 10.222.0.73 () {56 vars in 1120 bytes} [Fri May 13 14:51:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:19.226056 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663937e8-b7ac-41b4-95da-067f83fea617 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:19.228510 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede80aa0-0e8e-4f95-b7bf-9c6084004003 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:19.288071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e3964-fe48-45aa-9aa3-d1bca88534f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:19.289037 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e3964-fe48-45aa-9aa3-d1bca88534f6 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:19.289442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e3964-fe48-45aa-9aa3-d1bca88534f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:19.289842 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e3964-fe48-45aa-9aa3-d1bca88534f6 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:19.290960 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e3964-fe48-45aa-9aa3-d1bca88534f6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:19.291413 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e3964-fe48-45aa-9aa3-d1bca88534f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:19.293630 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e3964-fe48-45aa-9aa3-d1bca88534f6 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:19.303321 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 455/923] 10.222.0.73 () {56 vars in 1126 bytes} [Fri May 13 14:51:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:19.312436 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e3964-fe48-45aa-9aa3-d1bca88534f6 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:19.428113 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede80aa0-0e8e-4f95-b7bf-9c6084004003 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:19.495467 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d77f4-7855-4d81-9ed3-c4c3809e2ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:19.497070 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d77f4-7855-4d81-9ed3-c4c3809e2ab0 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:19.497864 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d77f4-7855-4d81-9ed3-c4c3809e2ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:19.498624 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d77f4-7855-4d81-9ed3-c4c3809e2ab0 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:19.500323 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d77f4-7855-4d81-9ed3-c4c3809e2ab0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:19.501179 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d77f4-7855-4d81-9ed3-c4c3809e2ab0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:19.502457 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e3964-fe48-45aa-9aa3-d1bca88534f6 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:19.505035 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d77f4-7855-4d81-9ed3-c4c3809e2ab0 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:19.527792 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 469/924] 10.222.0.73 () {56 vars in 1115 bytes} [Fri May 13 14:51:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:19.532600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d77f4-7855-4d81-9ed3-c4c3809e2ab0 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:19.567213 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711b702-86d1-4ccc-90e7-de8c801162d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:19.568323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711b702-86d1-4ccc-90e7-de8c801162d7 None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:19.568823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711b702-86d1-4ccc-90e7-de8c801162d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:19.569309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711b702-86d1-4ccc-90e7-de8c801162d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:19.570682 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711b702-86d1-4ccc-90e7-de8c801162d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:19.573393 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711b702-86d1-4ccc-90e7-de8c801162d7 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:19.607592 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 456/925] 10.222.0.73 () {60 vars in 1144 bytes} [Fri May 13 14:51:19 2022] POST /identity/v3/endpoints => generated 347 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:51:19.607592 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad58468-c17c-4518-a503-e75c00ed66de None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:19.607592 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad58468-c17c-4518-a503-e75c00ed66de None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:19.607592 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad58468-c17c-4518-a503-e75c00ed66de None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:19.607592 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 457/926] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:19.617134 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed065ca2-46e5-4e70-bb5f-f41149d07bac None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:19.617622 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed065ca2-46e5-4e70-bb5f-f41149d07bac None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:19.618076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed065ca2-46e5-4e70-bb5f-f41149d07bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:19.646312 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-ed065ca2-46e5-4e70-bb5f-f41149d07bac None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:19.648505 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ed065ca2-46e5-4e70-bb5f-f41149d07bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:19.704119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d77f4-7855-4d81-9ed3-c4c3809e2ab0 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:19.781789 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 458/927] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:51:19.789992 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997445ce-63b6-45d0-9df7-420fa1fb5251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:19.792074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997445ce-63b6-45d0-9df7-420fa1fb5251 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:19.793005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997445ce-63b6-45d0-9df7-420fa1fb5251 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:19.793778 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997445ce-63b6-45d0-9df7-420fa1fb5251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:19.819721 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed065ca2-46e5-4e70-bb5f-f41149d07bac None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:19.822335 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997445ce-63b6-45d0-9df7-420fa1fb5251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:19.825278 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997445ce-63b6-45d0-9df7-420fa1fb5251 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:19.872446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-997445ce-63b6-45d0-9df7-420fa1fb5251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:19.872446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:19.872446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:19.872446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:19.872446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:19.872446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:19.872446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:19.872446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:19.872446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:19.872446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:19.872446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:19.872446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:19.872446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:51:19.872446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:51:19.872446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:51:19.874247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:51:19.874247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:19.874247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:19.874247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:19.874247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:19.874247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:19.874247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:19.874247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:19.874247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:19.874247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:19.874247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:19.874247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:19.874247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:19.874247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:19.874247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:19.874247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:19.874247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:19.884273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:51:19.884273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:51:19.884273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:19.884273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:19.884273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 470/928] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:19.887083 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997445ce-63b6-45d0-9df7-420fa1fb5251 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:20.027875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed065ca2-46e5-4e70-bb5f-f41149d07bac None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:20.078048 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997445ce-63b6-45d0-9df7-420fa1fb5251 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:20.100125 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17911bdd-5203-492e-bf95-644ac7c617e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:20.101306 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17911bdd-5203-492e-bf95-644ac7c617e7 None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:20.101761 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17911bdd-5203-492e-bf95-644ac7c617e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:20.102216 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17911bdd-5203-492e-bf95-644ac7c617e7 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:20.103675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17911bdd-5203-492e-bf95-644ac7c617e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:20.106321 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17911bdd-5203-492e-bf95-644ac7c617e7 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:20.139284 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 459/929] 10.222.0.73 () {60 vars in 1141 bytes} [Fri May 13 14:51:19 2022] POST /identity/v3/services => generated 241 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:51:20.170970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b24ba1-e46a-4efb-baed-869be1f5a5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:20.172785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b24ba1-e46a-4efb-baed-869be1f5a5d3 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:20.173638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b24ba1-e46a-4efb-baed-869be1f5a5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:20.174482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b24ba1-e46a-4efb-baed-869be1f5a5d3 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:20.176694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b24ba1-e46a-4efb-baed-869be1f5a5d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:20.177177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b24ba1-e46a-4efb-baed-869be1f5a5d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:20.182904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b24ba1-e46a-4efb-baed-869be1f5a5d3 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:20.204077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 471/930] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:20.213638 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17911bdd-5203-492e-bf95-644ac7c617e7 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:20.424195 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17911bdd-5203-492e-bf95-644ac7c617e7 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:20.494925 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f99a1-db1f-4bd4-b31e-1d46f92c81bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:20.496151 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f99a1-db1f-4bd4-b31e-1d46f92c81bf None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:20.496571 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f99a1-db1f-4bd4-b31e-1d46f92c81bf None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:20.496988 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f99a1-db1f-4bd4-b31e-1d46f92c81bf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:20.511928 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f99a1-db1f-4bd4-b31e-1d46f92c81bf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:20.514614 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f99a1-db1f-4bd4-b31e-1d46f92c81bf None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:20.541147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-d92f99a1-db1f-4bd4-b31e-1d46f92c81bf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:51:20.541147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:20.541147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:20.541147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:20.541147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:20.541147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:20.541147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:20.541147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:20.541147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:20.541147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:20.541147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:20.541147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:20.541147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:51:20.541147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:51:20.541147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:51:20.541147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:51:20.543052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:20.543052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:20.543052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:51:20.543052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:51:20.543052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:51:20.543052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:51:20.543052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:20.543052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:20.543052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:20.543052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:20.543052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:20.543052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:20.543052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:20.543052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:20.543052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:20.543052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:20.543052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:20.543052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:20.545007 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:20.545007 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:20.545007 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:51:20.545007 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:51:20.545007 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:51:20.545007 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:51:20.545007 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:51:20.545007 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:51:20.545007 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:51:20.545007 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:20.550998 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 460/931] 10.222.0.73 () {56 vars in 1117 bytes} [Fri May 13 14:51:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:20.553907 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b24ba1-e46a-4efb-baed-869be1f5a5d3 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:20.756668 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b24ba1-e46a-4efb-baed-869be1f5a5d3 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:20.821318 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974c6b2-0869-459a-987f-a976a9cccb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:20.822744 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974c6b2-0869-459a-987f-a976a9cccb06 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:20.823423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974c6b2-0869-459a-987f-a976a9cccb06 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:20.824114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974c6b2-0869-459a-987f-a976a9cccb06 None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:20.825642 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974c6b2-0869-459a-987f-a976a9cccb06 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:20.826344 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974c6b2-0869-459a-987f-a976a9cccb06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:20.829113 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974c6b2-0869-459a-987f-a976a9cccb06 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:20.860374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 472/932] 10.222.0.73 () {56 vars in 1149 bytes} [Fri May 13 14:51:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:20.866865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f99a1-db1f-4bd4-b31e-1d46f92c81bf None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:20.981902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f99a1-db1f-4bd4-b31e-1d46f92c81bf None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:21.020811 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46ccfe-3b28-41bb-b0ed-8613ea80156e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:21.021521 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46ccfe-3b28-41bb-b0ed-8613ea80156e None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:21.021809 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46ccfe-3b28-41bb-b0ed-8613ea80156e None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:21.022086 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46ccfe-3b28-41bb-b0ed-8613ea80156e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:21.035331 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46ccfe-3b28-41bb-b0ed-8613ea80156e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:21.036840 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46ccfe-3b28-41bb-b0ed-8613ea80156e None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:21.056142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-de46ccfe-3b28-41bb-b0ed-8613ea80156e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:21.056142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:21.056142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:21.056142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:21.056142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:21.056142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:21.056142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:21.056142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:21.056142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:21.056142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:21.056142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:21.056142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:21.056142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:51:21.056142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:51:21.056142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:51:21.057804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:51:21.057804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:21.057804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:21.057804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:21.057804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:21.057804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:21.057804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:21.057804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:21.057804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:21.057804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:21.057804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:21.057804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:21.057804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:21.057804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:21.057804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:21.057804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:21.057804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:21.059769 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:51:21.059769 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:51:21.059769 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:21.059769 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:21.059769 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 461/933] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:21.070170 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974c6b2-0869-459a-987f-a976a9cccb06 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:21.244980 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974c6b2-0869-459a-987f-a976a9cccb06 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:21.284453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e6e7f-1ca5-4533-9a97-f6a16bf3738f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:21.285534 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e6e7f-1ca5-4533-9a97-f6a16bf3738f None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:21.286025 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e6e7f-1ca5-4533-9a97-f6a16bf3738f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:21.286505 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e6e7f-1ca5-4533-9a97-f6a16bf3738f None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:21.287543 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e6e7f-1ca5-4533-9a97-f6a16bf3738f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:21.288067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e6e7f-1ca5-4533-9a97-f6a16bf3738f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:21.289691 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e6e7f-1ca5-4533-9a97-f6a16bf3738f None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:21.303861 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 473/934] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:21.312980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46ccfe-3b28-41bb-b0ed-8613ea80156e None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:21.438897 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c093c8-8149-4ca3-8c17-33aeea6dcb4c None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:21.439548 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c093c8-8149-4ca3-8c17-33aeea6dcb4c None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:21.440119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c093c8-8149-4ca3-8c17-33aeea6dcb4c None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:21.442328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 474/935] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:21.448992 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbe743-af1e-4297-be2e-1c263fc616a3 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:21.449668 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbe743-af1e-4297-be2e-1c263fc616a3 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:21.450159 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbe743-af1e-4297-be2e-1c263fc616a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:21.470494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-56cbe743-af1e-4297-be2e-1c263fc616a3 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:21.472771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-56cbe743-af1e-4297-be2e-1c263fc616a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:21.513708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46ccfe-3b28-41bb-b0ed-8613ea80156e None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:21.555287 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 475/936] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:51:21.574953 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbe743-af1e-4297-be2e-1c263fc616a3 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:21.579342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76eb34-4ca2-4c04-9243-086a4c27da23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:21.581256 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76eb34-4ca2-4c04-9243-086a4c27da23 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:21.581765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76eb34-4ca2-4c04-9243-086a4c27da23 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:21.582238 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76eb34-4ca2-4c04-9243-086a4c27da23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:21.596463 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76eb34-4ca2-4c04-9243-086a4c27da23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:21.599512 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76eb34-4ca2-4c04-9243-086a4c27da23 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:21.627360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-be76eb34-4ca2-4c04-9243-086a4c27da23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:21.627360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:21.627360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:21.627360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:21.627360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:21.627360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:21.627360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:21.627360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:21.627360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:21.627360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:21.627360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:21.627360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:21.627360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:51:21.627360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:51:21.627360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:51:21.628968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:51:21.628968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:21.628968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:21.628968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:21.628968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:21.628968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:21.628968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:21.628968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:21.628968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:21.628968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:21.628968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:21.628968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:21.628968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:21.628968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:21.628968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:21.628968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:21.628968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:21.629884 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:51:21.629884 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:51:21.629884 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:51:21.629884 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:51:21.629884 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:51:21.629884 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:51:21.629884 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:21.629884 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:21.630797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 462/937] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:51:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:21.640157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76eb34-4ca2-4c04-9243-086a4c27da23 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:21.704760 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbe743-af1e-4297-be2e-1c263fc616a3 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:21.744647 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ee078-a13a-4736-9b3d-842aadb918a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:21.745762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ee078-a13a-4736-9b3d-842aadb918a7 None admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:21.746247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ee078-a13a-4736-9b3d-842aadb918a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:21.746751 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ee078-a13a-4736-9b3d-842aadb918a7 None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:21.747769 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ee078-a13a-4736-9b3d-842aadb918a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:21.749689 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ee078-a13a-4736-9b3d-842aadb918a7 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:21.751372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: WARNING keystone.server.flask.common [None req-8d4ee078-a13a-4736-9b3d-842aadb918a7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 13 14:51:21.771465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.sql.core [None req-8d4ee078-a13a-4736-9b3d-842aadb918a7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 13 14:51:21.771465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 13 14:51:21.771465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [parameters: {'id': '21598fc7ffe342c3bc759899bcd3420f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 13 14:51:21.771465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79915) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 13 14:51:21.780603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-8d4ee078-a13a-4736-9b3d-842aadb918a7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 21598fc7ffe342c3bc759899bcd3420f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 21598fc7ffe342c3bc759899bcd3420f. May 13 14:51:21.780603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:21.780603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 14:51:21.780603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 14:51:21.780603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 14:51:21.780603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 14:51:21.780603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 14:51:21.780603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application result = self._query(query) May 13 14:51:21.780603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 14:51:21.780603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application conn.query(q) May 13 14:51:21.780603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 14:51:21.780603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 14:51:21.780603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 14:51:21.781519 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application result.read() May 13 14:51:21.781519 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 14:51:21.781519 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 14:51:21.781519 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 14:51:21.781519 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 14:51:21.781519 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 14:51:21.781519 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 14:51:21.781519 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 14:51:21.781519 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 14:51:21.781519 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 13 14:51:21.781519 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:21.781519 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 13 14:51:21.781519 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:21.781519 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:21.781519 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 13 14:51:21.781519 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 13 14:51:21.781519 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 13 14:51:21.781519 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return project_ref.to_dict() May 13 14:51:21.782508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 14:51:21.782508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application next(self.gen) May 13 14:51:21.782508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 13 14:51:21.782508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application yield resource May 13 14:51:21.782508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 14:51:21.782508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application next(self.gen) May 13 14:51:21.782508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 13 14:51:21.782508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self.session.rollback() May 13 14:51:21.782508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 13 14:51:21.782508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self.force_reraise() May 13 14:51:21.782508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 13 14:51:21.782508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise self.value May 13 14:51:21.782508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 13 14:51:21.782508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 13 14:51:21.782508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 13 14:51:21.782508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application session.commit() May 13 14:51:21.782508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 13 14:51:21.783471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 13 14:51:21.783471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 13 14:51:21.783471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._prepare_impl() May 13 14:51:21.783471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 13 14:51:21.783471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self.session.flush() May 13 14:51:21.783471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 13 14:51:21.783471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._flush(objects) May 13 14:51:21.783471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 13 14:51:21.783471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 13 14:51:21.783471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 13 14:51:21.783471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application compat.raise_( May 13 14:51:21.783471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 14:51:21.783471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception May 13 14:51:21.783471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 13 14:51:21.783471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application flush_context.execute() May 13 14:51:21.783471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 13 14:51:21.783471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rec.execute(self) May 13 14:51:21.785379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 13 14:51:21.785379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 13 14:51:21.785379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 13 14:51:21.785379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application _emit_insert_statements( May 13 14:51:21.785379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 13 14:51:21.785379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application c = connection._execute_20( May 13 14:51:21.785379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 13 14:51:21.785379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 13 14:51:21.785379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 13 14:51:21.785379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 13 14:51:21.785379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 13 14:51:21.785379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ret = self._execute_context( May 13 14:51:21.785379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 13 14:51:21.785379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 13 14:51:21.785379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 13 14:51:21.787432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 13 14:51:21.787432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 14:51:21.787432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception May 13 14:51:21.787432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 14:51:21.787432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 14:51:21.787432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 14:51:21.787432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 14:51:21.787432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 14:51:21.787432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application result = self._query(query) May 13 14:51:21.787432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 14:51:21.787432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application conn.query(q) May 13 14:51:21.787432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 14:51:21.787432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 14:51:21.787432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 14:51:21.787432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application result.read() May 13 14:51:21.787432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 14:51:21.787432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 14:51:21.789633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 14:51:21.789633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 14:51:21.789633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 14:51:21.789633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 14:51:21.789633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 14:51:21.789633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 14:51:21.789633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 13 14:51:21.789633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 13 14:51:21.789633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [parameters: {'id': '21598fc7ffe342c3bc759899bcd3420f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 13 14:51:21.789633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 13 14:51:21.789633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:21.789633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:51:21.789633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:21.789633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:21.789633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 13 14:51:21.791594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 13 14:51:21.791594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 13 14:51:21.791594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 13 14:51:21.791594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 13 14:51:21.791594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:21.791594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:51:21.791594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:21.791594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:21.791594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:21.791594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:21.791594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:21.791594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:21.791594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:21.791594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:21.791594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:21.791594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:21.791594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:21.794468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:21.794468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 13 14:51:21.794468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 13 14:51:21.794468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:21.794468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:21.794468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 13 14:51:21.794468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.Conflict( May 13 14:51:21.794468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 21598fc7ffe342c3bc759899bcd3420f. May 13 14:51:21.794468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:21.802898 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 476/938] 10.222.0.73 () {60 vars in 1140 bytes} [Fri May 13 14:51:21 2022] POST /identity/v3/projects => generated 262 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:21.804407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ee078-a13a-4736-9b3d-842aadb918a7 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:21.820408 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76eb34-4ca2-4c04-9243-086a4c27da23 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:21.885577 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fad7c-f329-4146-982b-9558bb67121d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:21.885577 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fad7c-f329-4146-982b-9558bb67121d None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:21.885577 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fad7c-f329-4146-982b-9558bb67121d None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:21.885577 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fad7c-f329-4146-982b-9558bb67121d None admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:21.886515 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fad7c-f329-4146-982b-9558bb67121d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:21.887113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fad7c-f329-4146-982b-9558bb67121d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:21.889822 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fad7c-f329-4146-982b-9558bb67121d None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:21.913130 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 463/939] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:51:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:21.919690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fad7c-f329-4146-982b-9558bb67121d None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:21.937001 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ee078-a13a-4736-9b3d-842aadb918a7 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:21.982483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1de92-a892-45f6-a655-bc7e1023f0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:21.983455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1de92-a892-45f6-a655-bc7e1023f0e8 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:21.983768 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1de92-a892-45f6-a655-bc7e1023f0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:21.984123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1de92-a892-45f6-a655-bc7e1023f0e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:21.993882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1de92-a892-45f6-a655-bc7e1023f0e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:21.996423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1de92-a892-45f6-a655-bc7e1023f0e8 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:22.015038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-a5e1de92-a892-45f6-a655-bc7e1023f0e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:22.015038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:22.015038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:22.015038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:22.015038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:22.015038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:22.015038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:22.015038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:22.015038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:22.015038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:22.015038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:22.015038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:22.015038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:51:22.015038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:51:22.015038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:51:22.016119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:51:22.016119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:22.016119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:22.016119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:22.016119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:22.016119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:22.016119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:22.016119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:22.016119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:22.016119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:22.016119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:22.016119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:22.016119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:22.016119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:22.016119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:22.016119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:22.016119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:22.017131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:51:22.017131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:51:22.017131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:51:22.017131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:51:22.017131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:51:22.017131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:51:22.017131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:22.017131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:22.022489 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 477/940] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:51:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:22.023988 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1de92-a892-45f6-a655-bc7e1023f0e8 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:22.054311 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fad7c-f329-4146-982b-9558bb67121d None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:22.099884 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2a52c-dd0f-4ea6-b6c3-9504992ecc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:22.101346 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2a52c-dd0f-4ea6-b6c3-9504992ecc10 None admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:22.101783 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2a52c-dd0f-4ea6-b6c3-9504992ecc10 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:22.102739 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2a52c-dd0f-4ea6-b6c3-9504992ecc10 None admin] PATH_INFO: `/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/0c04f5fb770d49c0a50f2cfbd77e17e0/roles/a77c06fbc15841b2943535dab76a36b5` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:22.105908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2a52c-dd0f-4ea6-b6c3-9504992ecc10 None admin] RBAC: Authorizing `identity:create_grant(project_id=48788e7517a14ca5b5af9f161512ac9c, user_id=0c04f5fb770d49c0a50f2cfbd77e17e0, role_id=a77c06fbc15841b2943535dab76a36b5)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:22.108368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2a52c-dd0f-4ea6-b6c3-9504992ecc10 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:22.129603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 464/941] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:51:21 2022] PUT /identity/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/0c04f5fb770d49c0a50f2cfbd77e17e0/roles/a77c06fbc15841b2943535dab76a36b5 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:51:22.162017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1de92-a892-45f6-a655-bc7e1023f0e8 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:22.207097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e619f4-60a6-4ec5-9649-8786f27188fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:22.208121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e619f4-60a6-4ec5-9649-8786f27188fd None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:22.208588 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e619f4-60a6-4ec5-9649-8786f27188fd None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:22.209076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e619f4-60a6-4ec5-9649-8786f27188fd None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:22.210090 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e619f4-60a6-4ec5-9649-8786f27188fd None admin] RBAC: Adding query filter params (name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:22.210591 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e619f4-60a6-4ec5-9649-8786f27188fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:22.212399 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e619f4-60a6-4ec5-9649-8786f27188fd None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:22.238419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 478/942] 10.222.0.73 () {56 vars in 1112 bytes} [Fri May 13 14:51:22 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:23.432663 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51faa504-c251-497f-aa2a-69b9eeb4a9c0 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:23.433685 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51faa504-c251-497f-aa2a-69b9eeb4a9c0 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:23.434206 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51faa504-c251-497f-aa2a-69b9eeb4a9c0 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:23.436360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 465/943] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:51:23.443694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b705417-8574-4ea4-a148-6edaebcb4645 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:23.444749 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b705417-8574-4ea4-a148-6edaebcb4645 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:23.445363 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b705417-8574-4ea4-a148-6edaebcb4645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:23.465217 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-1b705417-8574-4ea4-a148-6edaebcb4645 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:23.467325 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-1b705417-8574-4ea4-a148-6edaebcb4645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:23.549921 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 479/944] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:23.573905 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51faa504-c251-497f-aa2a-69b9eeb4a9c0 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:23.605614 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e435b20-0a26-4e49-b253-b48068e53148 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:23.606272 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e435b20-0a26-4e49-b253-b48068e53148 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:23.607336 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e435b20-0a26-4e49-b253-b48068e53148 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:23.609743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 480/945] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:51:23.616497 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63a7bd-8c4d-4d9c-a8f5-f4d5440df63c None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:23.617230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63a7bd-8c4d-4d9c-a8f5-f4d5440df63c None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:23.617573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63a7bd-8c4d-4d9c-a8f5-f4d5440df63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:23.643449 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-6e63a7bd-8c4d-4d9c-a8f5-f4d5440df63c None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:23.645943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-6e63a7bd-8c4d-4d9c-a8f5-f4d5440df63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:23.720192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51faa504-c251-497f-aa2a-69b9eeb4a9c0 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:23.758493 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc14fc-bfbe-44cc-a21e-28dfb7c342b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:23.759521 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc14fc-bfbe-44cc-a21e-28dfb7c342b0 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:23.759865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc14fc-bfbe-44cc-a21e-28dfb7c342b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:23.760222 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc14fc-bfbe-44cc-a21e-28dfb7c342b0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:23.760959 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc14fc-bfbe-44cc-a21e-28dfb7c342b0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:23.762489 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc14fc-bfbe-44cc-a21e-28dfb7c342b0 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:23.775191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-dedc14fc-bfbe-44cc-a21e-28dfb7c342b0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 13 14:51:23.775191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:23.775191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:51:23.775191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:51:23.775191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:51:23.775191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:51:23.775191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:51:23.775191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:23.775191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 14:51:23.775191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:23.775191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:51:23.775191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:23.775191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:23.775191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:23.775191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:23.775191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:23.775191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:23.777080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:23.777080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:23.777080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:23.777080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:23.777080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:23.777080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:23.777080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:51:23.777080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:51:23.777080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:51:23.777080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:51:23.777080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:23.777080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:23.777080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:23.777080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:23.777080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:23.777080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:23.778982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:23.778982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:23.778982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:23.778982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:23.778982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:23.778982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:23.778982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:23.778982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:23.778982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:23.778982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:23.778982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:51:23.778982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:23.778982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 14:51:23.778982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:23.781801 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 466/946] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:51:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:23.782881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc14fc-bfbe-44cc-a21e-28dfb7c342b0 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:23.789085 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 481/947] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:23.817273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63a7bd-8c4d-4d9c-a8f5-f4d5440df63c None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:23.930063 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc14fc-bfbe-44cc-a21e-28dfb7c342b0 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:23.983905 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5338dbb-b5ab-409b-9de6-086e882e23a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:23.984798 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5338dbb-b5ab-409b-9de6-086e882e23a9 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:23.985419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5338dbb-b5ab-409b-9de6-086e882e23a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:23.985700 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5338dbb-b5ab-409b-9de6-086e882e23a9 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:23.986792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5338dbb-b5ab-409b-9de6-086e882e23a9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:23.987287 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5338dbb-b5ab-409b-9de6-086e882e23a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:23.989645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5338dbb-b5ab-409b-9de6-086e882e23a9 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:24.003749 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63a7bd-8c4d-4d9c-a8f5-f4d5440df63c None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:24.004378 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 467/948] 10.222.0.73 () {56 vars in 1112 bytes} [Fri May 13 14:51:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:24.008466 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5338dbb-b5ab-409b-9de6-086e882e23a9 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:24.058564 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d1b13-000c-467f-83ef-cb60fb9327b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:24.060389 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d1b13-000c-467f-83ef-cb60fb9327b9 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:24.060950 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d1b13-000c-467f-83ef-cb60fb9327b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:24.061442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d1b13-000c-467f-83ef-cb60fb9327b9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:24.062725 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d1b13-000c-467f-83ef-cb60fb9327b9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:24.065919 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d1b13-000c-467f-83ef-cb60fb9327b9 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:24.087484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-333d1b13-000c-467f-83ef-cb60fb9327b9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:51:24.087484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:24.087484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:51:24.087484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:51:24.087484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:51:24.087484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:51:24.087484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:51:24.087484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:24.087484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:51:24.087484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:24.087484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:51:24.087484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:24.087484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:24.087484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:24.087484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:24.087484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:24.087484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:24.088589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:24.088589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:24.088589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:24.088589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:24.088589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:24.088589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:24.088589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:51:24.088589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:51:24.088589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:51:24.088589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:51:24.088589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:24.088589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:24.088589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:24.088589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:24.088589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:24.088589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:24.089427 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:24.089427 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:24.089427 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:24.089427 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:24.089427 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:24.089427 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:24.089427 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:24.089427 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:24.089427 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:24.089427 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:24.089427 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:51:24.089427 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:24.089427 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:51:24.089427 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:24.095294 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 482/949] 10.222.0.73 () {56 vars in 1126 bytes} [Fri May 13 14:51:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:24.098704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d1b13-000c-467f-83ef-cb60fb9327b9 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:24.143397 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5338dbb-b5ab-409b-9de6-086e882e23a9 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:24.190795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2874e02-4dd8-45be-9b2e-001143703d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:24.191957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2874e02-4dd8-45be-9b2e-001143703d92 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:24.192409 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2874e02-4dd8-45be-9b2e-001143703d92 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:24.192874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2874e02-4dd8-45be-9b2e-001143703d92 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:24.194653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2874e02-4dd8-45be-9b2e-001143703d92 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:24.195248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2874e02-4dd8-45be-9b2e-001143703d92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:24.197806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2874e02-4dd8-45be-9b2e-001143703d92 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:24.211453 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 468/950] 10.222.0.73 () {56 vars in 1112 bytes} [Fri May 13 14:51:24 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:24.262705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d1b13-000c-467f-83ef-cb60fb9327b9 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:24.306735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc941183-44ba-4851-b261-d4c99ee39bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:24.307729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc941183-44ba-4851-b261-d4c99ee39bb2 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:24.308194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc941183-44ba-4851-b261-d4c99ee39bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:24.308624 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc941183-44ba-4851-b261-d4c99ee39bb2 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:24.309603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc941183-44ba-4851-b261-d4c99ee39bb2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:24.310130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc941183-44ba-4851-b261-d4c99ee39bb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:24.311772 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc941183-44ba-4851-b261-d4c99ee39bb2 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:24.320409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 483/951] 10.222.0.73 () {56 vars in 1122 bytes} [Fri May 13 14:51:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:24.332243 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2874e02-4dd8-45be-9b2e-001143703d92 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:24.470050 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2874e02-4dd8-45be-9b2e-001143703d92 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:24.510544 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce0d47-2355-4e30-af11-8c9f47880be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:24.511540 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce0d47-2355-4e30-af11-8c9f47880be9 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:24.511995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce0d47-2355-4e30-af11-8c9f47880be9 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:24.512424 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce0d47-2355-4e30-af11-8c9f47880be9 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:24.513377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce0d47-2355-4e30-af11-8c9f47880be9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:24.513838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce0d47-2355-4e30-af11-8c9f47880be9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:24.515428 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce0d47-2355-4e30-af11-8c9f47880be9 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:24.521482 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 469/952] 10.222.0.73 () {56 vars in 1122 bytes} [Fri May 13 14:51:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:24.531818 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc941183-44ba-4851-b261-d4c99ee39bb2 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:24.660847 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc941183-44ba-4851-b261-d4c99ee39bb2 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:24.701257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba737a-5146-494b-a9ef-e2e31866952b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:24.702103 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba737a-5146-494b-a9ef-e2e31866952b None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:24.702385 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba737a-5146-494b-a9ef-e2e31866952b None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:24.702657 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba737a-5146-494b-a9ef-e2e31866952b None admin] PATH_INFO: `/v3/endpoints` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:24.703501 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba737a-5146-494b-a9ef-e2e31866952b None admin] RBAC: Adding query filter params (interface=public, service_id=7081ec616d48489bbd9784857cfe6c4a, region_id=RegionOne) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:24.703881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba737a-5146-494b-a9ef-e2e31866952b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:24.705334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba737a-5146-494b-a9ef-e2e31866952b None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:24.711892 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 484/953] 10.222.0.73 () {56 vars in 1251 bytes} [Fri May 13 14:51:24 2022] GET /identity/v3/endpoints?service_id=7081ec616d48489bbd9784857cfe6c4a&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:24.721839 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce0d47-2355-4e30-af11-8c9f47880be9 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:24.785762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18436ef-81b0-4823-8791-0d662a557c82 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:24.786183 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18436ef-81b0-4823-8791-0d662a557c82 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:24.786468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18436ef-81b0-4823-8791-0d662a557c82 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:24.789019 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 485/954] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:51:24.797168 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaeab58-26ac-495e-aea6-98bc027a1dc6 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:24.797597 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaeab58-26ac-495e-aea6-98bc027a1dc6 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:24.797976 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaeab58-26ac-495e-aea6-98bc027a1dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:24.820859 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-daaeab58-26ac-495e-aea6-98bc027a1dc6 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:24.822076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-daaeab58-26ac-495e-aea6-98bc027a1dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:24.896798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 486/955] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:24.911963 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce0d47-2355-4e30-af11-8c9f47880be9 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:24.939988 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaeab58-26ac-495e-aea6-98bc027a1dc6 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:24.956921 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a700f32-d6ab-4548-9408-4131c2e0ca54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:24.957610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a700f32-d6ab-4548-9408-4131c2e0ca54 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:24.957900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a700f32-d6ab-4548-9408-4131c2e0ca54 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:24.958181 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a700f32-d6ab-4548-9408-4131c2e0ca54 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:24.958893 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a700f32-d6ab-4548-9408-4131c2e0ca54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:24.960371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a700f32-d6ab-4548-9408-4131c2e0ca54 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:24.968777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 470/956] 10.222.0.73 () {56 vars in 1087 bytes} [Fri May 13 14:51:24 2022] GET /identity/v3/services => generated 1497 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 14:51:25.099664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaeab58-26ac-495e-aea6-98bc027a1dc6 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:25.143708 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26db905-26d9-4054-a851-b0da179d19ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:25.144968 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26db905-26d9-4054-a851-b0da179d19ab None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:25.145439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26db905-26d9-4054-a851-b0da179d19ab None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:25.145892 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26db905-26d9-4054-a851-b0da179d19ab None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:25.160064 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26db905-26d9-4054-a851-b0da179d19ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:51:25.169049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-f26db905-26d9-4054-a851-b0da179d19ab None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:51:25.169049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:25.169049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:25.169049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:25.169049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:25.169049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:25.169049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:25.169049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:25.169049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:25.169049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:25.169049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:25.169049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:25.169049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:51:25.169049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:51:25.169049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:51:25.169049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:51:25.170216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:51:25.170216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:51:25.170216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:51:25.170216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:51:25.170216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:25.170216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:25.170216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:25.170216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:25.170216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:25.170216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:25.170216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:25.170216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:25.170216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:25.170216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:25.170216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:25.170216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:25.171121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:25.171121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:25.171121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:25.171121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:25.171121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:51:25.171121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:51:25.171121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:51:25.171121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:51:25.171121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:51:25.171121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:51:25.171121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:51:25.171121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:25.173915 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 487/957] 10.222.0.73 () {56 vars in 1120 bytes} [Fri May 13 14:51:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:25.183376 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a700f32-d6ab-4548-9408-4131c2e0ca54 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:25.332447 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a700f32-d6ab-4548-9408-4131c2e0ca54 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:25.371397 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4615e-fc3a-40ad-a2b5-bcd83063be94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:25.372326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4615e-fc3a-40ad-a2b5-bcd83063be94 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:25.372760 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4615e-fc3a-40ad-a2b5-bcd83063be94 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:25.373186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4615e-fc3a-40ad-a2b5-bcd83063be94 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:25.374133 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4615e-fc3a-40ad-a2b5-bcd83063be94 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:25.374618 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4615e-fc3a-40ad-a2b5-bcd83063be94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:25.376379 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4615e-fc3a-40ad-a2b5-bcd83063be94 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:25.388187 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 471/958] 10.222.0.73 () {56 vars in 1115 bytes} [Fri May 13 14:51:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:25.397841 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26db905-26d9-4054-a851-b0da179d19ab None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:25.534869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26db905-26d9-4054-a851-b0da179d19ab None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:25.576797 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e77f0b-969e-4168-957f-70b0fa9b48a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:25.577927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e77f0b-969e-4168-957f-70b0fa9b48a4 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:25.578541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e77f0b-969e-4168-957f-70b0fa9b48a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:25.579078 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e77f0b-969e-4168-957f-70b0fa9b48a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:25.592104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e77f0b-969e-4168-957f-70b0fa9b48a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:25.593824 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e77f0b-969e-4168-957f-70b0fa9b48a4 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:25.614101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-32e77f0b-969e-4168-957f-70b0fa9b48a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:25.614101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:25.614101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:25.614101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:25.614101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:25.614101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:25.614101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:25.614101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:25.614101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:25.614101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:25.614101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:25.614101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:25.614101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:51:25.614101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:51:25.614101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:51:25.615465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:51:25.615465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:25.615465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:25.615465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:25.615465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:25.615465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:25.615465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:25.615465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:25.615465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:25.615465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:25.615465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:25.615465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:25.615465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:25.615465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:25.615465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:25.615465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:25.615465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:25.616568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:51:25.616568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:51:25.616568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:25.616568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:25.618671 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 488/959] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:25.627253 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4615e-fc3a-40ad-a2b5-bcd83063be94 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:25.748928 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4615e-fc3a-40ad-a2b5-bcd83063be94 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:25.790878 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d76976-8689-417d-9c3c-2722250f3104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:25.791848 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d76976-8689-417d-9c3c-2722250f3104 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:25.792306 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d76976-8689-417d-9c3c-2722250f3104 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:25.792729 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d76976-8689-417d-9c3c-2722250f3104 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:25.793637 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d76976-8689-417d-9c3c-2722250f3104 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:25.794104 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d76976-8689-417d-9c3c-2722250f3104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:25.795722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d76976-8689-417d-9c3c-2722250f3104 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:25.809776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 472/960] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:25.818814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e77f0b-969e-4168-957f-70b0fa9b48a4 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:25.983847 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e77f0b-969e-4168-957f-70b0fa9b48a4 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:26.024586 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ce9a0-36cf-42a9-9c20-ce201baf348b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:26.025430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ce9a0-36cf-42a9-9c20-ce201baf348b None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:26.025712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ce9a0-36cf-42a9-9c20-ce201baf348b None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:26.025989 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ce9a0-36cf-42a9-9c20-ce201baf348b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:26.034751 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ce9a0-36cf-42a9-9c20-ce201baf348b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:26.036284 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ce9a0-36cf-42a9-9c20-ce201baf348b None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:26.052157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-700ce9a0-36cf-42a9-9c20-ce201baf348b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:51:26.052157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:26.052157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:26.052157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:26.052157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:26.052157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:26.052157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:26.052157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:26.052157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:26.052157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:26.052157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:26.052157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:26.052157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:51:26.052157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:51:26.052157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:51:26.052157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:51:26.054005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:26.054005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:26.054005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:51:26.054005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:51:26.054005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:51:26.054005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:51:26.054005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:26.054005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:26.054005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:26.054005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:26.054005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:26.054005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:26.054005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:26.054005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:26.054005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:26.054005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:26.054005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:26.054005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:26.055886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:26.055886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:26.055886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:51:26.055886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:51:26.055886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:51:26.055886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:51:26.055886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:51:26.055886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:51:26.055886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 14:51:26.055886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:26.055886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 489/961] 10.222.0.73 () {56 vars in 1117 bytes} [Fri May 13 14:51:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:26.063401 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666d905-c21e-4a73-afbb-5e64dfcdefb9 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:26.063863 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666d905-c21e-4a73-afbb-5e64dfcdefb9 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:26.064343 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666d905-c21e-4a73-afbb-5e64dfcdefb9 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:26.069851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ce9a0-36cf-42a9-9c20-ce201baf348b None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:26.073422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 473/962] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:26.076403 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661039c-f3ae-4988-a999-90c98e9373ed None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:26.076855 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661039c-f3ae-4988-a999-90c98e9373ed None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:26.077322 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661039c-f3ae-4988-a999-90c98e9373ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:26.104005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-f661039c-f3ae-4988-a999-90c98e9373ed None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:26.105949 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-f661039c-f3ae-4988-a999-90c98e9373ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:26.216114 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 474/963] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:51:26.241078 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ce9a0-36cf-42a9-9c20-ce201baf348b None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:26.255645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661039c-f3ae-4988-a999-90c98e9373ed None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:26.284603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed57915-b24e-4789-a87a-f8a9917d1a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:26.285426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed57915-b24e-4789-a87a-f8a9917d1a26 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:26.285708 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed57915-b24e-4789-a87a-f8a9917d1a26 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:26.285982 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed57915-b24e-4789-a87a-f8a9917d1a26 None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:26.287070 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed57915-b24e-4789-a87a-f8a9917d1a26 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:26.287389 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed57915-b24e-4789-a87a-f8a9917d1a26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:26.289309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed57915-b24e-4789-a87a-f8a9917d1a26 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:26.313749 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 490/964] 10.222.0.73 () {56 vars in 1149 bytes} [Fri May 13 14:51:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:26.322373 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed57915-b24e-4789-a87a-f8a9917d1a26 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:26.434487 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661039c-f3ae-4988-a999-90c98e9373ed None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:26.474371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fac1ad-041b-4764-987a-decf2e36c0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:26.475003 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fac1ad-041b-4764-987a-decf2e36c0b4 None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:26.475284 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fac1ad-041b-4764-987a-decf2e36c0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:26.475554 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fac1ad-041b-4764-987a-decf2e36c0b4 None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:26.476513 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fac1ad-041b-4764-987a-decf2e36c0b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:26.477746 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fac1ad-041b-4764-987a-decf2e36c0b4 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:26.479268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: WARNING keystone.server.flask.common [None req-e1fac1ad-041b-4764-987a-decf2e36c0b4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 13 14:51:26.499371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.sql.core [None req-e1fac1ad-041b-4764-987a-decf2e36c0b4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 13 14:51:26.499371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 13 14:51:26.499371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [parameters: {'user_id': 'ffa8340e718f425faa37fe2dbbf0e988', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 13 14:51:26.499371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79916) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 13 14:51:26.513554 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed57915-b24e-4789-a87a-f8a9917d1a26 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:26.537161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-e1fac1ad-041b-4764-987a-decf2e36c0b4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 13 14:51:26.537161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:26.537161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 14:51:26.537161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 14:51:26.537161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 14:51:26.537161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 14:51:26.537161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 14:51:26.537161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application result = self._query(query) May 13 14:51:26.537161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 14:51:26.537161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application conn.query(q) May 13 14:51:26.537161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 14:51:26.537161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 14:51:26.537161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 14:51:26.537161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application result.read() May 13 14:51:26.537161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 14:51:26.539186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 14:51:26.539186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 14:51:26.539186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 14:51:26.539186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 14:51:26.539186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 14:51:26.539186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 14:51:26.539186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 14:51:26.539186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 13 14:51:26.539186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:26.539186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 13 14:51:26.539186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:26.539186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:26.539186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 13 14:51:26.539186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 13 14:51:26.539186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 13 14:51:26.539186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 13 14:51:26.539186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 14:51:26.539186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application next(self.gen) May 13 14:51:26.541377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 13 14:51:26.541377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application yield resource May 13 14:51:26.541377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 14:51:26.541377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application next(self.gen) May 13 14:51:26.541377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 13 14:51:26.541377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self.session.rollback() May 13 14:51:26.541377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 13 14:51:26.541377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self.force_reraise() May 13 14:51:26.541377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 13 14:51:26.541377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise self.value May 13 14:51:26.541377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 13 14:51:26.541377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 13 14:51:26.541377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 13 14:51:26.541377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application session.commit() May 13 14:51:26.541377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 13 14:51:26.541377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 13 14:51:26.541377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 13 14:51:26.544846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._prepare_impl() May 13 14:51:26.544846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 13 14:51:26.544846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self.session.flush() May 13 14:51:26.544846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 13 14:51:26.544846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._flush(objects) May 13 14:51:26.544846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 13 14:51:26.544846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 13 14:51:26.544846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 13 14:51:26.544846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application compat.raise_( May 13 14:51:26.544846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 14:51:26.544846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception May 13 14:51:26.544846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 13 14:51:26.544846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application flush_context.execute() May 13 14:51:26.544846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 13 14:51:26.544846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rec.execute(self) May 13 14:51:26.544846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 13 14:51:26.544846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 13 14:51:26.548502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 13 14:51:26.548502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application _emit_insert_statements( May 13 14:51:26.548502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 13 14:51:26.548502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application result = connection._execute_20( May 13 14:51:26.548502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 13 14:51:26.548502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 13 14:51:26.548502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 13 14:51:26.548502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 13 14:51:26.548502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 13 14:51:26.548502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ret = self._execute_context( May 13 14:51:26.548502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 13 14:51:26.548502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 13 14:51:26.548502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 13 14:51:26.548502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 13 14:51:26.548502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 14:51:26.548502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception May 13 14:51:26.555211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 14:51:26.555211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 14:51:26.555211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 14:51:26.555211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 14:51:26.555211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 14:51:26.555211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application result = self._query(query) May 13 14:51:26.555211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 14:51:26.555211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application conn.query(q) May 13 14:51:26.555211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 14:51:26.555211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 14:51:26.555211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 14:51:26.555211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application result.read() May 13 14:51:26.555211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 14:51:26.555211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 14:51:26.555211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 14:51:26.555211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 14:51:26.558575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 14:51:26.558575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 14:51:26.558575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 14:51:26.558575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 14:51:26.558575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 13 14:51:26.558575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 13 14:51:26.558575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ffa8340e718f425faa37fe2dbbf0e988', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 13 14:51:26.558575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 13 14:51:26.558575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:26.558575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:51:26.558575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:26.558575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:26.558575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:26.558575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:26.558575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:26.562297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:26.562297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:26.562297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:26.562297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:26.562297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:26.562297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:26.562297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:26.562297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 13 14:51:26.562297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 13 14:51:26.562297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:26.562297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:26.562297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:51:26.562297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:51:26.562297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:51:26.562297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:51:26.562297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 13 14:51:26.562297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 13 14:51:26.567305 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 13 14:51:26.567305 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 13 14:51:26.567305 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 13 14:51:26.567305 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 13 14:51:26.567305 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 13 14:51:26.567305 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:26.567305 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 475/965] 10.222.0.73 () {60 vars in 1131 bytes} [Fri May 13 14:51:26 2022] POST /identity/v3/users => generated 160 bytes in 305 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:26.573399 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fac1ad-041b-4764-987a-decf2e36c0b4 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:26.589339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccff01-5377-462f-ba47-678330da7863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:26.590383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccff01-5377-462f-ba47-678330da7863 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:26.590874 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccff01-5377-462f-ba47-678330da7863 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:26.591345 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccff01-5377-462f-ba47-678330da7863 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:26.737109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccff01-5377-462f-ba47-678330da7863 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:26.739692 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccff01-5377-462f-ba47-678330da7863 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:26.764451 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fac1ad-041b-4764-987a-decf2e36c0b4 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:26.838130 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714fb8c-fd02-4064-8cc0-39d87035bc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:26.839530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714fb8c-fd02-4064-8cc0-39d87035bc7b None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:26.840002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714fb8c-fd02-4064-8cc0-39d87035bc7b None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:26.840466 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714fb8c-fd02-4064-8cc0-39d87035bc7b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:26.857726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714fb8c-fd02-4064-8cc0-39d87035bc7b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:26.861690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714fb8c-fd02-4064-8cc0-39d87035bc7b None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:26.893681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-a714fb8c-fd02-4064-8cc0-39d87035bc7b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 13 14:51:26.893681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:26.893681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:26.893681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:26.893681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:26.893681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:26.893681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:26.893681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:26.893681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:26.893681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:26.893681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:26.893681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:26.893681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:51:26.893681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:51:26.893681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:51:26.893681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:51:26.895814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:26.895814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:26.895814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:51:26.895814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:51:26.895814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:51:26.895814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:51:26.895814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:26.895814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:26.895814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:26.895814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:26.895814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:26.895814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:26.895814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:26.895814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:26.895814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:26.895814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:26.895814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:26.895814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:26.897911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:26.897911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:26.897911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:51:26.897911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:51:26.897911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:51:26.897911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:51:26.897911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:51:26.897911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:51:26.897911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 13 14:51:26.897911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:26.901500 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 476/966] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:51:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:26.905529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714fb8c-fd02-4064-8cc0-39d87035bc7b None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:26.952390 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 491/967] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:51:26 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:51:26.958103 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccff01-5377-462f-ba47-678330da7863 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:27.086720 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714fb8c-fd02-4064-8cc0-39d87035bc7b None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:27.146473 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccff01-5377-462f-ba47-678330da7863 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:27.149316 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f84a1-0ef7-4ad8-b11d-497ecb1650f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:27.150540 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f84a1-0ef7-4ad8-b11d-497ecb1650f7 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:27.150868 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f84a1-0ef7-4ad8-b11d-497ecb1650f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:27.151341 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f84a1-0ef7-4ad8-b11d-497ecb1650f7 None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:27.154011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f84a1-0ef7-4ad8-b11d-497ecb1650f7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:27.154011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f84a1-0ef7-4ad8-b11d-497ecb1650f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:27.155934 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f84a1-0ef7-4ad8-b11d-497ecb1650f7 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:27.216346 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be21c05-a1b0-4a36-8ef8-068ec3e58167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:27.218126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be21c05-a1b0-4a36-8ef8-068ec3e58167 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:27.218891 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be21c05-a1b0-4a36-8ef8-068ec3e58167 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:27.219616 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be21c05-a1b0-4a36-8ef8-068ec3e58167 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:27.235013 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 477/968] 10.222.0.73 () {56 vars in 1101 bytes} [Fri May 13 14:51:26 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:27.240983 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be21c05-a1b0-4a36-8ef8-068ec3e58167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:27.243948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be21c05-a1b0-4a36-8ef8-068ec3e58167 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:27.277220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-1be21c05-a1b0-4a36-8ef8-068ec3e58167 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:27.277220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:27.277220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:27.277220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:27.277220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:27.277220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:27.277220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:27.277220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:27.277220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:27.277220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:27.277220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:27.277220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:27.277220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:51:27.277220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:51:27.277220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:51:27.279291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:51:27.279291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:27.279291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:27.279291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:27.279291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:27.279291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:27.279291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:27.279291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:27.279291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:27.279291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:27.279291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:27.279291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:27.279291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:27.279291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:27.279291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:27.279291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:27.279291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:27.280937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:51:27.280937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:51:27.280937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:27.280937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:27.285260 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 492/969] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:27.294628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f84a1-0ef7-4ad8-b11d-497ecb1650f7 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:27.318471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46117b7-3f38-4ec7-8414-5c7a5bea591a None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:27.319120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46117b7-3f38-4ec7-8414-5c7a5bea591a None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:27.319642 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46117b7-3f38-4ec7-8414-5c7a5bea591a None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:27.322470 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 493/970] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:27.332187 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1024b4-ef12-430e-90cf-f79160d194a3 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:27.332770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1024b4-ef12-430e-90cf-f79160d194a3 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:27.333334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1024b4-ef12-430e-90cf-f79160d194a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:27.359376 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-9c1024b4-ef12-430e-90cf-f79160d194a3 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:27.361470 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-9c1024b4-ef12-430e-90cf-f79160d194a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:27.450068 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f84a1-0ef7-4ad8-b11d-497ecb1650f7 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:27.494857 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 494/971] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:51:27.515950 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277990d-17e5-4ded-9531-258bf503b587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:27.517023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277990d-17e5-4ded-9531-258bf503b587 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:27.517512 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277990d-17e5-4ded-9531-258bf503b587 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:27.518543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277990d-17e5-4ded-9531-258bf503b587 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:27.519540 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277990d-17e5-4ded-9531-258bf503b587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:27.520083 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277990d-17e5-4ded-9531-258bf503b587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:27.522036 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277990d-17e5-4ded-9531-258bf503b587 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:27.539508 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 478/972] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:27.543808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1024b4-ef12-430e-90cf-f79160d194a3 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:27.549000 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277990d-17e5-4ded-9531-258bf503b587 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:27.744944 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1024b4-ef12-430e-90cf-f79160d194a3 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:27.747601 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277990d-17e5-4ded-9531-258bf503b587 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:27.797694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2259a-174a-4e6d-bde5-36e4aa049caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:27.798865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2259a-174a-4e6d-bde5-36e4aa049caa None admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:27.799391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2259a-174a-4e6d-bde5-36e4aa049caa None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:27.799940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2259a-174a-4e6d-bde5-36e4aa049caa None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:27.801341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2259a-174a-4e6d-bde5-36e4aa049caa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:27.803956 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2259a-174a-4e6d-bde5-36e4aa049caa None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:27.807811 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da8bdd-9b9b-4c02-9db2-56b84442c018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:27.810345 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da8bdd-9b9b-4c02-9db2-56b84442c018 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:27.811346 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da8bdd-9b9b-4c02-9db2-56b84442c018 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:27.812021 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da8bdd-9b9b-4c02-9db2-56b84442c018 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:27.825301 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 495/973] 10.222.0.73 () {60 vars in 1141 bytes} [Fri May 13 14:51:27 2022] POST /identity/v3/services => generated 242 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:51:27.828584 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da8bdd-9b9b-4c02-9db2-56b84442c018 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:27.832064 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da8bdd-9b9b-4c02-9db2-56b84442c018 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:27.867927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-91da8bdd-9b9b-4c02-9db2-56b84442c018 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:27.867927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:27.867927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:27.867927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:27.867927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:27.867927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:27.867927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:27.867927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:27.867927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:27.867927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:27.867927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:27.867927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:27.867927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:51:27.867927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:51:27.867927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:51:27.869146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:51:27.869146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:27.869146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:27.869146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:27.869146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:27.869146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:27.869146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:27.869146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:27.869146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:27.869146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:27.869146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:27.869146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:27.869146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:27.869146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:27.869146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:27.869146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:27.869146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:27.870247 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:51:27.870247 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:51:27.870247 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:51:27.870247 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:51:27.870247 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:51:27.870247 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:51:27.870247 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:27.870247 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:27.871149 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 479/974] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:51:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:27.888226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2259a-174a-4e6d-bde5-36e4aa049caa None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:28.061421 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2259a-174a-4e6d-bde5-36e4aa049caa None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:28.123909 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd394440-9cb6-4500-8d15-0fafe8c63842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:28.125048 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd394440-9cb6-4500-8d15-0fafe8c63842 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:28.125502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd394440-9cb6-4500-8d15-0fafe8c63842 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:28.125945 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd394440-9cb6-4500-8d15-0fafe8c63842 None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:28.128012 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd394440-9cb6-4500-8d15-0fafe8c63842 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:28.128554 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd394440-9cb6-4500-8d15-0fafe8c63842 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:28.131259 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd394440-9cb6-4500-8d15-0fafe8c63842 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:28.155463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 496/975] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:51:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:28.156172 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a4b50-78b6-4e50-873e-6f0c81722757 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:28.156452 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a4b50-78b6-4e50-873e-6f0c81722757 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:28.156728 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a4b50-78b6-4e50-873e-6f0c81722757 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:28.158146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 480/976] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:51:28.163579 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a4b50-78b6-4e50-873e-6f0c81722757 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:28.164426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17170fc8-512f-4dbd-9533-063b8bb0120d None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:28.164906 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17170fc8-512f-4dbd-9533-063b8bb0120d None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:28.165590 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17170fc8-512f-4dbd-9533-063b8bb0120d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:28.189333 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-17170fc8-512f-4dbd-9533-063b8bb0120d None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:28.191274 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-17170fc8-512f-4dbd-9533-063b8bb0120d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:28.300720 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a4b50-78b6-4e50-873e-6f0c81722757 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:28.318773 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 497/977] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:28.342749 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17170fc8-512f-4dbd-9533-063b8bb0120d None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:28.355296 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a844ab2-cb0f-4ba1-837d-24d80bd62dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:28.356337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a844ab2-cb0f-4ba1-837d-24d80bd62dba None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:28.356828 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a844ab2-cb0f-4ba1-837d-24d80bd62dba None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:28.357309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a844ab2-cb0f-4ba1-837d-24d80bd62dba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:28.358806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a844ab2-cb0f-4ba1-837d-24d80bd62dba None admin] RBAC: Adding query filter params (role.id=a77c06fbc15841b2943535dab76a36b5, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=0c04f5fb770d49c0a50f2cfbd77e17e0) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:28.359373 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a844ab2-cb0f-4ba1-837d-24d80bd62dba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:28.363191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a844ab2-cb0f-4ba1-837d-24d80bd62dba None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:28.383082 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 481/978] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:51:28 2022] GET /identity/v3/role_assignments?user.id=0c04f5fb770d49c0a50f2cfbd77e17e0&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=a77c06fbc15841b2943535dab76a36b5 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:28.541873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17170fc8-512f-4dbd-9533-063b8bb0120d None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:28.601391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e5b63-4f5b-4341-befe-16ad1401825f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:28.602227 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e5b63-4f5b-4341-befe-16ad1401825f None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:28.602508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e5b63-4f5b-4341-befe-16ad1401825f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:28.602785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e5b63-4f5b-4341-befe-16ad1401825f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:28.603477 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e5b63-4f5b-4341-befe-16ad1401825f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:28.604893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e5b63-4f5b-4341-befe-16ad1401825f None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:28.618316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-0f5e5b63-4f5b-4341-befe-16ad1401825f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:51:28.618316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:28.618316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:51:28.618316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:51:28.618316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:51:28.618316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:51:28.618316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:51:28.618316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:28.618316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:51:28.618316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:28.618316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:51:28.618316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:28.618316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:28.618316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:28.618316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:28.618316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:28.618316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:28.620537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:28.620537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:28.620537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:28.620537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:28.620537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:28.620537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:28.620537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:51:28.620537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:51:28.620537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:51:28.620537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:51:28.620537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:28.620537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:28.620537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:28.620537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:28.620537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:28.620537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:28.622483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:28.622483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:28.622483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:28.622483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:28.622483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:28.622483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:28.622483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:28.622483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:28.622483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:28.622483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:28.622483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:51:28.622483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:28.622483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:51:28.622483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:28.622483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 498/979] 10.222.0.73 () {56 vars in 1126 bytes} [Fri May 13 14:51:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:28.627528 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a844ab2-cb0f-4ba1-837d-24d80bd62dba None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:28.763569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a844ab2-cb0f-4ba1-837d-24d80bd62dba None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:28.805201 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b48a8b-bcb0-4913-8106-2921025f838d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:28.805888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b48a8b-bcb0-4913-8106-2921025f838d None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:28.806162 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b48a8b-bcb0-4913-8106-2921025f838d None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:28.806429 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b48a8b-bcb0-4913-8106-2921025f838d None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:28.807212 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b48a8b-bcb0-4913-8106-2921025f838d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:28.807515 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b48a8b-bcb0-4913-8106-2921025f838d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:28.809185 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b48a8b-bcb0-4913-8106-2921025f838d None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:28.823171 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 482/980] 10.222.0.73 () {56 vars in 1122 bytes} [Fri May 13 14:51:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:28.825708 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e5b63-4f5b-4341-befe-16ad1401825f None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:29.032946 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e5b63-4f5b-4341-befe-16ad1401825f None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:29.097454 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdafe25-1f20-4d01-a858-c4c18143dc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:29.098581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdafe25-1f20-4d01-a858-c4c18143dc44 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:29.099108 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdafe25-1f20-4d01-a858-c4c18143dc44 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:29.099591 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdafe25-1f20-4d01-a858-c4c18143dc44 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:29.100897 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdafe25-1f20-4d01-a858-c4c18143dc44 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:29.101445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdafe25-1f20-4d01-a858-c4c18143dc44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:29.104119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdafe25-1f20-4d01-a858-c4c18143dc44 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:29.121893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 499/981] 10.222.0.73 () {56 vars in 1122 bytes} [Fri May 13 14:51:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:29.124446 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b48a8b-bcb0-4913-8106-2921025f838d None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:29.320065 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b48a8b-bcb0-4913-8106-2921025f838d None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:29.386849 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a533ad6-4f5a-442d-b423-c209d8d23f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:29.388001 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a533ad6-4f5a-442d-b423-c209d8d23f1e None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:29.388496 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a533ad6-4f5a-442d-b423-c209d8d23f1e None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:29.388977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a533ad6-4f5a-442d-b423-c209d8d23f1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:29.390394 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a533ad6-4f5a-442d-b423-c209d8d23f1e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:29.393465 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a533ad6-4f5a-442d-b423-c209d8d23f1e None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:29.433714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 483/982] 10.222.0.73 () {60 vars in 1144 bytes} [Fri May 13 14:51:29 2022] POST /identity/v3/endpoints => generated 349 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:51:30.877810 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1fd4b-3fd4-4a93-96f7-b88997d72dad None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:30.878660 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1fd4b-3fd4-4a93-96f7-b88997d72dad None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:30.878660 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1fd4b-3fd4-4a93-96f7-b88997d72dad None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:30.880042 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 500/983] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:51:30.888908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e11111-6d15-4ed4-869a-343730f37222 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:30.889673 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e11111-6d15-4ed4-869a-343730f37222 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:30.889673 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e11111-6d15-4ed4-869a-343730f37222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:30.909770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-28e11111-6d15-4ed4-869a-343730f37222 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:30.911657 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-28e11111-6d15-4ed4-869a-343730f37222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:30.921141 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318c358-5fb3-4f75-8520-2a0bc29437fa None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:30.921457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318c358-5fb3-4f75-8520-2a0bc29437fa None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:30.921780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318c358-5fb3-4f75-8520-2a0bc29437fa None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:30.923148 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 501/984] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:51:30.930669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db2cbb-5711-428d-9aa8-89b0b578e417 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:30.931294 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db2cbb-5711-428d-9aa8-89b0b578e417 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:30.931576 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db2cbb-5711-428d-9aa8-89b0b578e417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:30.949637 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-13db2cbb-5711-428d-9aa8-89b0b578e417 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:30.950899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-13db2cbb-5711-428d-9aa8-89b0b578e417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:31.008125 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 484/985] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:31.027585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 502/986] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:31.037543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e11111-6d15-4ed4-869a-343730f37222 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:31.057680 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db2cbb-5711-428d-9aa8-89b0b578e417 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:31.168096 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e11111-6d15-4ed4-869a-343730f37222 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:31.197890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db2cbb-5711-428d-9aa8-89b0b578e417 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:31.217468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d379e-459a-499a-bf5e-4aa42e17aaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:31.218274 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d379e-459a-499a-bf5e-4aa42e17aaac None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:31.218557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d379e-459a-499a-bf5e-4aa42e17aaac None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:31.218845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d379e-459a-499a-bf5e-4aa42e17aaac None admin] PATH_INFO: `/v3/services/image` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:31.219535 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d379e-459a-499a-bf5e-4aa42e17aaac None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:31.221501 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d379e-459a-499a-bf5e-4aa42e17aaac None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:31.233962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-c36d379e-459a-499a-bf5e-4aa42e17aaac None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 13 14:51:31.233962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:31.233962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:51:31.233962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:51:31.233962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:51:31.233962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:51:31.233962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:51:31.233962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:31.233962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 14:51:31.233962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:31.233962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:51:31.233962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:31.233962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:31.233962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:31.233962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:31.233962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:31.233962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:31.235115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:31.235115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:31.235115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:31.235115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:31.235115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:31.235115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:31.235115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:51:31.235115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:51:31.235115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:51:31.235115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:51:31.235115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:31.235115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:31.235115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:31.235115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:31.235115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:31.235115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:31.236135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:31.236135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:31.236135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:31.236135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:31.236135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:31.236135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:31.236135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:31.236135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:31.236135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:31.236135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:31.236135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:51:31.236135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:31.236135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 14:51:31.236135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:31.236135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 485/987] 10.222.0.73 () {56 vars in 1105 bytes} [Fri May 13 14:51:31 2022] GET /identity/v3/services/image => generated 86 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:31.241632 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d379e-459a-499a-bf5e-4aa42e17aaac None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:31.257181 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad6609-d2af-48c0-a777-792ed548f99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:31.258540 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad6609-d2af-48c0-a777-792ed548f99a None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:31.259075 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad6609-d2af-48c0-a777-792ed548f99a None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:31.259563 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad6609-d2af-48c0-a777-792ed548f99a None admin] PATH_INFO: `/v3/services/compute` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:31.260838 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad6609-d2af-48c0-a777-792ed548f99a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:31.263580 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad6609-d2af-48c0-a777-792ed548f99a None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:31.286289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-28ad6609-d2af-48c0-a777-792ed548f99a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 13 14:51:31.286289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:31.286289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:51:31.286289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:51:31.286289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:51:31.286289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:51:31.286289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:51:31.286289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:31.286289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 14:51:31.286289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:31.286289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:51:31.286289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:31.286289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:31.286289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:31.286289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:31.286289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:31.286289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:31.287447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:31.287447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:31.287447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:31.287447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:31.287447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:31.287447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:31.287447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:51:31.287447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:51:31.287447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:51:31.287447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:51:31.287447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:31.287447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:31.287447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:31.287447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:31.287447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:31.287447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:31.288338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:31.288338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:31.288338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:31.288338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:31.288338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:31.288338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:31.288338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:31.288338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:31.288338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:31.288338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:31.288338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:51:31.288338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:31.288338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 14:51:31.288338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:31.289120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 503/988] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:51:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:31.294945 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad6609-d2af-48c0-a777-792ed548f99a None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:31.368469 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d379e-459a-499a-bf5e-4aa42e17aaac None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:31.409617 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2aad61-00b1-4b96-a33b-7fe1b607a2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:31.410341 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2aad61-00b1-4b96-a33b-7fe1b607a2b6 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:31.410622 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2aad61-00b1-4b96-a33b-7fe1b607a2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:31.410941 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2aad61-00b1-4b96-a33b-7fe1b607a2b6 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:31.411710 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2aad61-00b1-4b96-a33b-7fe1b607a2b6 None admin] RBAC: Adding query filter params (name=image) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:31.412018 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2aad61-00b1-4b96-a33b-7fe1b607a2b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:31.413449 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2aad61-00b1-4b96-a33b-7fe1b607a2b6 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:31.419071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 486/989] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:31.425063 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2aad61-00b1-4b96-a33b-7fe1b607a2b6 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:31.446466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad6609-d2af-48c0-a777-792ed548f99a None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:31.494914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c55990-0eb9-427d-a125-31f0a25e3908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:31.495944 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c55990-0eb9-427d-a125-31f0a25e3908 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:31.496419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c55990-0eb9-427d-a125-31f0a25e3908 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:31.496876 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c55990-0eb9-427d-a125-31f0a25e3908 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:31.497800 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c55990-0eb9-427d-a125-31f0a25e3908 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:31.498312 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c55990-0eb9-427d-a125-31f0a25e3908 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:31.499965 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c55990-0eb9-427d-a125-31f0a25e3908 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:31.506530 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 504/990] 10.222.0.73 () {56 vars in 1112 bytes} [Fri May 13 14:51:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:31.515284 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c55990-0eb9-427d-a125-31f0a25e3908 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:31.554569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2aad61-00b1-4b96-a33b-7fe1b607a2b6 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:31.615656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484daf7f-4574-4264-a5c0-5849c7e7bd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:31.616722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484daf7f-4574-4264-a5c0-5849c7e7bd2e None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:31.617192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484daf7f-4574-4264-a5c0-5849c7e7bd2e None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:31.617681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484daf7f-4574-4264-a5c0-5849c7e7bd2e None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:31.619049 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484daf7f-4574-4264-a5c0-5849c7e7bd2e None admin] RBAC: Adding query filter params (type=image) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:31.619601 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484daf7f-4574-4264-a5c0-5849c7e7bd2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:31.622307 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484daf7f-4574-4264-a5c0-5849c7e7bd2e None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:31.639157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 487/991] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:31.703323 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c55990-0eb9-427d-a125-31f0a25e3908 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:31.765996 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c351a10-c483-40b7-a1db-5ff4732b5461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:31.767147 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c351a10-c483-40b7-a1db-5ff4732b5461 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:31.767625 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c351a10-c483-40b7-a1db-5ff4732b5461 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:31.768149 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c351a10-c483-40b7-a1db-5ff4732b5461 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:31.769370 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c351a10-c483-40b7-a1db-5ff4732b5461 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:31.769906 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c351a10-c483-40b7-a1db-5ff4732b5461 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:31.772328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c351a10-c483-40b7-a1db-5ff4732b5461 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:31.786885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 505/992] 10.222.0.73 () {56 vars in 1112 bytes} [Fri May 13 14:51:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:31.791036 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484daf7f-4574-4264-a5c0-5849c7e7bd2e None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:31.962503 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484daf7f-4574-4264-a5c0-5849c7e7bd2e None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:32.017812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bb82f-3d62-4414-9641-32321c22f12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:32.018809 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bb82f-3d62-4414-9641-32321c22f12c None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:32.019274 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bb82f-3d62-4414-9641-32321c22f12c None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:32.019687 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bb82f-3d62-4414-9641-32321c22f12c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:32.021088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bb82f-3d62-4414-9641-32321c22f12c None admin] RBAC: Adding query filter params (interface=public, service_id=f156f54892b547f5948f556c2952431a, region_id=RegionOne) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:32.021570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bb82f-3d62-4414-9641-32321c22f12c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:32.025353 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bb82f-3d62-4414-9641-32321c22f12c None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:32.035641 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 488/993] 10.222.0.73 () {56 vars in 1251 bytes} [Fri May 13 14:51:31 2022] GET /identity/v3/endpoints?service_id=f156f54892b547f5948f556c2952431a&interface=public®ion_id=RegionOne => generated 194 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:32.043811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c351a10-c483-40b7-a1db-5ff4732b5461 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:32.157111 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c351a10-c483-40b7-a1db-5ff4732b5461 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:32.194054 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14685fa-c37b-479c-927b-be573d975ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:32.194727 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14685fa-c37b-479c-927b-be573d975ce2 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:32.195035 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14685fa-c37b-479c-927b-be573d975ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:32.195304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14685fa-c37b-479c-927b-be573d975ce2 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:32.195987 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14685fa-c37b-479c-927b-be573d975ce2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:32.197390 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14685fa-c37b-479c-927b-be573d975ce2 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:32.204543 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 506/994] 10.222.0.73 () {56 vars in 1087 bytes} [Fri May 13 14:51:32 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:51:32.686379 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c4fd3-262a-4adb-bf36-08d3e1e29cc7 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:32.686661 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c4fd3-262a-4adb-bf36-08d3e1e29cc7 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:32.686975 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c4fd3-262a-4adb-bf36-08d3e1e29cc7 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:32.688375 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 489/995] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:32.694441 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e4c8b-2a57-4e0b-84ca-8e490ef81c64 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:32.694728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e4c8b-2a57-4e0b-84ca-8e490ef81c64 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:32.695047 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e4c8b-2a57-4e0b-84ca-8e490ef81c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:32.713788 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-564e4c8b-2a57-4e0b-84ca-8e490ef81c64 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:32.715027 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-564e4c8b-2a57-4e0b-84ca-8e490ef81c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:32.787050 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 507/996] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:32.809876 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c4fd3-262a-4adb-bf36-08d3e1e29cc7 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:32.937685 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c4fd3-262a-4adb-bf36-08d3e1e29cc7 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:32.977139 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6f196-9995-48c8-8ac8-e2492ba26864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:32.978115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6f196-9995-48c8-8ac8-e2492ba26864 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:32.978252 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6f196-9995-48c8-8ac8-e2492ba26864 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:32.978626 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6f196-9995-48c8-8ac8-e2492ba26864 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:32.979157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6f196-9995-48c8-8ac8-e2492ba26864 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:32.980534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6f196-9995-48c8-8ac8-e2492ba26864 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:32.993628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-40d6f196-9995-48c8-8ac8-e2492ba26864 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:51:32.993628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:32.993628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:51:32.993628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:51:32.993628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:51:32.993628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:51:32.993628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:51:32.993628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:32.993628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:51:32.993628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:32.993628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:51:32.993628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:32.993628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:32.993628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:32.993628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:32.993628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:32.993628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:32.995684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:32.995684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:32.995684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:32.995684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:32.995684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:32.995684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:32.995684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:51:32.995684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:51:32.995684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:51:32.995684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:51:32.995684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:32.995684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:32.995684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:32.995684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:32.995684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:32.995684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:32.997359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:32.997359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:32.997359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:32.997359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:32.997359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:32.997359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:32.997359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:32.997359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:32.997359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:32.997359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:32.997359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:51:32.997359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:32.997359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:51:32.997359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:33.002860 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 490/997] 10.222.0.73 () {56 vars in 1126 bytes} [Fri May 13 14:51:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:33.003029 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e4c8b-2a57-4e0b-84ca-8e490ef81c64 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:33.164453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e4c8b-2a57-4e0b-84ca-8e490ef81c64 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:33.224270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c11cbb-dcf7-4859-8b21-a466b3fb6572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:33.225891 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c11cbb-dcf7-4859-8b21-a466b3fb6572 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:33.226739 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c11cbb-dcf7-4859-8b21-a466b3fb6572 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:33.227551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c11cbb-dcf7-4859-8b21-a466b3fb6572 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:33.229058 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c11cbb-dcf7-4859-8b21-a466b3fb6572 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:33.229790 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c11cbb-dcf7-4859-8b21-a466b3fb6572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:33.232506 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c11cbb-dcf7-4859-8b21-a466b3fb6572 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:33.242623 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 508/998] 10.222.0.73 () {56 vars in 1122 bytes} [Fri May 13 14:51:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:33.249490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6f196-9995-48c8-8ac8-e2492ba26864 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:33.437167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6f196-9995-48c8-8ac8-e2492ba26864 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:33.477085 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4aa80-a285-4d79-97bc-b851831fd40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:33.477659 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4aa80-a285-4d79-97bc-b851831fd40f None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:33.477935 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4aa80-a285-4d79-97bc-b851831fd40f None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:33.478202 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4aa80-a285-4d79-97bc-b851831fd40f None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:33.478954 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4aa80-a285-4d79-97bc-b851831fd40f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:33.479257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4aa80-a285-4d79-97bc-b851831fd40f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:33.480651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4aa80-a285-4d79-97bc-b851831fd40f None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:33.490877 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 491/999] 10.222.0.73 () {56 vars in 1122 bytes} [Fri May 13 14:51:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:33.497262 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c11cbb-dcf7-4859-8b21-a466b3fb6572 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:33.685797 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c11cbb-dcf7-4859-8b21-a466b3fb6572 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:33.753944 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef2d38-49bb-415f-9c63-6d9a7e9428e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:33.755061 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef2d38-49bb-415f-9c63-6d9a7e9428e7 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:33.755558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef2d38-49bb-415f-9c63-6d9a7e9428e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:33.756046 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef2d38-49bb-415f-9c63-6d9a7e9428e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:33.757669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef2d38-49bb-415f-9c63-6d9a7e9428e7 None admin] RBAC: Adding query filter params (interface=admin, service_id=7081ec616d48489bbd9784857cfe6c4a, region_id=RegionOne) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:33.758247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef2d38-49bb-415f-9c63-6d9a7e9428e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:33.760952 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef2d38-49bb-415f-9c63-6d9a7e9428e7 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:33.775169 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 509/1000] 10.222.0.73 () {56 vars in 1249 bytes} [Fri May 13 14:51:33 2022] GET /identity/v3/endpoints?service_id=7081ec616d48489bbd9784857cfe6c4a&interface=admin®ion_id=RegionOne => generated 193 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:33.781112 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4aa80-a285-4d79-97bc-b851831fd40f None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:33.982697 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4aa80-a285-4d79-97bc-b851831fd40f None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:34.046634 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32c016-12f2-4617-914d-9d6b6880aa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:34.047780 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32c016-12f2-4617-914d-9d6b6880aa9e None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:34.048259 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32c016-12f2-4617-914d-9d6b6880aa9e None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:34.049344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32c016-12f2-4617-914d-9d6b6880aa9e None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:34.050602 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32c016-12f2-4617-914d-9d6b6880aa9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:34.053288 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32c016-12f2-4617-914d-9d6b6880aa9e None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:34.075178 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 492/1001] 10.222.0.73 () {56 vars in 1087 bytes} [Fri May 13 14:51:33 2022] GET /identity/v3/services => generated 1727 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:51:34.538262 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128aa0b7-d5e7-45a6-9603-330d48319b6f None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:34.539420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128aa0b7-d5e7-45a6-9603-330d48319b6f None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:34.539588 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128aa0b7-d5e7-45a6-9603-330d48319b6f None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:34.541416 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 510/1002] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:34.548791 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628c159-f887-44e9-aabd-0a45352e2ff7 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:34.549831 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628c159-f887-44e9-aabd-0a45352e2ff7 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:34.550654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628c159-f887-44e9-aabd-0a45352e2ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:34.582641 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-d628c159-f887-44e9-aabd-0a45352e2ff7 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:34.585204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-d628c159-f887-44e9-aabd-0a45352e2ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:34.716576 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 493/1003] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:34.746188 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0e3b0-939e-4ca4-9802-27098a8aaf46 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:34.746838 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0e3b0-939e-4ca4-9802-27098a8aaf46 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:34.747397 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0e3b0-939e-4ca4-9802-27098a8aaf46 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:34.750168 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 511/1004] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:34.757209 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628c159-f887-44e9-aabd-0a45352e2ff7 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:34.759771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a7584-fe49-4dde-85ec-0a82c25ebae7 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:34.760272 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a7584-fe49-4dde-85ec-0a82c25ebae7 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:34.760767 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a7584-fe49-4dde-85ec-0a82c25ebae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:34.788550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-9e3a7584-fe49-4dde-85ec-0a82c25ebae7 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:34.790553 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-9e3a7584-fe49-4dde-85ec-0a82c25ebae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:34.891053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 512/1005] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:34.910518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a7584-fe49-4dde-85ec-0a82c25ebae7 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:34.925434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628c159-f887-44e9-aabd-0a45352e2ff7 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:34.989525 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ada96f-99a7-441f-aa55-24ddd164bb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:34.990931 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ada96f-99a7-441f-aa55-24ddd164bb8d None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:34.991423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ada96f-99a7-441f-aa55-24ddd164bb8d None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:34.991874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ada96f-99a7-441f-aa55-24ddd164bb8d None admin] PATH_INFO: `/v3/services/compute` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:34.993109 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ada96f-99a7-441f-aa55-24ddd164bb8d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:34.995673 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ada96f-99a7-441f-aa55-24ddd164bb8d None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:35.021599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-f4ada96f-99a7-441f-aa55-24ddd164bb8d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 13 14:51:35.021599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:35.021599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:51:35.021599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:51:35.021599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:51:35.021599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:51:35.021599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:51:35.021599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:35.021599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 14:51:35.021599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:35.021599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:51:35.021599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:35.021599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:35.021599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:35.021599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:35.021599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:35.021599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:35.023776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:35.023776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:35.023776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:35.023776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:35.023776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:35.023776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:35.023776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:51:35.023776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:51:35.023776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:51:35.023776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:51:35.023776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:35.023776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:35.023776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:35.023776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:35.023776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:35.023776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:35.025519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:35.025519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:35.025519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:35.025519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:35.025519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:35.025519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:35.025519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:35.025519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:35.025519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:35.025519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:35.025519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:51:35.025519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:35.025519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 14:51:35.025519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:35.036292 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 494/1006] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:51:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:35.040815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a7584-fe49-4dde-85ec-0a82c25ebae7 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:35.044287 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ada96f-99a7-441f-aa55-24ddd164bb8d None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:35.104816 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbac012-fd29-4978-9c7b-8298c5de54af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:35.106345 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbac012-fd29-4978-9c7b-8298c5de54af None admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:35.107137 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbac012-fd29-4978-9c7b-8298c5de54af None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:35.107836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbac012-fd29-4978-9c7b-8298c5de54af None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:35.109221 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbac012-fd29-4978-9c7b-8298c5de54af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:35.112029 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbac012-fd29-4978-9c7b-8298c5de54af None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:35.139441 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 513/1007] 10.222.0.73 () {60 vars in 1141 bytes} [Fri May 13 14:51:34 2022] POST /identity/v3/services => generated 242 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:51:35.206778 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ada96f-99a7-441f-aa55-24ddd164bb8d None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:35.290441 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e9441-8cf3-48bd-a872-d5c8d6a68f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:35.291798 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e9441-8cf3-48bd-a872-d5c8d6a68f54 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:35.292191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e9441-8cf3-48bd-a872-d5c8d6a68f54 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:35.292689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e9441-8cf3-48bd-a872-d5c8d6a68f54 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:35.294116 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e9441-8cf3-48bd-a872-d5c8d6a68f54 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:35.294678 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e9441-8cf3-48bd-a872-d5c8d6a68f54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:35.297510 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e9441-8cf3-48bd-a872-d5c8d6a68f54 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:35.307771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 495/1008] 10.222.0.73 () {56 vars in 1112 bytes} [Fri May 13 14:51:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:35.319047 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbac012-fd29-4978-9c7b-8298c5de54af None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:35.522748 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbac012-fd29-4978-9c7b-8298c5de54af None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:35.587580 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e43f09-78a6-437b-b174-560e60bd4649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:35.588672 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e43f09-78a6-437b-b174-560e60bd4649 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:35.589065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e43f09-78a6-437b-b174-560e60bd4649 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:35.589532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e43f09-78a6-437b-b174-560e60bd4649 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:35.590901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e43f09-78a6-437b-b174-560e60bd4649 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:35.591409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e43f09-78a6-437b-b174-560e60bd4649 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:35.593942 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e43f09-78a6-437b-b174-560e60bd4649 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:35.611444 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 514/1009] 10.222.0.73 () {56 vars in 1112 bytes} [Fri May 13 14:51:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:35.614102 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e9441-8cf3-48bd-a872-d5c8d6a68f54 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:35.815222 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e9441-8cf3-48bd-a872-d5c8d6a68f54 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:35.880762 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746c3f8-92f8-42a6-873e-fbfd836b77d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:35.881883 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746c3f8-92f8-42a6-873e-fbfd836b77d5 None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:35.882373 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746c3f8-92f8-42a6-873e-fbfd836b77d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:35.882880 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746c3f8-92f8-42a6-873e-fbfd836b77d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:35.886991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746c3f8-92f8-42a6-873e-fbfd836b77d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:35.886991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746c3f8-92f8-42a6-873e-fbfd836b77d5 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:35.931134 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 496/1010] 10.222.0.73 () {60 vars in 1144 bytes} [Fri May 13 14:51:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:51:36.734622 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961d691-0811-481f-9ac5-f27e92bae788 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:36.735431 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961d691-0811-481f-9ac5-f27e92bae788 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:36.735431 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961d691-0811-481f-9ac5-f27e92bae788 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:36.736836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 515/1011] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:36.746051 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdc093-8a6d-444d-8865-706b15283466 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:36.746606 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdc093-8a6d-444d-8865-706b15283466 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:36.747010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdc093-8a6d-444d-8865-706b15283466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:36.777208 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-01fdc093-8a6d-444d-8865-706b15283466 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:36.779297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-01fdc093-8a6d-444d-8865-706b15283466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:36.907018 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 497/1012] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:36 2022] POST /identity/v3/auth/tokens => generated 1812 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:36.943505 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961d691-0811-481f-9ac5-f27e92bae788 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:37.108130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961d691-0811-481f-9ac5-f27e92bae788 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:37.163025 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec590b64-e0ed-4bb4-a42f-43d6d8726103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:37.164392 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec590b64-e0ed-4bb4-a42f-43d6d8726103 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:37.164895 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec590b64-e0ed-4bb4-a42f-43d6d8726103 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:37.165392 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec590b64-e0ed-4bb4-a42f-43d6d8726103 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:37.166619 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec590b64-e0ed-4bb4-a42f-43d6d8726103 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:37.169073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec590b64-e0ed-4bb4-a42f-43d6d8726103 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:37.184581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-ec590b64-e0ed-4bb4-a42f-43d6d8726103 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:51:37.184581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:37.184581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:51:37.184581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:51:37.184581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:51:37.184581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:51:37.184581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:51:37.184581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:37.184581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:51:37.184581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:37.184581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:51:37.184581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:37.184581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:37.184581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:37.184581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:37.184581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:37.184581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:37.191814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:37.191814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:37.191814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:37.191814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:37.191814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:37.191814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:37.191814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:51:37.191814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:51:37.191814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:51:37.191814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:51:37.191814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:37.191814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:37.191814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:37.191814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:37.191814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:37.191814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:37.194066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:37.194066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:37.194066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:37.194066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:37.194066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:37.194066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:37.194066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:37.194066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:37.194066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:37.194066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:37.194066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:51:37.194066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:37.194066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 14:51:37.194066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:37.194066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 516/1013] 10.222.0.73 () {56 vars in 1126 bytes} [Fri May 13 14:51:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:37.201274 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdc093-8a6d-444d-8865-706b15283466 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:37.317109 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdc093-8a6d-444d-8865-706b15283466 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:37.357074 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59359fb-d00d-47e2-9976-e7c80771a7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:37.357742 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59359fb-d00d-47e2-9976-e7c80771a7d5 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:37.358031 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59359fb-d00d-47e2-9976-e7c80771a7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:37.358349 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59359fb-d00d-47e2-9976-e7c80771a7d5 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:37.359024 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59359fb-d00d-47e2-9976-e7c80771a7d5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:37.359326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59359fb-d00d-47e2-9976-e7c80771a7d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:37.360775 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59359fb-d00d-47e2-9976-e7c80771a7d5 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:37.367505 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 498/1014] 10.222.0.73 () {56 vars in 1122 bytes} [Fri May 13 14:51:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:37.374185 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec590b64-e0ed-4bb4-a42f-43d6d8726103 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:37.557856 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec590b64-e0ed-4bb4-a42f-43d6d8726103 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:37.624335 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9270a6-582a-458a-9984-0af5ed331f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:37.625119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9270a6-582a-458a-9984-0af5ed331f97 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:37.625591 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9270a6-582a-458a-9984-0af5ed331f97 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:37.626050 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9270a6-582a-458a-9984-0af5ed331f97 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:37.627774 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9270a6-582a-458a-9984-0af5ed331f97 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:37.628235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9270a6-582a-458a-9984-0af5ed331f97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:37.629767 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9270a6-582a-458a-9984-0af5ed331f97 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:37.641136 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 517/1015] 10.222.0.73 () {56 vars in 1122 bytes} [Fri May 13 14:51:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:37.643211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59359fb-d00d-47e2-9976-e7c80771a7d5 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:37.764380 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59359fb-d00d-47e2-9976-e7c80771a7d5 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:37.804451 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675172e6-fd33-4212-a118-fa030e216e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:37.805121 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675172e6-fd33-4212-a118-fa030e216e83 None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:37.805404 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675172e6-fd33-4212-a118-fa030e216e83 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:37.805650 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675172e6-fd33-4212-a118-fa030e216e83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:37.806416 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675172e6-fd33-4212-a118-fa030e216e83 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:37.807857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675172e6-fd33-4212-a118-fa030e216e83 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:37.826633 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 499/1016] 10.222.0.73 () {60 vars in 1144 bytes} [Fri May 13 14:51:37 2022] POST /identity/v3/endpoints => generated 325 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:51:38.457299 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9c813-4bd7-40bf-affe-5ffe65692ddd None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:38.458057 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9c813-4bd7-40bf-affe-5ffe65692ddd None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:38.458402 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9c813-4bd7-40bf-affe-5ffe65692ddd None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:38.460930 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 518/1017] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:38.470375 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a2b0e-5609-4842-995f-23de19158504 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:38.470942 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a2b0e-5609-4842-995f-23de19158504 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:38.471444 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a2b0e-5609-4842-995f-23de19158504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:38.501032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-f51a2b0e-5609-4842-995f-23de19158504 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:38.503692 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-f51a2b0e-5609-4842-995f-23de19158504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:38.643360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 500/1018] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:51:38.682692 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9c813-4bd7-40bf-affe-5ffe65692ddd None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:38.888101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9c813-4bd7-40bf-affe-5ffe65692ddd None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:38.961996 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a680d6e-e39c-4b73-bfa4-83f9654f21f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:38.963646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a680d6e-e39c-4b73-bfa4-83f9654f21f3 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:38.964372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a680d6e-e39c-4b73-bfa4-83f9654f21f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:38.965108 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a680d6e-e39c-4b73-bfa4-83f9654f21f3 None admin] PATH_INFO: `/v3/services/image` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:38.966613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a680d6e-e39c-4b73-bfa4-83f9654f21f3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:38.969531 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a680d6e-e39c-4b73-bfa4-83f9654f21f3 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:38.992269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-6a680d6e-e39c-4b73-bfa4-83f9654f21f3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 13 14:51:38.992269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:38.992269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:51:38.992269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:51:38.992269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:51:38.992269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:51:38.992269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:51:38.992269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:38.992269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 14:51:38.992269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:38.992269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:51:38.992269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:38.992269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:38.992269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:38.992269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:38.992269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:38.992269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:38.993574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:38.993574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:38.993574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:38.993574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:38.993574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:38.993574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:38.993574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:51:38.993574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:51:38.993574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:51:38.993574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:51:38.993574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:38.993574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:38.993574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:38.993574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:38.993574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:38.993574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:38.994667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:38.994667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:38.994667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:38.994667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:38.994667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:38.994667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:38.994667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:38.994667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:38.994667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:38.994667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:38.994667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:51:38.994667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:38.994667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 14:51:38.994667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:38.998898 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 519/1019] 10.222.0.73 () {56 vars in 1105 bytes} [Fri May 13 14:51:38 2022] GET /identity/v3/services/image => generated 86 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:39.008657 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a2b0e-5609-4842-995f-23de19158504 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:39.061940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4081102-ea29-4e8d-afb2-e13b062114ef None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:39.062397 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4081102-ea29-4e8d-afb2-e13b062114ef None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:39.062611 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4081102-ea29-4e8d-afb2-e13b062114ef None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:39.064747 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 520/1020] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:51:39.070462 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7053b8-13b1-4c6f-b35f-b3c7be242477 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:39.070873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7053b8-13b1-4c6f-b35f-b3c7be242477 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:39.071151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7053b8-13b1-4c6f-b35f-b3c7be242477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:39.091096 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-cc7053b8-13b1-4c6f-b35f-b3c7be242477 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:39.093117 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-cc7053b8-13b1-4c6f-b35f-b3c7be242477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:39.188813 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a2b0e-5609-4842-995f-23de19158504 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:39.218897 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 521/1021] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:51:39.244996 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7053b8-13b1-4c6f-b35f-b3c7be242477 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:39.253928 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220babf3-9fb9-40f2-af90-1ffec65ae4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:39.255100 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220babf3-9fb9-40f2-af90-1ffec65ae4e3 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:39.255594 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220babf3-9fb9-40f2-af90-1ffec65ae4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:39.256091 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220babf3-9fb9-40f2-af90-1ffec65ae4e3 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:39.257426 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220babf3-9fb9-40f2-af90-1ffec65ae4e3 None admin] RBAC: Adding query filter params (name=image) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:39.257999 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220babf3-9fb9-40f2-af90-1ffec65ae4e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:39.260609 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220babf3-9fb9-40f2-af90-1ffec65ae4e3 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:39.276347 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 501/1022] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:39.278314 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220babf3-9fb9-40f2-af90-1ffec65ae4e3 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:39.378854 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7053b8-13b1-4c6f-b35f-b3c7be242477 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:39.431073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9b002-44a4-4b85-a2a6-321a4633f698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:39.432735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9b002-44a4-4b85-a2a6-321a4633f698 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:39.432863 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9b002-44a4-4b85-a2a6-321a4633f698 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:39.433301 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9b002-44a4-4b85-a2a6-321a4633f698 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:39.441402 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220babf3-9fb9-40f2-af90-1ffec65ae4e3 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:39.453357 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9b002-44a4-4b85-a2a6-321a4633f698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:51:39.470746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-0cb9b002-44a4-4b85-a2a6-321a4633f698 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:51:39.470746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:39.470746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:39.470746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:39.470746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:39.470746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:39.470746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:39.470746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:39.470746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:39.470746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:39.470746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:39.470746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:39.470746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:51:39.470746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:51:39.470746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:51:39.470746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:51:39.472664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:51:39.472664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:51:39.472664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:51:39.472664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:51:39.472664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:39.472664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:39.472664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:39.472664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:39.472664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:39.472664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:39.472664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:39.472664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:39.472664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:39.472664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:39.472664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:39.472664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:39.473980 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:39.473980 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:39.473980 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:39.473980 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:39.473980 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:51:39.473980 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:51:39.473980 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:51:39.473980 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:51:39.473980 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:51:39.473980 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:51:39.473980 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:51:39.473980 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:39.481509 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 522/1023] 10.222.0.73 () {56 vars in 1120 bytes} [Fri May 13 14:51:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:39.482982 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9b002-44a4-4b85-a2a6-321a4633f698 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:39.484343 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5c696-cc63-4600-8619-8b8bcca2d1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:39.485031 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5c696-cc63-4600-8619-8b8bcca2d1ae None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:39.485326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5c696-cc63-4600-8619-8b8bcca2d1ae None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:39.485607 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5c696-cc63-4600-8619-8b8bcca2d1ae None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:39.486955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5c696-cc63-4600-8619-8b8bcca2d1ae None admin] RBAC: Adding query filter params (type=image) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:39.487233 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5c696-cc63-4600-8619-8b8bcca2d1ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:39.488635 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5c696-cc63-4600-8619-8b8bcca2d1ae None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:39.499359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 502/1024] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:39.500027 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5c696-cc63-4600-8619-8b8bcca2d1ae None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:39.637849 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5c696-cc63-4600-8619-8b8bcca2d1ae None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:39.641746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9b002-44a4-4b85-a2a6-321a4633f698 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:39.687713 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a4fe9-75df-416e-a4cb-9ea8e7ad9967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:39.688721 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a4fe9-75df-416e-a4cb-9ea8e7ad9967 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:39.689034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a4fe9-75df-416e-a4cb-9ea8e7ad9967 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:39.689490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a4fe9-75df-416e-a4cb-9ea8e7ad9967 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:39.691167 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a4fe9-75df-416e-a4cb-9ea8e7ad9967 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:39.691767 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a4fe9-75df-416e-a4cb-9ea8e7ad9967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:39.693463 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54834df7-538a-404a-b94c-64ffb986b7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:39.694374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a4fe9-75df-416e-a4cb-9ea8e7ad9967 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:39.694558 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54834df7-538a-404a-b94c-64ffb986b7a5 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:39.695099 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54834df7-538a-404a-b94c-64ffb986b7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:39.695586 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54834df7-538a-404a-b94c-64ffb986b7a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:39.697064 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54834df7-538a-404a-b94c-64ffb986b7a5 None admin] RBAC: Adding query filter params (interface=public, service_id=3d70a492d77f484081d378bcb83bfa07, region_id=RegionOne) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:39.697415 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54834df7-538a-404a-b94c-64ffb986b7a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:39.699656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54834df7-538a-404a-b94c-64ffb986b7a5 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:39.711991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 503/1025] 10.222.0.73 () {56 vars in 1251 bytes} [Fri May 13 14:51:39 2022] GET /identity/v3/endpoints?service_id=3d70a492d77f484081d378bcb83bfa07&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:39.712182 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 523/1026] 10.222.0.73 () {56 vars in 1115 bytes} [Fri May 13 14:51:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:39.713517 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54834df7-538a-404a-b94c-64ffb986b7a5 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:39.717686 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a4fe9-75df-416e-a4cb-9ea8e7ad9967 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:39.837010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a4fe9-75df-416e-a4cb-9ea8e7ad9967 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:39.860529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54834df7-538a-404a-b94c-64ffb986b7a5 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:39.887742 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6b024-1048-428b-af3b-f8b4f7b47da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:39.888566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6b024-1048-428b-af3b-f8b4f7b47da2 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:39.888863 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6b024-1048-428b-af3b-f8b4f7b47da2 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:39.889107 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6b024-1048-428b-af3b-f8b4f7b47da2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:39.902490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6b024-1048-428b-af3b-f8b4f7b47da2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:39.904488 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6b024-1048-428b-af3b-f8b4f7b47da2 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:39.907850 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c32ee2-8450-4143-a618-55f4aadbd9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:39.908517 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c32ee2-8450-4143-a618-55f4aadbd9f5 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:39.908798 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c32ee2-8450-4143-a618-55f4aadbd9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:39.909069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c32ee2-8450-4143-a618-55f4aadbd9f5 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:39.909745 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c32ee2-8450-4143-a618-55f4aadbd9f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:39.911154 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c32ee2-8450-4143-a618-55f4aadbd9f5 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:39.920651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 504/1027] 10.222.0.73 () {56 vars in 1087 bytes} [Fri May 13 14:51:39 2022] GET /identity/v3/services => generated 1957 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 14:51:39.932423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-09f6b024-1048-428b-af3b-f8b4f7b47da2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:39.932423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:39.932423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:39.932423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:39.932423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:39.932423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:39.932423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:39.932423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:39.932423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:39.932423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:39.932423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:39.932423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:39.932423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:51:39.932423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:51:39.932423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:51:39.933522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:51:39.933522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:39.933522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:39.933522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:39.933522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:39.933522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:39.933522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:39.933522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:39.933522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:39.933522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:39.933522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:39.933522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:39.933522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:39.933522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:39.933522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:39.933522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:39.933522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:39.934735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:51:39.934735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:51:39.934735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:39.934735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:39.934735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 524/1028] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:39.940656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c32ee2-8450-4143-a618-55f4aadbd9f5 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:40.082266 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c32ee2-8450-4143-a618-55f4aadbd9f5 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:40.148040 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15ae47-bf67-4f77-b4f1-3a4c1911e823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:40.149455 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15ae47-bf67-4f77-b4f1-3a4c1911e823 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:40.149978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15ae47-bf67-4f77-b4f1-3a4c1911e823 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:40.150658 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15ae47-bf67-4f77-b4f1-3a4c1911e823 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:40.152115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15ae47-bf67-4f77-b4f1-3a4c1911e823 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:40.152662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15ae47-bf67-4f77-b4f1-3a4c1911e823 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:40.155807 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15ae47-bf67-4f77-b4f1-3a4c1911e823 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:40.168746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec0f79-9b24-4df5-89e8-770cadd74e26 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:40.169009 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec0f79-9b24-4df5-89e8-770cadd74e26 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:40.169284 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec0f79-9b24-4df5-89e8-770cadd74e26 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:40.171606 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 525/1029] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:51:40.177801 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4e439-58c3-4d97-8179-7df17ddac7ef None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:40.178623 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 505/1030] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:40.179006 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4e439-58c3-4d97-8179-7df17ddac7ef None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:40.181878 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4e439-58c3-4d97-8179-7df17ddac7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:40.184610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15ae47-bf67-4f77-b4f1-3a4c1911e823 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:40.204314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-baf4e439-58c3-4d97-8179-7df17ddac7ef None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:40.205616 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-baf4e439-58c3-4d97-8179-7df17ddac7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:40.308402 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 526/1031] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:40.332662 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4e439-58c3-4d97-8179-7df17ddac7ef None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:40.353663 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15ae47-bf67-4f77-b4f1-3a4c1911e823 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:40.405689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3db298-932d-445b-a3df-2aadd1ab3f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:40.408017 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3db298-932d-445b-a3df-2aadd1ab3f0b None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:40.408548 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3db298-932d-445b-a3df-2aadd1ab3f0b None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:40.408867 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3db298-932d-445b-a3df-2aadd1ab3f0b None admin] PATH_INFO: `/v3/users/nova` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:40.419471 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3db298-932d-445b-a3df-2aadd1ab3f0b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:40.421102 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3db298-932d-445b-a3df-2aadd1ab3f0b None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:40.436194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-be3db298-932d-445b-a3df-2aadd1ab3f0b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 14:51:40.436194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:40.436194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:40.436194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:40.436194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:40.436194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:40.436194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:40.436194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:40.436194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:40.436194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:40.436194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:40.436194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:40.436194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:51:40.436194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:51:40.436194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:51:40.436194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:51:40.437225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:40.437225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:40.437225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:51:40.437225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:51:40.437225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:51:40.437225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:51:40.437225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:40.437225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:40.437225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:40.437225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:40.437225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:40.437225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:40.437225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:40.437225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:40.437225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:40.437225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:40.437225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:40.437225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:40.438176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:40.438176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:40.438176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:51:40.438176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:51:40.438176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:51:40.438176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:51:40.438176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:51:40.438176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:51:40.438176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 14:51:40.438176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:40.438176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 506/1032] 10.222.0.73 () {56 vars in 1093 bytes} [Fri May 13 14:51:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:40.444768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3db298-932d-445b-a3df-2aadd1ab3f0b None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:40.461763 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4e439-58c3-4d97-8179-7df17ddac7ef None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:40.521031 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d428966-9231-4d6d-9a05-5ab344d9cf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:40.522428 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d428966-9231-4d6d-9a05-5ab344d9cf99 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:40.522971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d428966-9231-4d6d-9a05-5ab344d9cf99 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:40.523481 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d428966-9231-4d6d-9a05-5ab344d9cf99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:40.525585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d428966-9231-4d6d-9a05-5ab344d9cf99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:40.528385 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d428966-9231-4d6d-9a05-5ab344d9cf99 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:40.536802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 527/1033] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:40.538589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d428966-9231-4d6d-9a05-5ab344d9cf99 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:40.590541 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3db298-932d-445b-a3df-2aadd1ab3f0b None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:40.646508 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f3c81-549a-4d89-9172-59e3c004dfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:40.647343 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f3c81-549a-4d89-9172-59e3c004dfbd None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:40.647625 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f3c81-549a-4d89-9172-59e3c004dfbd None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:40.647896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f3c81-549a-4d89-9172-59e3c004dfbd None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:40.648736 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f3c81-549a-4d89-9172-59e3c004dfbd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:40.649036 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f3c81-549a-4d89-9172-59e3c004dfbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:40.650476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f3c81-549a-4d89-9172-59e3c004dfbd None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:40.670430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 507/1034] 10.222.0.73 () {56 vars in 1133 bytes} [Fri May 13 14:51:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:40.676926 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f3c81-549a-4d89-9172-59e3c004dfbd None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:40.693750 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d428966-9231-4d6d-9a05-5ab344d9cf99 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:40.737254 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6e013-8339-472b-8d32-3c21d2fed075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:40.737920 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6e013-8339-472b-8d32-3c21d2fed075 None admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:40.738196 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6e013-8339-472b-8d32-3c21d2fed075 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:40.738469 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6e013-8339-472b-8d32-3c21d2fed075 None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:40.739205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6e013-8339-472b-8d32-3c21d2fed075 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:40.740624 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6e013-8339-472b-8d32-3c21d2fed075 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:40.778860 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 528/1035] 10.222.0.73 () {60 vars in 1141 bytes} [Fri May 13 14:51:40 2022] POST /identity/v3/projects => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:51:40.832586 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f3c81-549a-4d89-9172-59e3c004dfbd None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:40.877893 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18239f99-2190-48b3-ae74-19c566735a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:40.878536 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18239f99-2190-48b3-ae74-19c566735a46 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:40.879001 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18239f99-2190-48b3-ae74-19c566735a46 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:40.879466 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18239f99-2190-48b3-ae74-19c566735a46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:40.989101 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18239f99-2190-48b3-ae74-19c566735a46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:40.990579 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18239f99-2190-48b3-ae74-19c566735a46 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:41.170969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 508/1036] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:51:40 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 13 14:51:41.176913 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6e013-8339-472b-8d32-3c21d2fed075 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:41.355991 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6e013-8339-472b-8d32-3c21d2fed075 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:41.405333 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12a172-8ecc-4fd1-9834-306552a8a4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:41.406158 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12a172-8ecc-4fd1-9834-306552a8a4b3 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:41.406429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12a172-8ecc-4fd1-9834-306552a8a4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:41.406716 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12a172-8ecc-4fd1-9834-306552a8a4b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:41.420116 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12a172-8ecc-4fd1-9834-306552a8a4b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:41.421722 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12a172-8ecc-4fd1-9834-306552a8a4b3 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:41.442339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-2c12a172-8ecc-4fd1-9834-306552a8a4b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:41.442339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:41.442339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:41.442339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:41.442339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:41.442339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:41.442339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:41.442339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:41.442339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:41.442339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:41.442339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:41.442339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:41.442339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:51:41.442339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:51:41.442339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:51:41.449746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:51:41.449746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:41.449746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:41.449746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:41.449746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:41.449746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:41.449746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:41.449746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:41.449746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:41.449746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:41.449746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:41.449746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:41.449746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:41.449746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:41.449746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:41.449746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:41.449746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:41.451480 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:51:41.451480 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:51:41.451480 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:41.451480 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:41.451480 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 529/1037] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:41.454934 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18239f99-2190-48b3-ae74-19c566735a46 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:41.574128 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18239f99-2190-48b3-ae74-19c566735a46 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:41.614603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893946a8-4032-4cb0-926f-ef8a2de890e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:41.615368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893946a8-4032-4cb0-926f-ef8a2de890e7 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:41.615646 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893946a8-4032-4cb0-926f-ef8a2de890e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:41.615907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893946a8-4032-4cb0-926f-ef8a2de890e7 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:41.616626 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893946a8-4032-4cb0-926f-ef8a2de890e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:41.617163 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893946a8-4032-4cb0-926f-ef8a2de890e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:41.618294 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893946a8-4032-4cb0-926f-ef8a2de890e7 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:41.634262 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 509/1038] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:41.640755 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12a172-8ecc-4fd1-9834-306552a8a4b3 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:41.828151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12a172-8ecc-4fd1-9834-306552a8a4b3 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:41.902237 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fff5a-b0d9-465a-a705-1ada545eeb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:41.903607 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fff5a-b0d9-465a-a705-1ada545eeb40 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:41.904072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fff5a-b0d9-465a-a705-1ada545eeb40 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:41.904515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fff5a-b0d9-465a-a705-1ada545eeb40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:41.918876 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fff5a-b0d9-465a-a705-1ada545eeb40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:41.921639 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fff5a-b0d9-465a-a705-1ada545eeb40 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:41.951811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-d90fff5a-b0d9-465a-a705-1ada545eeb40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:41.951811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:41.951811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:41.951811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:41.951811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:41.951811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:41.951811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:41.951811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:41.951811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:41.951811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:41.951811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:41.951811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:41.951811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:51:41.951811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:51:41.951811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:51:41.953648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:51:41.953648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:41.953648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:41.953648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:41.953648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:41.953648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:41.953648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:41.953648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:41.953648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:41.953648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:41.953648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:41.953648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:41.953648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:41.953648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:41.953648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:41.953648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:41.953648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:41.955724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:51:41.955724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:51:41.955724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:51:41.955724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:51:41.955724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:51:41.955724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:51:41.955724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:41.955724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:41.959448 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 530/1039] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:51:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:41.964362 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893946a8-4032-4cb0-926f-ef8a2de890e7 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:42.138429 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893946a8-4032-4cb0-926f-ef8a2de890e7 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:42.206757 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d889e-db0d-42fc-b5ab-c0b84a899659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:42.207906 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d889e-db0d-42fc-b5ab-c0b84a899659 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:42.208387 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d889e-db0d-42fc-b5ab-c0b84a899659 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:42.208871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d889e-db0d-42fc-b5ab-c0b84a899659 None admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:42.210368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d889e-db0d-42fc-b5ab-c0b84a899659 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:42.210953 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d889e-db0d-42fc-b5ab-c0b84a899659 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:42.213727 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d889e-db0d-42fc-b5ab-c0b84a899659 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:42.242045 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 510/1040] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:51:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:42.244386 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fff5a-b0d9-465a-a705-1ada545eeb40 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:42.422610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fff5a-b0d9-465a-a705-1ada545eeb40 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:42.483822 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f15c4d-b98c-4fe5-9b19-79eb4938d2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:42.484496 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f15c4d-b98c-4fe5-9b19-79eb4938d2f9 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:42.484763 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f15c4d-b98c-4fe5-9b19-79eb4938d2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:42.485041 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f15c4d-b98c-4fe5-9b19-79eb4938d2f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:42.485919 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f15c4d-b98c-4fe5-9b19-79eb4938d2f9 None admin] RBAC: Adding query filter params (role.id=a77c06fbc15841b2943535dab76a36b5, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=52d539202cfb40a48b231713e16a599a) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:42.486225 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f15c4d-b98c-4fe5-9b19-79eb4938d2f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:42.487706 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f15c4d-b98c-4fe5-9b19-79eb4938d2f9 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:42.502864 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 531/1041] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:51:42 2022] GET /identity/v3/role_assignments?user.id=52d539202cfb40a48b231713e16a599a&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=a77c06fbc15841b2943535dab76a36b5 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:42.746372 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f875fd-0fca-451c-89ab-d0ee7826c2fc None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:42.746566 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f875fd-0fca-451c-89ab-d0ee7826c2fc None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:42.747226 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f875fd-0fca-451c-89ab-d0ee7826c2fc None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:42.748300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 511/1042] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:42.755112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bf44d-7aca-4728-912b-7de2a8af3a82 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:42.755825 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bf44d-7aca-4728-912b-7de2a8af3a82 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:42.755825 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bf44d-7aca-4728-912b-7de2a8af3a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:42.773947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-bb7bf44d-7aca-4728-912b-7de2a8af3a82 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:42.775173 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-bb7bf44d-7aca-4728-912b-7de2a8af3a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:42.853005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 532/1043] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:42.877708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f875fd-0fca-451c-89ab-d0ee7826c2fc None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:43.067973 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f875fd-0fca-451c-89ab-d0ee7826c2fc None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:43.129496 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b80753-feea-4e1c-8342-0a3e5bd7643e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:43.130806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b80753-feea-4e1c-8342-0a3e5bd7643e None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:43.131338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b80753-feea-4e1c-8342-0a3e5bd7643e None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:43.131827 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b80753-feea-4e1c-8342-0a3e5bd7643e None admin] PATH_INFO: `/v3/services/image` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:43.133056 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b80753-feea-4e1c-8342-0a3e5bd7643e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:43.135848 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b80753-feea-4e1c-8342-0a3e5bd7643e None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:43.158967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-09b80753-feea-4e1c-8342-0a3e5bd7643e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 13 14:51:43.158967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:43.158967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:51:43.158967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:51:43.158967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:51:43.158967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:51:43.158967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:51:43.158967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:43.158967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 14:51:43.158967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:43.158967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:51:43.158967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:43.158967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:43.158967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:43.158967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:43.158967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:43.158967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:43.160951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:43.160951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:43.160951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:43.160951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:43.160951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:43.160951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:43.160951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:51:43.160951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:51:43.160951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:51:43.160951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:51:43.160951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:43.160951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:43.160951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:43.160951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:43.160951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:43.160951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:43.169002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:43.169002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:43.169002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:43.169002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:43.169002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:43.169002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:43.169002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:43.169002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:43.169002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:43.169002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:43.169002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:51:43.169002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:51:43.169002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 14:51:43.169002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:43.169002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 512/1044] 10.222.0.73 () {56 vars in 1105 bytes} [Fri May 13 14:51:42 2022] GET /identity/v3/services/image => generated 86 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:43.177192 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bf44d-7aca-4728-912b-7de2a8af3a82 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:43.368866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bf44d-7aca-4728-912b-7de2a8af3a82 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:43.436008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be011e-706f-41a4-8487-fde0f8f09bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:43.437231 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be011e-706f-41a4-8487-fde0f8f09bbb None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:43.437711 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be011e-706f-41a4-8487-fde0f8f09bbb None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:43.438177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be011e-706f-41a4-8487-fde0f8f09bbb None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:43.440375 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be011e-706f-41a4-8487-fde0f8f09bbb None admin] RBAC: Adding query filter params (name=image) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:43.440899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be011e-706f-41a4-8487-fde0f8f09bbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:43.443547 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be011e-706f-41a4-8487-fde0f8f09bbb None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:43.453288 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 533/1045] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:43.463418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b80753-feea-4e1c-8342-0a3e5bd7643e None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:43.612166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226a4b0-a02a-4ce2-a56a-4259a99321e5 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:43.612653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226a4b0-a02a-4ce2-a56a-4259a99321e5 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:43.613134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226a4b0-a02a-4ce2-a56a-4259a99321e5 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:43.615670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 534/1046] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:43.623373 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e278016-a9d9-4063-9138-191695b6e38f None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:43.623763 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e278016-a9d9-4063-9138-191695b6e38f None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:43.624138 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e278016-a9d9-4063-9138-191695b6e38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:43.648327 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-6e278016-a9d9-4063-9138-191695b6e38f None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:43.650372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-6e278016-a9d9-4063-9138-191695b6e38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:43.659523 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b80753-feea-4e1c-8342-0a3e5bd7643e None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:43.720003 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac258a2-80e5-4315-8b83-fcb820d96916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:43.721334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac258a2-80e5-4315-8b83-fcb820d96916 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:43.721655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac258a2-80e5-4315-8b83-fcb820d96916 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:43.722123 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac258a2-80e5-4315-8b83-fcb820d96916 None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:43.723443 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac258a2-80e5-4315-8b83-fcb820d96916 None admin] RBAC: Adding query filter params (type=image) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:43.724464 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac258a2-80e5-4315-8b83-fcb820d96916 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:43.726720 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac258a2-80e5-4315-8b83-fcb820d96916 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:43.739214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 513/1047] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:43.745907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac258a2-80e5-4315-8b83-fcb820d96916 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:43.775258 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 535/1048] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:51:43.808085 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e278016-a9d9-4063-9138-191695b6e38f None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:43.878695 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac258a2-80e5-4315-8b83-fcb820d96916 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:43.928402 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86008c19-fb60-4c9a-bd78-fb50c0aa7171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:43.929538 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86008c19-fb60-4c9a-bd78-fb50c0aa7171 None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:43.930046 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86008c19-fb60-4c9a-bd78-fb50c0aa7171 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:43.930552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86008c19-fb60-4c9a-bd78-fb50c0aa7171 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:43.932085 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86008c19-fb60-4c9a-bd78-fb50c0aa7171 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:43.933919 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e278016-a9d9-4063-9138-191695b6e38f None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:43.934644 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86008c19-fb60-4c9a-bd78-fb50c0aa7171 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:43.960927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 514/1049] 10.222.0.73 () {60 vars in 1144 bytes} [Fri May 13 14:51:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:51:43.982612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f819df-3606-4711-840b-89b91d0423f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:43.983731 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f819df-3606-4711-840b-89b91d0423f8 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:43.984190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f819df-3606-4711-840b-89b91d0423f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:43.984629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f819df-3606-4711-840b-89b91d0423f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:43.986132 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f819df-3606-4711-840b-89b91d0423f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:43.987981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f819df-3606-4711-840b-89b91d0423f8 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:43.994582 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 536/1050] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:43.996369 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86008c19-fb60-4c9a-bd78-fb50c0aa7171 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:44.112362 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86008c19-fb60-4c9a-bd78-fb50c0aa7171 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:44.150348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6768f-b844-44a7-9ce5-19597cca01db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:44.150981 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6768f-b844-44a7-9ce5-19597cca01db None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:44.151268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6768f-b844-44a7-9ce5-19597cca01db None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:44.151542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6768f-b844-44a7-9ce5-19597cca01db None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:44.152278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6768f-b844-44a7-9ce5-19597cca01db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:44.153791 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6768f-b844-44a7-9ce5-19597cca01db None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:44.184574 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 515/1051] 10.222.0.73 () {60 vars in 1132 bytes} [Fri May 13 14:51:43 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:51:45.187417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082fc18-1fac-4bb9-9443-1b7d26278d9a None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:45.188159 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082fc18-1fac-4bb9-9443-1b7d26278d9a None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:45.188159 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082fc18-1fac-4bb9-9443-1b7d26278d9a None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:45.190412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 537/1052] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:45.196025 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf75b67-b9fc-4f0e-89b4-9877987517e0 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:45.196757 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf75b67-b9fc-4f0e-89b4-9877987517e0 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:45.196757 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf75b67-b9fc-4f0e-89b4-9877987517e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:45.214216 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-bbf75b67-b9fc-4f0e-89b4-9877987517e0 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:45.215459 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-bbf75b67-b9fc-4f0e-89b4-9877987517e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:45.337374 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 516/1053] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:45.380282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082fc18-1fac-4bb9-9443-1b7d26278d9a None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:45.564503 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082fc18-1fac-4bb9-9443-1b7d26278d9a None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:45.624890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134ec19-95dc-4cc6-b4cd-240fc3b95a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:45.625730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134ec19-95dc-4cc6-b4cd-240fc3b95a9a None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:45.626048 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134ec19-95dc-4cc6-b4cd-240fc3b95a9a None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:45.626327 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134ec19-95dc-4cc6-b4cd-240fc3b95a9a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:45.638928 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134ec19-95dc-4cc6-b4cd-240fc3b95a9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:51:45.647409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-5134ec19-95dc-4cc6-b4cd-240fc3b95a9a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:51:45.647409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:45.647409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:45.647409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:45.647409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:45.647409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:45.647409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:45.647409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:45.647409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:45.647409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:45.647409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:45.647409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:45.647409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:51:45.647409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:51:45.647409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:51:45.647409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:51:45.649076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:51:45.649076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:51:45.649076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:51:45.649076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:51:45.649076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:45.649076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:45.649076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:45.649076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:45.649076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:45.649076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:45.649076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:45.649076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:45.649076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:45.649076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:45.649076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:45.649076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:45.650204 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:45.650204 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:45.650204 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:45.650204 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:45.650204 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:51:45.650204 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:51:45.650204 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:51:45.650204 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:51:45.650204 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:51:45.650204 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:51:45.650204 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:51:45.650204 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:45.650204 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 538/1054] 10.222.0.73 () {56 vars in 1120 bytes} [Fri May 13 14:51:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:45.662630 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf75b67-b9fc-4f0e-89b4-9877987517e0 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:45.775651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf75b67-b9fc-4f0e-89b4-9877987517e0 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:45.812166 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9098be7-b8b2-44ff-a100-1a11ab09bac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:45.812843 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9098be7-b8b2-44ff-a100-1a11ab09bac2 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:45.813122 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9098be7-b8b2-44ff-a100-1a11ab09bac2 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:45.813396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9098be7-b8b2-44ff-a100-1a11ab09bac2 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:45.814197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9098be7-b8b2-44ff-a100-1a11ab09bac2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:45.814487 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9098be7-b8b2-44ff-a100-1a11ab09bac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:45.816268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9098be7-b8b2-44ff-a100-1a11ab09bac2 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:45.826332 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 517/1055] 10.222.0.73 () {56 vars in 1115 bytes} [Fri May 13 14:51:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:45.833003 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134ec19-95dc-4cc6-b4cd-240fc3b95a9a None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:45.944858 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134ec19-95dc-4cc6-b4cd-240fc3b95a9a None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:45.981882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca5a04-52e3-4e27-9708-0a995540e7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:45.982696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca5a04-52e3-4e27-9708-0a995540e7da None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:45.983003 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca5a04-52e3-4e27-9708-0a995540e7da None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:45.983274 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca5a04-52e3-4e27-9708-0a995540e7da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:45.995154 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca5a04-52e3-4e27-9708-0a995540e7da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:45.996626 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca5a04-52e3-4e27-9708-0a995540e7da None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:46.015060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-52ca5a04-52e3-4e27-9708-0a995540e7da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:46.015060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:46.015060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:46.015060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:46.015060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:46.015060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:46.015060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:46.015060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:46.015060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:46.015060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:46.015060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:46.015060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:46.015060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:51:46.015060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:51:46.015060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:51:46.016455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:51:46.016455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:46.016455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:46.016455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:46.016455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:46.016455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:46.016455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:46.016455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:46.016455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:46.016455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:46.016455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:46.016455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:46.016455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:46.016455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:46.016455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:46.016455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:46.016455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:46.018487 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:51:46.018487 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:51:46.018487 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:46.018487 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:46.019757 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 539/1056] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:46.022717 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9098be7-b8b2-44ff-a100-1a11ab09bac2 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:46.130348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9098be7-b8b2-44ff-a100-1a11ab09bac2 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:46.178790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28364db-a7a6-4172-9686-d08fdd2726c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:46.180032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28364db-a7a6-4172-9686-d08fdd2726c3 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:46.180547 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28364db-a7a6-4172-9686-d08fdd2726c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:46.181051 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28364db-a7a6-4172-9686-d08fdd2726c3 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:46.182497 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28364db-a7a6-4172-9686-d08fdd2726c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:46.183090 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28364db-a7a6-4172-9686-d08fdd2726c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:46.185815 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28364db-a7a6-4172-9686-d08fdd2726c3 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:46.210986 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 518/1057] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:46.220795 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca5a04-52e3-4e27-9708-0a995540e7da None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:46.411180 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca5a04-52e3-4e27-9708-0a995540e7da None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:46.474677 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984f69e-d6a5-4eb9-9429-7db473739b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:46.475808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984f69e-d6a5-4eb9-9429-7db473739b15 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:46.476247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984f69e-d6a5-4eb9-9429-7db473739b15 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:46.476536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984f69e-d6a5-4eb9-9429-7db473739b15 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:46.487196 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984f69e-d6a5-4eb9-9429-7db473739b15 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:46.488915 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984f69e-d6a5-4eb9-9429-7db473739b15 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:46.508053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-7984f69e-d6a5-4eb9-9429-7db473739b15 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 14:51:46.508053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:46.508053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:46.508053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:46.508053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:46.508053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:46.508053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:46.508053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:46.508053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:46.508053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:46.508053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:46.508053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:46.508053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:51:46.508053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:51:46.508053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:51:46.508053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:51:46.515924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:46.515924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:46.515924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:51:46.515924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:51:46.515924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:51:46.515924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:51:46.515924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:46.515924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:46.515924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:46.515924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:46.515924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:46.515924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:46.515924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:46.515924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:46.515924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:46.515924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:46.515924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:46.515924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:46.518730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:46.518730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:46.518730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:51:46.518730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:51:46.518730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:51:46.518730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:51:46.518730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:51:46.518730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:51:46.518730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 14:51:46.518730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:46.518730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 540/1058] 10.222.0.73 () {56 vars in 1093 bytes} [Fri May 13 14:51:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:46.524147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28364db-a7a6-4172-9686-d08fdd2726c3 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:46.706921 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28364db-a7a6-4172-9686-d08fdd2726c3 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:46.768835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e191b-eae1-4fcd-b839-635f54964f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:46.770013 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e191b-eae1-4fcd-b839-635f54964f02 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:46.770513 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e191b-eae1-4fcd-b839-635f54964f02 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:46.771043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e191b-eae1-4fcd-b839-635f54964f02 None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:46.772845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e191b-eae1-4fcd-b839-635f54964f02 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:46.773392 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e191b-eae1-4fcd-b839-635f54964f02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:46.776367 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e191b-eae1-4fcd-b839-635f54964f02 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:46.823371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 519/1059] 10.222.0.73 () {56 vars in 1133 bytes} [Fri May 13 14:51:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:46.826274 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984f69e-d6a5-4eb9-9429-7db473739b15 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:46.836507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5eb9e4-3769-4b4d-9d04-82b622cd83c7 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:46.836768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5eb9e4-3769-4b4d-9d04-82b622cd83c7 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:46.837099 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5eb9e4-3769-4b4d-9d04-82b622cd83c7 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:46.838692 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 520/1060] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:46.844227 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdbc2b-abdc-4e4f-8be1-eef8e76cec1f None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:46.844646 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdbc2b-abdc-4e4f-8be1-eef8e76cec1f None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:46.844804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdbc2b-abdc-4e4f-8be1-eef8e76cec1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:46.863513 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-45cdbc2b-abdc-4e4f-8be1-eef8e76cec1f None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:46.864710 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-45cdbc2b-abdc-4e4f-8be1-eef8e76cec1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:46.959634 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 521/1061] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:51:46.982267 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48812c51-3768-45fd-81a9-2aaedbc256ff None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:46.982558 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48812c51-3768-45fd-81a9-2aaedbc256ff None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:46.982805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48812c51-3768-45fd-81a9-2aaedbc256ff None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:46.984362 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 522/1062] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:51:46.985196 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48812c51-3768-45fd-81a9-2aaedbc256ff None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:47.015888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984f69e-d6a5-4eb9-9429-7db473739b15 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:47.058926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020cb6e-4d0f-46e2-b353-775e0ddb0005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:47.059731 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020cb6e-4d0f-46e2-b353-775e0ddb0005 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:47.060009 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020cb6e-4d0f-46e2-b353-775e0ddb0005 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:47.060283 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020cb6e-4d0f-46e2-b353-775e0ddb0005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:47.071809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020cb6e-4d0f-46e2-b353-775e0ddb0005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:47.073280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020cb6e-4d0f-46e2-b353-775e0ddb0005 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:47.091077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-1020cb6e-4d0f-46e2-b353-775e0ddb0005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:47.091077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:47.091077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:47.091077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:47.091077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:47.091077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:47.091077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:47.091077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:47.091077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:47.091077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:47.091077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:47.091077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:47.091077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:51:47.091077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:51:47.091077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:51:47.092206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:51:47.092206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:47.092206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:47.092206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:47.092206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:47.092206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:47.092206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:47.092206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:47.092206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:47.092206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:47.092206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:47.092206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:47.092206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:47.092206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:47.092206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:47.092206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:47.092206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:47.093750 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:51:47.093750 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:51:47.093750 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:47.093750 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:47.093750 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 541/1063] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:47.093750 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17991b2d-46e6-4854-a9e5-8652cdc095fe None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:47.094408 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17991b2d-46e6-4854-a9e5-8652cdc095fe None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:47.094408 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17991b2d-46e6-4854-a9e5-8652cdc095fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:47.113472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-17991b2d-46e6-4854-a9e5-8652cdc095fe None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:47.114687 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-17991b2d-46e6-4854-a9e5-8652cdc095fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:47.133651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48812c51-3768-45fd-81a9-2aaedbc256ff None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:47.172849 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ec6ff-c94b-405d-8a9c-8ec9ebd772fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:47.174090 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ec6ff-c94b-405d-8a9c-8ec9ebd772fc None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:47.174425 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ec6ff-c94b-405d-8a9c-8ec9ebd772fc None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:47.174773 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ec6ff-c94b-405d-8a9c-8ec9ebd772fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:47.191499 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 542/1064] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:47.192477 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17991b2d-46e6-4854-a9e5-8652cdc095fe None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:47.263560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ec6ff-c94b-405d-8a9c-8ec9ebd772fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:47.265365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ec6ff-c94b-405d-8a9c-8ec9ebd772fc None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:47.319995 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17991b2d-46e6-4854-a9e5-8652cdc095fe None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:47.362279 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed1ad6-c7aa-4789-8a75-2f8afa70eecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:47.363075 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed1ad6-c7aa-4789-8a75-2f8afa70eecd None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:47.363358 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed1ad6-c7aa-4789-8a75-2f8afa70eecd None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:47.363630 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed1ad6-c7aa-4789-8a75-2f8afa70eecd None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:47.364360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed1ad6-c7aa-4789-8a75-2f8afa70eecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:47.364827 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed1ad6-c7aa-4789-8a75-2f8afa70eecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:47.367250 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed1ad6-c7aa-4789-8a75-2f8afa70eecd None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:47.381436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 543/1065] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:47.387303 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed1ad6-c7aa-4789-8a75-2f8afa70eecd None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:47.387538 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 523/1066] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:51:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:51:47.388656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ec6ff-c94b-405d-8a9c-8ec9ebd772fc None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:47.514319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed1ad6-c7aa-4789-8a75-2f8afa70eecd None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:47.523182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ec6ff-c94b-405d-8a9c-8ec9ebd772fc None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:47.556072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3f4a9-8ffa-41db-a67f-36b9dcb6ad3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:47.557101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3f4a9-8ffa-41db-a67f-36b9dcb6ad3c None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:47.557567 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3f4a9-8ffa-41db-a67f-36b9dcb6ad3c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:47.557879 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3f4a9-8ffa-41db-a67f-36b9dcb6ad3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:47.562556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de6321-d8ea-4db0-91b8-9b8261a2f9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:47.563519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de6321-d8ea-4db0-91b8-9b8261a2f9c8 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:47.563857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de6321-d8ea-4db0-91b8-9b8261a2f9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:47.564186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de6321-d8ea-4db0-91b8-9b8261a2f9c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:47.571633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3f4a9-8ffa-41db-a67f-36b9dcb6ad3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:51:47.576330 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de6321-d8ea-4db0-91b8-9b8261a2f9c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:47.577797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de6321-d8ea-4db0-91b8-9b8261a2f9c8 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:47.580018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-a2f3f4a9-8ffa-41db-a67f-36b9dcb6ad3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:51:47.580018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:47.580018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:47.580018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:47.580018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:47.580018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:47.580018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:47.580018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:47.580018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:47.580018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:47.580018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:47.580018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:47.580018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:51:47.580018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:51:47.580018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:51:47.580018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:51:47.581653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:51:47.581653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:51:47.581653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:51:47.581653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:51:47.581653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:47.581653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:47.581653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:47.581653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:47.581653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:47.581653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:47.581653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:47.581653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:47.581653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:47.581653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:47.581653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:47.581653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:47.584089 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:47.584089 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:47.584089 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:47.584089 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:47.584089 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:51:47.584089 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:51:47.584089 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:51:47.584089 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:51:47.584089 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:51:47.584089 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:51:47.584089 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:51:47.584089 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:47.584089 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 544/1067] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:51:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:47.584089 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3f4a9-8ffa-41db-a67f-36b9dcb6ad3c None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:47.612612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-60de6321-d8ea-4db0-91b8-9b8261a2f9c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:47.612612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:47.612612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:47.612612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:47.612612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:47.612612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:47.612612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:47.612612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:47.612612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:47.612612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:47.612612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:47.612612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:47.612612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:51:47.612612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:51:47.612612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:51:47.613608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:51:47.613608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:47.613608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:47.613608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:47.613608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:47.613608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:47.613608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:47.613608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:47.613608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:47.613608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:47.613608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:47.613608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:47.613608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:47.613608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:47.613608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:47.613608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:47.613608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:47.614492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:51:47.614492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:51:47.614492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:47.614492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:47.615173 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 524/1068] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:47.616352 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de6321-d8ea-4db0-91b8-9b8261a2f9c8 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:47.745217 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3f4a9-8ffa-41db-a67f-36b9dcb6ad3c None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:47.798543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de6321-d8ea-4db0-91b8-9b8261a2f9c8 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:47.806311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340245ff-626b-43f3-8e74-7b7f3947ca00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:47.807968 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340245ff-626b-43f3-8e74-7b7f3947ca00 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:47.808683 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340245ff-626b-43f3-8e74-7b7f3947ca00 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:47.809194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340245ff-626b-43f3-8e74-7b7f3947ca00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:47.823119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340245ff-626b-43f3-8e74-7b7f3947ca00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:47.825923 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340245ff-626b-43f3-8e74-7b7f3947ca00 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:47.848968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e780ba-863f-4184-9b24-61dae293273b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:47.849638 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e780ba-863f-4184-9b24-61dae293273b None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:47.849920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e780ba-863f-4184-9b24-61dae293273b None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:47.850194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e780ba-863f-4184-9b24-61dae293273b None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:47.850988 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e780ba-863f-4184-9b24-61dae293273b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:47.851293 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e780ba-863f-4184-9b24-61dae293273b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:47.852424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-340245ff-626b-43f3-8e74-7b7f3947ca00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:47.852424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:47.852424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:47.852424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:47.852424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:47.852424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:47.852424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:47.852424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:47.852424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:47.852424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:47.852424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:47.852424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:47.852424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:51:47.852424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:51:47.852424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:51:47.853443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:51:47.853443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:47.853443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:47.853443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:47.853443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:47.853443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:47.853443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:47.853443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:47.853443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:47.853443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:47.853443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:47.853443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:47.853443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:47.853443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:47.853443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:47.853443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:47.853443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:47.854672 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:51:47.854672 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:51:47.854672 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:51:47.854672 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:51:47.854672 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:51:47.854672 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:51:47.854672 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:47.854672 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:47.855223 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e780ba-863f-4184-9b24-61dae293273b None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:47.855318 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 545/1069] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:51:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:47.855596 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340245ff-626b-43f3-8e74-7b7f3947ca00 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:47.863808 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 525/1070] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:51:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:47.864675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e780ba-863f-4184-9b24-61dae293273b None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:47.972817 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340245ff-626b-43f3-8e74-7b7f3947ca00 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:47.985102 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e780ba-863f-4184-9b24-61dae293273b None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:48.012455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5d2d4-9995-4162-a189-1cd61a11fc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:48.013126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5d2d4-9995-4162-a189-1cd61a11fc16 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:48.013406 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5d2d4-9995-4162-a189-1cd61a11fc16 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:48.013682 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5d2d4-9995-4162-a189-1cd61a11fc16 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:48.014404 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5d2d4-9995-4162-a189-1cd61a11fc16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:48.014710 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5d2d4-9995-4162-a189-1cd61a11fc16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:48.016128 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5d2d4-9995-4162-a189-1cd61a11fc16 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:48.029194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 546/1071] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:48.029487 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a04eb-2b1d-442f-b4c4-7106cd7a8f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:48.030129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5d2d4-9995-4162-a189-1cd61a11fc16 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:48.030550 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a04eb-2b1d-442f-b4c4-7106cd7a8f49 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:48.031008 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a04eb-2b1d-442f-b4c4-7106cd7a8f49 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:48.031495 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a04eb-2b1d-442f-b4c4-7106cd7a8f49 None admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:48.033024 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a04eb-2b1d-442f-b4c4-7106cd7a8f49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:48.033550 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a04eb-2b1d-442f-b4c4-7106cd7a8f49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:48.036356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a04eb-2b1d-442f-b4c4-7106cd7a8f49 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:48.060269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 526/1072] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:51:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:48.071387 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a04eb-2b1d-442f-b4c4-7106cd7a8f49 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:48.175822 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5d2d4-9995-4162-a189-1cd61a11fc16 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:48.228634 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb481cc1-aa9f-4515-8d56-3b933bfb61d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:48.230044 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb481cc1-aa9f-4515-8d56-3b933bfb61d9 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:48.230679 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb481cc1-aa9f-4515-8d56-3b933bfb61d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:48.230981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb481cc1-aa9f-4515-8d56-3b933bfb61d9 None admin] PATH_INFO: `/v3/users/3d543790968f4ab792fe403634e87995` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:48.241052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a04eb-2b1d-442f-b4c4-7106cd7a8f49 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:48.248652 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb481cc1-aa9f-4515-8d56-3b933bfb61d9 None admin] RBAC: Authorizing `identity:get_user(user_id=3d543790968f4ab792fe403634e87995)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:48.250131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb481cc1-aa9f-4515-8d56-3b933bfb61d9 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:48.252377 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 547/1073] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:51:48 2022] GET /identity/v3/users/3d543790968f4ab792fe403634e87995 => generated 285 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:48.258374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb481cc1-aa9f-4515-8d56-3b933bfb61d9 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:48.287318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baed20b-9ac5-4da5-b95d-07835b15babe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:48.288218 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baed20b-9ac5-4da5-b95d-07835b15babe None admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:48.288502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baed20b-9ac5-4da5-b95d-07835b15babe None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:48.288785 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baed20b-9ac5-4da5-b95d-07835b15babe None admin] PATH_INFO: `/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/52d539202cfb40a48b231713e16a599a/roles/a77c06fbc15841b2943535dab76a36b5` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:48.291222 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baed20b-9ac5-4da5-b95d-07835b15babe None admin] RBAC: Authorizing `identity:create_grant(project_id=48788e7517a14ca5b5af9f161512ac9c, user_id=52d539202cfb40a48b231713e16a599a, role_id=a77c06fbc15841b2943535dab76a36b5)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:48.292717 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baed20b-9ac5-4da5-b95d-07835b15babe None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:48.309714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 527/1074] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:51:48 2022] PUT /identity/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/52d539202cfb40a48b231713e16a599a/roles/a77c06fbc15841b2943535dab76a36b5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:51:48.411556 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb481cc1-aa9f-4515-8d56-3b933bfb61d9 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:48.456888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65036f31-b7e6-42a4-83e1-05e7acf2a0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:48.457563 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65036f31-b7e6-42a4-83e1-05e7acf2a0bf None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:48.457839 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65036f31-b7e6-42a4-83e1-05e7acf2a0bf None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:48.458108 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65036f31-b7e6-42a4-83e1-05e7acf2a0bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:48.540097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65036f31-b7e6-42a4-83e1-05e7acf2a0bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:48.543341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65036f31-b7e6-42a4-83e1-05e7acf2a0bf None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:48.681393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 548/1075] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:51:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 13 14:51:48.688221 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baed20b-9ac5-4da5-b95d-07835b15babe None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:48.864881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baed20b-9ac5-4da5-b95d-07835b15babe None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:48.924974 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41647e5a-80b0-4264-b16d-c052a5d11bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:48.925969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41647e5a-80b0-4264-b16d-c052a5d11bc7 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:48.926341 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41647e5a-80b0-4264-b16d-c052a5d11bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:48.926717 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41647e5a-80b0-4264-b16d-c052a5d11bc7 None admin] PATH_INFO: `/v3/projects/9454d8b1b9df4da48b99ce711321a1bc` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:48.928312 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41647e5a-80b0-4264-b16d-c052a5d11bc7 None admin] RBAC: Authorizing `identity:get_project(project_id=9454d8b1b9df4da48b99ce711321a1bc)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:48.929866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41647e5a-80b0-4264-b16d-c052a5d11bc7 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:48.931939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 528/1076] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:51:48 2022] GET /identity/v3/projects/9454d8b1b9df4da48b99ce711321a1bc => generated 311 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:48.938280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65036f31-b7e6-42a4-83e1-05e7acf2a0bf None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:49.054588 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65036f31-b7e6-42a4-83e1-05e7acf2a0bf None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:49.093949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc135db-3f0d-4e27-ab4e-8e439195bd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:49.095322 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc135db-3f0d-4e27-ab4e-8e439195bd63 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:49.095679 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc135db-3f0d-4e27-ab4e-8e439195bd63 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:49.096025 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc135db-3f0d-4e27-ab4e-8e439195bd63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:49.096939 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc135db-3f0d-4e27-ab4e-8e439195bd63 None admin] RBAC: Adding query filter params (role.id=b6fbf976763d4795afbfb53a09ec6f6c, scope.project.id=9454d8b1b9df4da48b99ce711321a1bc, user.id=3d543790968f4ab792fe403634e87995) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:49.097305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc135db-3f0d-4e27-ab4e-8e439195bd63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:49.098854 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc135db-3f0d-4e27-ab4e-8e439195bd63 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:49.105553 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 549/1077] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:51:48 2022] GET /identity/v3/role_assignments?user.id=3d543790968f4ab792fe403634e87995&scope.project.id=9454d8b1b9df4da48b99ce711321a1bc&role.id=b6fbf976763d4795afbfb53a09ec6f6c => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:51.270247 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bafbfa-1ea4-4eed-bdc9-29325058c4dd None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:51.271089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bafbfa-1ea4-4eed-bdc9-29325058c4dd None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:51.271089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bafbfa-1ea4-4eed-bdc9-29325058c4dd None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:51.272755 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 529/1078] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:51.280018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b6e59-5917-47b5-bf43-700e68493278 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:51.280637 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b6e59-5917-47b5-bf43-700e68493278 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:51.281009 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b6e59-5917-47b5-bf43-700e68493278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:51.309944 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-3b1b6e59-5917-47b5-bf43-700e68493278 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:51.312013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-3b1b6e59-5917-47b5-bf43-700e68493278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:51.435734 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 550/1079] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:51.460553 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bafbfa-1ea4-4eed-bdc9-29325058c4dd None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:51.587160 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bafbfa-1ea4-4eed-bdc9-29325058c4dd None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:51.628724 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd49f96-b360-4757-8d82-fda6d8d0ab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:51.629571 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd49f96-b360-4757-8d82-fda6d8d0ab40 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:51.629852 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd49f96-b360-4757-8d82-fda6d8d0ab40 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:51.630126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd49f96-b360-4757-8d82-fda6d8d0ab40 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:51.643971 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd49f96-b360-4757-8d82-fda6d8d0ab40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:51:51.652434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-ebd49f96-b360-4757-8d82-fda6d8d0ab40 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:51:51.652434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:51.652434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:51.652434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:51.652434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:51.652434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:51.652434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:51.652434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:51.652434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:51.652434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:51.652434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:51.652434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:51.652434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:51:51.652434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:51:51.652434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:51:51.652434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:51:51.654747 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:51:51.654747 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:51:51.654747 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:51:51.654747 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:51:51.654747 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:51.654747 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:51.654747 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:51.654747 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:51.654747 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:51.654747 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:51.654747 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:51.654747 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:51.654747 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:51.654747 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:51.654747 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:51.654747 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:51.656639 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:51.656639 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:51.656639 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:51.656639 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:51.656639 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:51:51.656639 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:51:51.656639 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:51:51.656639 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:51:51.656639 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:51:51.656639 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:51:51.656639 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 14:51:51.656639 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:51.659216 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 530/1080] 10.222.0.73 () {56 vars in 1120 bytes} [Fri May 13 14:51:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:51.660532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b6e59-5917-47b5-bf43-700e68493278 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:51.772253 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b6e59-5917-47b5-bf43-700e68493278 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:51.814211 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e344a-c6d2-445f-933a-290b9c39327d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:51.815277 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e344a-c6d2-445f-933a-290b9c39327d None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:51.815618 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e344a-c6d2-445f-933a-290b9c39327d None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:51.815972 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e344a-c6d2-445f-933a-290b9c39327d None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:51.816820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e344a-c6d2-445f-933a-290b9c39327d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:51.817182 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e344a-c6d2-445f-933a-290b9c39327d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:51.818682 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e344a-c6d2-445f-933a-290b9c39327d None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:51.829571 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 551/1081] 10.222.0.73 () {56 vars in 1115 bytes} [Fri May 13 14:51:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:51.836361 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd49f96-b360-4757-8d82-fda6d8d0ab40 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:51.955189 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd49f96-b360-4757-8d82-fda6d8d0ab40 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:51.994276 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0352ddf-1c5c-4e06-b656-02cc2970f10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:51.995258 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0352ddf-1c5c-4e06-b656-02cc2970f10e None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:51.995625 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0352ddf-1c5c-4e06-b656-02cc2970f10e None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:51.995985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0352ddf-1c5c-4e06-b656-02cc2970f10e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:52.009631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0352ddf-1c5c-4e06-b656-02cc2970f10e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:52.011280 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0352ddf-1c5c-4e06-b656-02cc2970f10e None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:52.029885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-c0352ddf-1c5c-4e06-b656-02cc2970f10e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:52.029885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:52.029885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:52.029885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:52.029885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:52.029885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:52.029885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:52.029885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:52.029885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:52.029885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:52.029885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:52.029885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:52.029885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:51:52.029885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:51:52.029885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:51:52.031744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:51:52.031744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:52.031744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:52.031744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:52.031744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:52.031744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:52.031744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:52.031744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:52.031744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:52.031744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:52.031744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:52.031744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:52.031744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:52.031744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:52.031744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:52.031744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:52.031744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:52.033488 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:51:52.033488 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:51:52.033488 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:52.033488 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:52.033488 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 531/1082] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:52.039294 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e344a-c6d2-445f-933a-290b9c39327d None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:52.135307 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eef4ca-26e7-462f-85c1-836bfb884498 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:52.135689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eef4ca-26e7-462f-85c1-836bfb884498 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:52.135869 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eef4ca-26e7-462f-85c1-836bfb884498 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:52.137270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 532/1083] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:51:52.143022 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a23835-e427-4c5b-8ea5-912a3d624153 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:52.143302 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a23835-e427-4c5b-8ea5-912a3d624153 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:52.143576 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a23835-e427-4c5b-8ea5-912a3d624153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:52.160658 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-51a23835-e427-4c5b-8ea5-912a3d624153 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:52.161872 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-51a23835-e427-4c5b-8ea5-912a3d624153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:52.172358 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e344a-c6d2-445f-933a-290b9c39327d None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:52.222589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118aed2-ff6e-4dce-b187-8eb85ce16555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:52.223618 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118aed2-ff6e-4dce-b187-8eb85ce16555 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:52.224065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118aed2-ff6e-4dce-b187-8eb85ce16555 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:52.224513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118aed2-ff6e-4dce-b187-8eb85ce16555 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:52.225736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118aed2-ff6e-4dce-b187-8eb85ce16555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:52.226233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118aed2-ff6e-4dce-b187-8eb85ce16555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:52.228376 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118aed2-ff6e-4dce-b187-8eb85ce16555 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:52.245074 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 533/1084] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:51:52.252637 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 552/1085] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:52.253981 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a23835-e427-4c5b-8ea5-912a3d624153 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:52.286121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118aed2-ff6e-4dce-b187-8eb85ce16555 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:52.373053 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a23835-e427-4c5b-8ea5-912a3d624153 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:52.425328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118aed2-ff6e-4dce-b187-8eb85ce16555 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:52.428049 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99209d32-a11f-4fd9-a14a-1443c92af942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:52.429242 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99209d32-a11f-4fd9-a14a-1443c92af942 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:52.429567 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99209d32-a11f-4fd9-a14a-1443c92af942 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:52.429879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99209d32-a11f-4fd9-a14a-1443c92af942 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:52.442861 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99209d32-a11f-4fd9-a14a-1443c92af942 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:52.445304 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99209d32-a11f-4fd9-a14a-1443c92af942 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:52.471180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-99209d32-a11f-4fd9-a14a-1443c92af942 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 14:51:52.471180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:52.471180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:52.471180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:52.471180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:52.471180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:52.471180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:52.471180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:52.471180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:52.471180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:52.471180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:52.471180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:52.471180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:51:52.471180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:51:52.471180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:51:52.471180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:51:52.472962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:52.472962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:52.472962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:51:52.472962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:51:52.472962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:51:52.472962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:51:52.472962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:52.472962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:52.472962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:52.472962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:52.472962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:52.472962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:52.472962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:52.472962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:52.472962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:52.472962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:52.472962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:52.472962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:52.475180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:52.475180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:52.475180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:51:52.475180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:51:52.475180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:51:52.475180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:51:52.475180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:51:52.475180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:51:52.475180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 14:51:52.475180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:52.475180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 534/1086] 10.222.0.73 () {56 vars in 1093 bytes} [Fri May 13 14:51:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:52.479667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c7770-8a45-4eaa-a056-912947921f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:52.480914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c7770-8a45-4eaa-a056-912947921f5f None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:52.481054 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99209d32-a11f-4fd9-a14a-1443c92af942 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:52.481359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c7770-8a45-4eaa-a056-912947921f5f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:52.481798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c7770-8a45-4eaa-a056-912947921f5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:52.495470 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c7770-8a45-4eaa-a056-912947921f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:51:52.504121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-c38c7770-8a45-4eaa-a056-912947921f5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:51:52.504121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:52.504121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:52.504121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:52.504121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:52.504121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:52.504121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:52.504121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:52.504121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:52.504121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:52.504121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:52.504121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:52.504121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:51:52.504121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:51:52.504121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:51:52.504121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:51:52.506251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:51:52.506251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:51:52.506251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:51:52.506251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:51:52.506251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:52.506251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:52.506251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:52.506251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:52.506251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:52.506251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:52.506251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:52.506251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:52.506251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:52.506251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:52.506251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:52.506251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:52.509044 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:52.509044 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:52.509044 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:52.509044 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:52.509044 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:51:52.509044 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:51:52.509044 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:51:52.509044 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:51:52.509044 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:51:52.509044 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:51:52.509044 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:51:52.509044 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:52.509044 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 553/1087] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:51:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:52.514740 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c7770-8a45-4eaa-a056-912947921f5f None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:52.609454 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99209d32-a11f-4fd9-a14a-1443c92af942 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:52.641452 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c7770-8a45-4eaa-a056-912947921f5f None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:52.663600 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cbf70-568f-44da-95bd-f0042b83816b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:52.664602 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cbf70-568f-44da-95bd-f0042b83816b None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:52.665050 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cbf70-568f-44da-95bd-f0042b83816b None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:52.665437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cbf70-568f-44da-95bd-f0042b83816b None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:52.666918 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cbf70-568f-44da-95bd-f0042b83816b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:52.667420 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cbf70-568f-44da-95bd-f0042b83816b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:52.669672 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cbf70-568f-44da-95bd-f0042b83816b None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:52.694138 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977125b0-b7c8-4e30-bb87-ef844de30af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:52.695186 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977125b0-b7c8-4e30-bb87-ef844de30af0 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:52.695634 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977125b0-b7c8-4e30-bb87-ef844de30af0 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:52.696070 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977125b0-b7c8-4e30-bb87-ef844de30af0 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:52.697355 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977125b0-b7c8-4e30-bb87-ef844de30af0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:52.697864 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977125b0-b7c8-4e30-bb87-ef844de30af0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:52.698006 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 535/1088] 10.222.0.73 () {56 vars in 1133 bytes} [Fri May 13 14:51:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:52.699539 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977125b0-b7c8-4e30-bb87-ef844de30af0 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:52.704489 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cbf70-568f-44da-95bd-f0042b83816b None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:52.712395 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 554/1089] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:51:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:52.718570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977125b0-b7c8-4e30-bb87-ef844de30af0 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:52.828053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977125b0-b7c8-4e30-bb87-ef844de30af0 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:52.845114 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cbf70-568f-44da-95bd-f0042b83816b None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:52.862783 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18cce2-f033-4b10-8555-cc9eef3206b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:52.863686 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18cce2-f033-4b10-8555-cc9eef3206b6 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:52.863961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18cce2-f033-4b10-8555-cc9eef3206b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:52.864235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18cce2-f033-4b10-8555-cc9eef3206b6 None admin] PATH_INFO: `/v3/users/3d543790968f4ab792fe403634e87995` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:52.865482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18cce2-f033-4b10-8555-cc9eef3206b6 None admin] RBAC: Authorizing `identity:get_user(user_id=3d543790968f4ab792fe403634e87995)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:52.866958 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18cce2-f033-4b10-8555-cc9eef3206b6 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:52.868686 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 555/1090] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:51:52 2022] GET /identity/v3/users/3d543790968f4ab792fe403634e87995 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:52.875245 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18cce2-f033-4b10-8555-cc9eef3206b6 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:52.905136 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349ea70-0132-4801-a4de-f91e51db12af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:52.906170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349ea70-0132-4801-a4de-f91e51db12af None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:52.906606 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349ea70-0132-4801-a4de-f91e51db12af None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:52.907635 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349ea70-0132-4801-a4de-f91e51db12af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:52.989792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349ea70-0132-4801-a4de-f91e51db12af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:52.991545 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349ea70-0132-4801-a4de-f91e51db12af None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:52.999541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18cce2-f033-4b10-8555-cc9eef3206b6 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:53.039164 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab05e7-43fe-4ff4-ba47-09bcd36999dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:53.040216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab05e7-43fe-4ff4-ba47-09bcd36999dd None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:53.040614 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab05e7-43fe-4ff4-ba47-09bcd36999dd None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:53.040985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab05e7-43fe-4ff4-ba47-09bcd36999dd None admin] PATH_INFO: `/v3/projects/9454d8b1b9df4da48b99ce711321a1bc` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:53.042563 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab05e7-43fe-4ff4-ba47-09bcd36999dd None admin] RBAC: Authorizing `identity:get_project(project_id=9454d8b1b9df4da48b99ce711321a1bc)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:53.044214 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab05e7-43fe-4ff4-ba47-09bcd36999dd None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:53.046189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 556/1091] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:51:52 2022] GET /identity/v3/projects/9454d8b1b9df4da48b99ce711321a1bc => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:53.053000 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab05e7-43fe-4ff4-ba47-09bcd36999dd None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:53.116118 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 536/1092] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:51:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 13 14:51:53.117511 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349ea70-0132-4801-a4de-f91e51db12af None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:53.183542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab05e7-43fe-4ff4-ba47-09bcd36999dd None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:53.223312 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c328e8-f7a5-42b9-80d8-feb27b21f602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:53.224220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c328e8-f7a5-42b9-80d8-feb27b21f602 None admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:53.224494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c328e8-f7a5-42b9-80d8-feb27b21f602 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:53.224763 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c328e8-f7a5-42b9-80d8-feb27b21f602 None admin] PATH_INFO: `/v3/projects/9454d8b1b9df4da48b99ce711321a1bc/users/3d543790968f4ab792fe403634e87995/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:53.226951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c328e8-f7a5-42b9-80d8-feb27b21f602 None admin] RBAC: Authorizing `identity:create_grant(project_id=9454d8b1b9df4da48b99ce711321a1bc, user_id=3d543790968f4ab792fe403634e87995, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:53.228470 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c328e8-f7a5-42b9-80d8-feb27b21f602 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:53.237677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349ea70-0132-4801-a4de-f91e51db12af None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:53.247966 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 557/1093] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:51:53 2022] PUT /identity/v3/projects/9454d8b1b9df4da48b99ce711321a1bc/users/3d543790968f4ab792fe403634e87995/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:51:53.294153 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11cc2c-f217-432c-9941-3c4188668607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:53.295410 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11cc2c-f217-432c-9941-3c4188668607 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:53.295837 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11cc2c-f217-432c-9941-3c4188668607 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:53.296248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11cc2c-f217-432c-9941-3c4188668607 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:53.314703 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11cc2c-f217-432c-9941-3c4188668607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:53.317039 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11cc2c-f217-432c-9941-3c4188668607 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:53.347812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-1c11cc2c-f217-432c-9941-3c4188668607 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:53.347812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:53.347812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:53.347812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:53.347812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:53.347812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:53.347812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:53.347812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:53.347812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:53.347812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:53.347812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:53.347812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:53.347812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:51:53.347812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:51:53.347812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:51:53.349675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:51:53.349675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:53.349675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:53.349675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:53.349675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:53.349675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:53.349675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:53.349675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:53.349675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:53.349675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:53.349675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:53.349675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:53.349675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:53.349675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:53.349675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:53.349675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:53.349675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:53.350997 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:51:53.350997 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:51:53.350997 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:51:53.350997 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:53.350997 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 537/1094] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:51:53.357957 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c328e8-f7a5-42b9-80d8-feb27b21f602 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:53.490848 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c328e8-f7a5-42b9-80d8-feb27b21f602 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:53.531424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362986f-edfe-4d39-b16e-885c5f6177f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:53.532761 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362986f-edfe-4d39-b16e-885c5f6177f2 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:53.533094 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362986f-edfe-4d39-b16e-885c5f6177f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:53.533424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362986f-edfe-4d39-b16e-885c5f6177f2 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:53.534220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362986f-edfe-4d39-b16e-885c5f6177f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:53.534575 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362986f-edfe-4d39-b16e-885c5f6177f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:53.536081 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362986f-edfe-4d39-b16e-885c5f6177f2 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:53.549878 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 558/1095] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:53.556239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11cc2c-f217-432c-9941-3c4188668607 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:53.729031 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11cc2c-f217-432c-9941-3c4188668607 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:53.789673 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb038317-b845-455c-ac09-534f701cb46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:53.791061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb038317-b845-455c-ac09-534f701cb46c None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:53.791583 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb038317-b845-455c-ac09-534f701cb46c None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:53.792038 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb038317-b845-455c-ac09-534f701cb46c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:53.805150 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb038317-b845-455c-ac09-534f701cb46c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:53.808016 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb038317-b845-455c-ac09-534f701cb46c None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:53.834363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-bb038317-b845-455c-ac09-534f701cb46c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:53.834363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:53.834363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:53.834363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:53.834363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:53.834363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:53.834363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:53.834363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:53.834363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:53.834363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:53.834363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:53.834363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:53.834363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:51:53.834363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:51:53.834363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:51:53.836168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:51:53.836168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:53.836168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:53.836168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:53.836168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:53.836168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:53.836168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:53.836168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:53.836168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:51:53.836168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:53.836168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:53.836168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:53.836168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:53.836168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:53.836168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:53.836168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:53.836168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:53.837840 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:51:53.837840 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:51:53.837840 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:51:53.837840 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:51:53.837840 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:51:53.837840 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:51:53.837840 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:51:53.837840 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:51:53.837840 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 538/1096] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:51:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:53.845008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362986f-edfe-4d39-b16e-885c5f6177f2 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:53.963994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362986f-edfe-4d39-b16e-885c5f6177f2 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:54.002991 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5f5cd-7a5f-45d2-bcbe-e6be109dcbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:54.003783 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5f5cd-7a5f-45d2-bcbe-e6be109dcbc9 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:54.004148 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5f5cd-7a5f-45d2-bcbe-e6be109dcbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:54.004531 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5f5cd-7a5f-45d2-bcbe-e6be109dcbc9 None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:54.005436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5f5cd-7a5f-45d2-bcbe-e6be109dcbc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:54.005828 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5f5cd-7a5f-45d2-bcbe-e6be109dcbc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:54.007413 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5f5cd-7a5f-45d2-bcbe-e6be109dcbc9 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:54.022017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 559/1097] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:51:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:54.031239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb038317-b845-455c-ac09-534f701cb46c None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:54.148727 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb038317-b845-455c-ac09-534f701cb46c None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:54.204799 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8674d4-520f-4ad9-8563-edb1e745d300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:54.206293 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8674d4-520f-4ad9-8563-edb1e745d300 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:54.206797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8674d4-520f-4ad9-8563-edb1e745d300 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:54.207322 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8674d4-520f-4ad9-8563-edb1e745d300 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:54.208927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8674d4-520f-4ad9-8563-edb1e745d300 None admin] RBAC: Adding query filter params (role.id=a77c06fbc15841b2943535dab76a36b5, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=52d539202cfb40a48b231713e16a599a) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:54.209492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8674d4-520f-4ad9-8563-edb1e745d300 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:54.212291 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8674d4-520f-4ad9-8563-edb1e745d300 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:54.235293 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 539/1098] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:51:54 2022] GET /identity/v3/role_assignments?user.id=52d539202cfb40a48b231713e16a599a&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=a77c06fbc15841b2943535dab76a36b5 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:55.601400 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaba211-519c-49b4-a2fe-799b2a316f59 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:55.602228 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaba211-519c-49b4-a2fe-799b2a316f59 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:55.602228 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaba211-519c-49b4-a2fe-799b2a316f59 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:55.603572 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 560/1099] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:51:55.609598 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff46d5-3cd3-46f4-baa4-189670e8048f None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:55.610686 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff46d5-3cd3-46f4-baa4-189670e8048f None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:55.610686 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff46d5-3cd3-46f4-baa4-189670e8048f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:55.628440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-2bff46d5-3cd3-46f4-baa4-189670e8048f None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:55.629693 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-2bff46d5-3cd3-46f4-baa4-189670e8048f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:55.700450 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 540/1100] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:55.723969 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaba211-519c-49b4-a2fe-799b2a316f59 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:55.831173 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaba211-519c-49b4-a2fe-799b2a316f59 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:55.868391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebed2c-dc70-4733-9d66-204b481e3a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:55.869112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebed2c-dc70-4733-9d66-204b481e3a94 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:55.869392 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebed2c-dc70-4733-9d66-204b481e3a94 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:55.869666 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebed2c-dc70-4733-9d66-204b481e3a94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:55.882772 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebed2c-dc70-4733-9d66-204b481e3a94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:51:55.890784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-6cebed2c-dc70-4733-9d66-204b481e3a94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:51:55.890784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:51:55.890784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:51:55.890784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:51:55.890784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:51:55.890784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:51:55.890784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:51:55.890784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:51:55.890784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:51:55.890784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:51:55.890784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:51:55.890784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:51:55.890784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:51:55.890784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:51:55.890784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:51:55.890784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:51:55.893007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:51:55.893007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:51:55.893007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:51:55.893007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:51:55.893007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:51:55.893007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:51:55.893007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:51:55.893007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:51:55.893007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:51:55.893007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:51:55.893007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:51:55.893007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:51:55.893007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:51:55.893007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:51:55.893007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:51:55.893007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:51:55.894902 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:51:55.894902 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:51:55.894902 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:51:55.894902 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:51:55.894902 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:51:55.894902 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:51:55.894902 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:51:55.894902 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:51:55.894902 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:51:55.894902 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:51:55.894902 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:51:55.894902 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:51:55.894902 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 561/1101] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:51:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:51:55.898388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff46d5-3cd3-46f4-baa4-189670e8048f None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:56.001900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff46d5-3cd3-46f4-baa4-189670e8048f None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:56.037439 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea192af-05ce-4418-9b0f-99ef8e182bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:56.038117 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea192af-05ce-4418-9b0f-99ef8e182bc9 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:56.038402 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea192af-05ce-4418-9b0f-99ef8e182bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:56.038691 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea192af-05ce-4418-9b0f-99ef8e182bc9 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:56.039451 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea192af-05ce-4418-9b0f-99ef8e182bc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:56.039754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea192af-05ce-4418-9b0f-99ef8e182bc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:56.041139 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea192af-05ce-4418-9b0f-99ef8e182bc9 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:56.050957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 541/1102] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:51:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:56.056860 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebed2c-dc70-4733-9d66-204b481e3a94 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:56.161785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebed2c-dc70-4733-9d66-204b481e3a94 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:56.197783 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8475d-77c1-4357-9ad7-b36be7ed73b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:56.198658 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8475d-77c1-4357-9ad7-b36be7ed73b8 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:56.198969 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8475d-77c1-4357-9ad7-b36be7ed73b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:56.199245 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8475d-77c1-4357-9ad7-b36be7ed73b8 None admin] PATH_INFO: `/v3/users/3d543790968f4ab792fe403634e87995` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:56.200547 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8475d-77c1-4357-9ad7-b36be7ed73b8 None admin] RBAC: Authorizing `identity:get_user(user_id=3d543790968f4ab792fe403634e87995)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:56.202007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8475d-77c1-4357-9ad7-b36be7ed73b8 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:56.203817 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 562/1103] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:51:56 2022] GET /identity/v3/users/3d543790968f4ab792fe403634e87995 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:56.213189 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea192af-05ce-4418-9b0f-99ef8e182bc9 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:56.317012 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea192af-05ce-4418-9b0f-99ef8e182bc9 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:56.351362 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7740a-81ce-4c49-8be9-feb9e6a74230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:56.352075 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7740a-81ce-4c49-8be9-feb9e6a74230 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:56.352398 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7740a-81ce-4c49-8be9-feb9e6a74230 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:56.352712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7740a-81ce-4c49-8be9-feb9e6a74230 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:56.465718 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7740a-81ce-4c49-8be9-feb9e6a74230 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:56.468264 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7740a-81ce-4c49-8be9-feb9e6a74230 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:56.648933 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 542/1104] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:51:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:51:56.655291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8475d-77c1-4357-9ad7-b36be7ed73b8 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:56.805052 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8475d-77c1-4357-9ad7-b36be7ed73b8 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:56.862545 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f373c77-c5a0-4f54-857b-a0e097c39433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:56.864025 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f373c77-c5a0-4f54-857b-a0e097c39433 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:56.864500 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f373c77-c5a0-4f54-857b-a0e097c39433 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:56.864975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f373c77-c5a0-4f54-857b-a0e097c39433 None admin] PATH_INFO: `/v3/projects/9454d8b1b9df4da48b99ce711321a1bc` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:56.867075 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f373c77-c5a0-4f54-857b-a0e097c39433 None admin] RBAC: Authorizing `identity:get_project(project_id=9454d8b1b9df4da48b99ce711321a1bc)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:56.869769 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f373c77-c5a0-4f54-857b-a0e097c39433 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:56.872988 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 563/1105] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:51:56 2022] GET /identity/v3/projects/9454d8b1b9df4da48b99ce711321a1bc => generated 311 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:56.880164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7740a-81ce-4c49-8be9-feb9e6a74230 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:57.036320 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7740a-81ce-4c49-8be9-feb9e6a74230 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:57.074795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a06905-d4f5-44b0-9d09-54956bb71fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:57.075458 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a06905-d4f5-44b0-9d09-54956bb71fc9 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:57.075776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a06905-d4f5-44b0-9d09-54956bb71fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:57.076084 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a06905-d4f5-44b0-9d09-54956bb71fc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:57.076967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a06905-d4f5-44b0-9d09-54956bb71fc9 None admin] RBAC: Adding query filter params (role.id=b6fbf976763d4795afbfb53a09ec6f6c, scope.project.id=9454d8b1b9df4da48b99ce711321a1bc, user.id=3d543790968f4ab792fe403634e87995) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:51:57.077335 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a06905-d4f5-44b0-9d09-54956bb71fc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:57.079548 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a06905-d4f5-44b0-9d09-54956bb71fc9 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:57.086674 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 543/1106] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:51:56 2022] GET /identity/v3/role_assignments?user.id=3d543790968f4ab792fe403634e87995&scope.project.id=9454d8b1b9df4da48b99ce711321a1bc&role.id=b6fbf976763d4795afbfb53a09ec6f6c => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:51:59.411340 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd90cae-2547-4ed3-8574-0421ceb86ffe None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:59.411954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd90cae-2547-4ed3-8574-0421ceb86ffe None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:59.411954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd90cae-2547-4ed3-8574-0421ceb86ffe None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:59.413270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 564/1107] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:51:59.419667 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11614d55-5dce-4dc5-8ea4-3ae57a3235b2 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:59.420510 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11614d55-5dce-4dc5-8ea4-3ae57a3235b2 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:59.420510 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11614d55-5dce-4dc5-8ea4-3ae57a3235b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:59.438614 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-11614d55-5dce-4dc5-8ea4-3ae57a3235b2 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:51:59.440098 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-11614d55-5dce-4dc5-8ea4-3ae57a3235b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:51:59.513543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 544/1108] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:51:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:51:59.539788 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd90cae-2547-4ed3-8574-0421ceb86ffe None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:59.660964 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd90cae-2547-4ed3-8574-0421ceb86ffe None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:59.696626 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a397e3-40dd-4ed9-9555-0a23b37f2e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:59.697399 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a397e3-40dd-4ed9-9555-0a23b37f2e0c None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:59.697717 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a397e3-40dd-4ed9-9555-0a23b37f2e0c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:59.698028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a397e3-40dd-4ed9-9555-0a23b37f2e0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:59.699344 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a397e3-40dd-4ed9-9555-0a23b37f2e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:59.700835 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a397e3-40dd-4ed9-9555-0a23b37f2e0c None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:59.702546 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 565/1109] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:51:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:51:59.708649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11614d55-5dce-4dc5-8ea4-3ae57a3235b2 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:51:59.813283 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11614d55-5dce-4dc5-8ea4-3ae57a3235b2 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:51:59.849403 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62550f9d-f2c3-4024-88a7-3fa95ca90bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:51:59.850081 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62550f9d-f2c3-4024-88a7-3fa95ca90bce None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:51:59.850358 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62550f9d-f2c3-4024-88a7-3fa95ca90bce None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:51:59.850634 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62550f9d-f2c3-4024-88a7-3fa95ca90bce None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:51:59.851385 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62550f9d-f2c3-4024-88a7-3fa95ca90bce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:51:59.852830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62550f9d-f2c3-4024-88a7-3fa95ca90bce None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:51:59.881300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 545/1110] 10.222.0.73 () {60 vars in 1132 bytes} [Fri May 13 14:51:59 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:52:02.280460 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4baf0-16ef-438a-8f62-8bf6456a6645 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:02.281021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4baf0-16ef-438a-8f62-8bf6456a6645 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:02.281021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4baf0-16ef-438a-8f62-8bf6456a6645 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:02.282348 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 566/1111] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:52:02.288286 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e9df3-d810-4527-bb94-350aec15b6c6 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:02.288791 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e9df3-d810-4527-bb94-350aec15b6c6 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:02.288895 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e9df3-d810-4527-bb94-350aec15b6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:02.306272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-a55e9df3-d810-4527-bb94-350aec15b6c6 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:52:02.307506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-a55e9df3-d810-4527-bb94-350aec15b6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:02.373877 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 546/1112] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:52:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:52:02.398370 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4baf0-16ef-438a-8f62-8bf6456a6645 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:02.502634 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4baf0-16ef-438a-8f62-8bf6456a6645 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:02.543810 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a56311-7236-4b48-a49b-ad5b19b4779f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:02.544591 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a56311-7236-4b48-a49b-ad5b19b4779f None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:02.544867 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a56311-7236-4b48-a49b-ad5b19b4779f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:02.545134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a56311-7236-4b48-a49b-ad5b19b4779f None admin] PATH_INFO: `/v3/roles/0a8d21e5149c42a8b85ca3c0258538d4` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:02.546610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a56311-7236-4b48-a49b-ad5b19b4779f None admin] RBAC: Authorizing `identity:get_role(role_id=0a8d21e5149c42a8b85ca3c0258538d4)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:02.548531 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a56311-7236-4b48-a49b-ad5b19b4779f None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:02.549941 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 567/1113] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:52:02 2022] GET /identity/v3/roles/0a8d21e5149c42a8b85ca3c0258538d4 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:02.558578 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e9df3-d810-4527-bb94-350aec15b6c6 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:02.659289 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e9df3-d810-4527-bb94-350aec15b6c6 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:02.694855 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b5180-dbbb-4042-ba41-5d856cffcc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:02.695754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b5180-dbbb-4042-ba41-5d856cffcc07 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:02.696030 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b5180-dbbb-4042-ba41-5d856cffcc07 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:02.696295 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b5180-dbbb-4042-ba41-5d856cffcc07 None admin] PATH_INFO: `/v3/users/50aef8bc13514a07a3f6bf9a8d13bafb` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:02.711389 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b5180-dbbb-4042-ba41-5d856cffcc07 None admin] RBAC: Authorizing `identity:get_user(user_id=50aef8bc13514a07a3f6bf9a8d13bafb)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:02.712994 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b5180-dbbb-4042-ba41-5d856cffcc07 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:02.714968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 547/1114] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:52:02 2022] GET /identity/v3/users/50aef8bc13514a07a3f6bf9a8d13bafb => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:02.721580 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a56311-7236-4b48-a49b-ad5b19b4779f None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:02.822060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a56311-7236-4b48-a49b-ad5b19b4779f None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:02.856526 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a0713-7605-4858-a45b-46cc4fa89074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:02.857180 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a0713-7605-4858-a45b-46cc4fa89074 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:02.857456 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a0713-7605-4858-a45b-46cc4fa89074 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:02.857725 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a0713-7605-4858-a45b-46cc4fa89074 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:02.927652 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a0713-7605-4858-a45b-46cc4fa89074 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:02.930410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a0713-7605-4858-a45b-46cc4fa89074 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:03.065768 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 568/1115] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:52:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:52:03.072271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b5180-dbbb-4042-ba41-5d856cffcc07 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:03.186390 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b5180-dbbb-4042-ba41-5d856cffcc07 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:03.227446 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744f627-b71d-4770-9481-1b77b388cda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:03.228320 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744f627-b71d-4770-9481-1b77b388cda1 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:03.228603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744f627-b71d-4770-9481-1b77b388cda1 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:03.228876 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744f627-b71d-4770-9481-1b77b388cda1 None admin] PATH_INFO: `/v3/projects/9454d8b1b9df4da48b99ce711321a1bc` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:03.230136 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744f627-b71d-4770-9481-1b77b388cda1 None admin] RBAC: Authorizing `identity:get_project(project_id=9454d8b1b9df4da48b99ce711321a1bc)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:03.231631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744f627-b71d-4770-9481-1b77b388cda1 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:03.233389 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 548/1116] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:52:03 2022] GET /identity/v3/projects/9454d8b1b9df4da48b99ce711321a1bc => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:03.242663 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a0713-7605-4858-a45b-46cc4fa89074 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:03.358084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a0713-7605-4858-a45b-46cc4fa89074 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:03.397365 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a32ba-bfe4-480a-ad8c-de746e7716e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:03.398094 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a32ba-bfe4-480a-ad8c-de746e7716e5 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:03.398483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a32ba-bfe4-480a-ad8c-de746e7716e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:03.398810 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a32ba-bfe4-480a-ad8c-de746e7716e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:03.399763 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a32ba-bfe4-480a-ad8c-de746e7716e5 None admin] RBAC: Adding query filter params (role.id=0a8d21e5149c42a8b85ca3c0258538d4, scope.project.id=9454d8b1b9df4da48b99ce711321a1bc, user.id=50aef8bc13514a07a3f6bf9a8d13bafb) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:52:03.400113 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a32ba-bfe4-480a-ad8c-de746e7716e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:03.401789 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a32ba-bfe4-480a-ad8c-de746e7716e5 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:03.408340 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 569/1117] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:52:03 2022] GET /identity/v3/role_assignments?user.id=50aef8bc13514a07a3f6bf9a8d13bafb&scope.project.id=9454d8b1b9df4da48b99ce711321a1bc&role.id=0a8d21e5149c42a8b85ca3c0258538d4 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:05.766596 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d35382-ef04-4005-8929-3d54b01c5417 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:05.767266 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d35382-ef04-4005-8929-3d54b01c5417 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:05.767266 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d35382-ef04-4005-8929-3d54b01c5417 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:05.768760 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 549/1118] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:52:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:52:05.774854 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31dd0a2-4152-4f96-8b55-18bea989b033 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:05.775432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31dd0a2-4152-4f96-8b55-18bea989b033 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:05.775432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31dd0a2-4152-4f96-8b55-18bea989b033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:05.792792 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-d31dd0a2-4152-4f96-8b55-18bea989b033 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:52:05.794143 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-d31dd0a2-4152-4f96-8b55-18bea989b033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:05.863319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 570/1119] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:52:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:52:05.886388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d35382-ef04-4005-8929-3d54b01c5417 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:05.991388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d35382-ef04-4005-8929-3d54b01c5417 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:06.029323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3f1c8-d253-4e10-8487-50bf112a5419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:06.030282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3f1c8-d253-4e10-8487-50bf112a5419 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:06.030606 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3f1c8-d253-4e10-8487-50bf112a5419 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:06.031149 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3f1c8-d253-4e10-8487-50bf112a5419 None admin] PATH_INFO: `/v3/roles/0a8d21e5149c42a8b85ca3c0258538d4` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:06.032872 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3f1c8-d253-4e10-8487-50bf112a5419 None admin] RBAC: Authorizing `identity:get_role(role_id=0a8d21e5149c42a8b85ca3c0258538d4)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:06.034310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3f1c8-d253-4e10-8487-50bf112a5419 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:06.035860 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 550/1120] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:52:05 2022] GET /identity/v3/roles/0a8d21e5149c42a8b85ca3c0258538d4 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:52:06.041894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31dd0a2-4152-4f96-8b55-18bea989b033 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:06.150087 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31dd0a2-4152-4f96-8b55-18bea989b033 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:06.185117 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ea798-4102-4b96-a7d0-a5e5837ac9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:06.186039 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ea798-4102-4b96-a7d0-a5e5837ac9d9 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:06.186358 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ea798-4102-4b96-a7d0-a5e5837ac9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:06.186674 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ea798-4102-4b96-a7d0-a5e5837ac9d9 None admin] PATH_INFO: `/v3/users/50aef8bc13514a07a3f6bf9a8d13bafb` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:06.188568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ea798-4102-4b96-a7d0-a5e5837ac9d9 None admin] RBAC: Authorizing `identity:get_user(user_id=50aef8bc13514a07a3f6bf9a8d13bafb)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:06.190331 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ea798-4102-4b96-a7d0-a5e5837ac9d9 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:06.192101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 571/1121] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:52:06 2022] GET /identity/v3/users/50aef8bc13514a07a3f6bf9a8d13bafb => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:06.198212 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3f1c8-d253-4e10-8487-50bf112a5419 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:06.310470 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3f1c8-d253-4e10-8487-50bf112a5419 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:06.348070 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1a624-799b-4e41-8d29-de97b69f1c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:06.348998 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1a624-799b-4e41-8d29-de97b69f1c81 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:06.349328 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1a624-799b-4e41-8d29-de97b69f1c81 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:06.349647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1a624-799b-4e41-8d29-de97b69f1c81 None admin] PATH_INFO: `/v3/projects/9454d8b1b9df4da48b99ce711321a1bc` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:06.351066 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1a624-799b-4e41-8d29-de97b69f1c81 None admin] RBAC: Authorizing `identity:get_project(project_id=9454d8b1b9df4da48b99ce711321a1bc)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:06.352588 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1a624-799b-4e41-8d29-de97b69f1c81 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:06.354412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 551/1122] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:52:06 2022] GET /identity/v3/projects/9454d8b1b9df4da48b99ce711321a1bc => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:06.361087 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ea798-4102-4b96-a7d0-a5e5837ac9d9 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:06.477092 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ea798-4102-4b96-a7d0-a5e5837ac9d9 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:06.513555 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67a141-a44c-4bc3-af85-73778e4dc7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:06.514506 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67a141-a44c-4bc3-af85-73778e4dc7d1 None admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:06.514876 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67a141-a44c-4bc3-af85-73778e4dc7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:06.515202 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67a141-a44c-4bc3-af85-73778e4dc7d1 None admin] PATH_INFO: `/v3/projects/9454d8b1b9df4da48b99ce711321a1bc/users/50aef8bc13514a07a3f6bf9a8d13bafb/roles/0a8d21e5149c42a8b85ca3c0258538d4` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:06.517605 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67a141-a44c-4bc3-af85-73778e4dc7d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9454d8b1b9df4da48b99ce711321a1bc, user_id=50aef8bc13514a07a3f6bf9a8d13bafb, role_id=0a8d21e5149c42a8b85ca3c0258538d4)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:06.519121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67a141-a44c-4bc3-af85-73778e4dc7d1 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:06.533920 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 572/1123] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:52:06 2022] PUT /identity/v3/projects/9454d8b1b9df4da48b99ce711321a1bc/users/50aef8bc13514a07a3f6bf9a8d13bafb/roles/0a8d21e5149c42a8b85ca3c0258538d4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:52:08.866630 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb79c5f-36dc-44cc-bbc0-ce394ade967b None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:08.867240 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb79c5f-36dc-44cc-bbc0-ce394ade967b None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:08.867240 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb79c5f-36dc-44cc-bbc0-ce394ade967b None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:08.868637 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 552/1124] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:52:08.875348 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74694b9-4257-438c-bc30-c1137e3f2ee1 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:08.876209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74694b9-4257-438c-bc30-c1137e3f2ee1 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:08.876209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74694b9-4257-438c-bc30-c1137e3f2ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:08.897587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-c74694b9-4257-438c-bc30-c1137e3f2ee1 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:52:08.899013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-c74694b9-4257-438c-bc30-c1137e3f2ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:08.970939 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 573/1125] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:52:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:52:08.994702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb79c5f-36dc-44cc-bbc0-ce394ade967b None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:09.100687 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb79c5f-36dc-44cc-bbc0-ce394ade967b None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:09.138936 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42b2a3-9511-442b-b8d5-75bcb806e9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:09.139736 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42b2a3-9511-442b-b8d5-75bcb806e9c5 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:09.140013 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42b2a3-9511-442b-b8d5-75bcb806e9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:09.140321 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42b2a3-9511-442b-b8d5-75bcb806e9c5 None admin] PATH_INFO: `/v3/roles/0a8d21e5149c42a8b85ca3c0258538d4` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:09.141910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42b2a3-9511-442b-b8d5-75bcb806e9c5 None admin] RBAC: Authorizing `identity:get_role(role_id=0a8d21e5149c42a8b85ca3c0258538d4)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:09.143342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42b2a3-9511-442b-b8d5-75bcb806e9c5 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:09.144779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 553/1126] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:52:08 2022] GET /identity/v3/roles/0a8d21e5149c42a8b85ca3c0258538d4 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:52:09.150973 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74694b9-4257-438c-bc30-c1137e3f2ee1 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:09.257708 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74694b9-4257-438c-bc30-c1137e3f2ee1 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:09.292956 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c75cd3-55d1-40ed-945c-ca64a9109587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:09.293845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c75cd3-55d1-40ed-945c-ca64a9109587 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:09.294128 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c75cd3-55d1-40ed-945c-ca64a9109587 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:09.294403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c75cd3-55d1-40ed-945c-ca64a9109587 None admin] PATH_INFO: `/v3/users/50aef8bc13514a07a3f6bf9a8d13bafb` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:09.295727 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c75cd3-55d1-40ed-945c-ca64a9109587 None admin] RBAC: Authorizing `identity:get_user(user_id=50aef8bc13514a07a3f6bf9a8d13bafb)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:09.297714 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c75cd3-55d1-40ed-945c-ca64a9109587 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:09.299428 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 574/1127] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:52:09 2022] GET /identity/v3/users/50aef8bc13514a07a3f6bf9a8d13bafb => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:52:09.305548 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42b2a3-9511-442b-b8d5-75bcb806e9c5 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:09.409480 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42b2a3-9511-442b-b8d5-75bcb806e9c5 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:09.446032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160cd68-5e89-4d73-8745-c950f1d3769b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:09.446688 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160cd68-5e89-4d73-8745-c950f1d3769b None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:09.447008 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160cd68-5e89-4d73-8745-c950f1d3769b None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:09.447283 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160cd68-5e89-4d73-8745-c950f1d3769b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:09.516686 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160cd68-5e89-4d73-8745-c950f1d3769b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:09.518160 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160cd68-5e89-4d73-8745-c950f1d3769b None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:09.623992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 554/1128] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:52:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 13 14:52:09.630356 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c75cd3-55d1-40ed-945c-ca64a9109587 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:09.761866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c75cd3-55d1-40ed-945c-ca64a9109587 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:09.829757 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f133893-e4fe-42a6-b2d7-f994d8a26bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:09.831198 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f133893-e4fe-42a6-b2d7-f994d8a26bd4 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:09.831656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f133893-e4fe-42a6-b2d7-f994d8a26bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:09.832107 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f133893-e4fe-42a6-b2d7-f994d8a26bd4 None admin] PATH_INFO: `/v3/projects/9454d8b1b9df4da48b99ce711321a1bc` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:09.834573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f133893-e4fe-42a6-b2d7-f994d8a26bd4 None admin] RBAC: Authorizing `identity:get_project(project_id=9454d8b1b9df4da48b99ce711321a1bc)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:09.837190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f133893-e4fe-42a6-b2d7-f994d8a26bd4 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:09.840250 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 575/1129] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:52:09 2022] GET /identity/v3/projects/9454d8b1b9df4da48b99ce711321a1bc => generated 311 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:52:09.847303 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160cd68-5e89-4d73-8745-c950f1d3769b None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:09.955775 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160cd68-5e89-4d73-8745-c950f1d3769b None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:09.992219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b6755-6cd2-4c40-b73c-4246874c09d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:09.992892 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6755-6cd2-4c40-b73c-4246874c09d2 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:09.993176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6755-6cd2-4c40-b73c-4246874c09d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:09.993452 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6755-6cd2-4c40-b73c-4246874c09d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:09.994296 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b6755-6cd2-4c40-b73c-4246874c09d2 None admin] RBAC: Adding query filter params (role.id=0a8d21e5149c42a8b85ca3c0258538d4, scope.project.id=9454d8b1b9df4da48b99ce711321a1bc, user.id=50aef8bc13514a07a3f6bf9a8d13bafb) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:52:09.994607 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b6755-6cd2-4c40-b73c-4246874c09d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:09.996109 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b6755-6cd2-4c40-b73c-4246874c09d2 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:10.002953 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 555/1130] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:52:09 2022] GET /identity/v3/role_assignments?user.id=50aef8bc13514a07a3f6bf9a8d13bafb&scope.project.id=9454d8b1b9df4da48b99ce711321a1bc&role.id=0a8d21e5149c42a8b85ca3c0258538d4 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:12.396009 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1976411-56fc-4cb8-be22-d142af452ab2 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:12.396627 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1976411-56fc-4cb8-be22-d142af452ab2 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:12.396627 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1976411-56fc-4cb8-be22-d142af452ab2 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:12.398113 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 576/1131] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:52:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:52:12.404359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ef38b-2103-4fc6-80b9-126d2d48cbb8 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:12.404995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ef38b-2103-4fc6-80b9-126d2d48cbb8 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:12.405142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ef38b-2103-4fc6-80b9-126d2d48cbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:12.423293 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-ec7ef38b-2103-4fc6-80b9-126d2d48cbb8 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:52:12.424543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ec7ef38b-2103-4fc6-80b9-126d2d48cbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:12.498460 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 556/1132] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:52:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:52:12.523517 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1976411-56fc-4cb8-be22-d142af452ab2 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:12.634132 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1976411-56fc-4cb8-be22-d142af452ab2 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:12.669989 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78037a-4edb-4dd1-a5e8-928ffab8952e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:12.670724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78037a-4edb-4dd1-a5e8-928ffab8952e None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:12.671074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78037a-4edb-4dd1-a5e8-928ffab8952e None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:12.671387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78037a-4edb-4dd1-a5e8-928ffab8952e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:12.672667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78037a-4edb-4dd1-a5e8-928ffab8952e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:12.674117 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78037a-4edb-4dd1-a5e8-928ffab8952e None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:12.675832 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 577/1133] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:52:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:12.681942 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ef38b-2103-4fc6-80b9-126d2d48cbb8 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:12.787207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ef38b-2103-4fc6-80b9-126d2d48cbb8 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:12.824207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9899399-5120-4472-902b-42e33319e1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:12.824897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9899399-5120-4472-902b-42e33319e1bd None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:12.825187 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9899399-5120-4472-902b-42e33319e1bd None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:12.825459 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9899399-5120-4472-902b-42e33319e1bd None admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:12.826201 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9899399-5120-4472-902b-42e33319e1bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:12.828370 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9899399-5120-4472-902b-42e33319e1bd None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:12.855417 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 557/1134] 10.222.0.73 () {60 vars in 1141 bytes} [Fri May 13 14:52:12 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:52:15.241763 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e469009-54f6-4c72-80b4-411276ba2023 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:15.242302 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e469009-54f6-4c72-80b4-411276ba2023 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:15.242302 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e469009-54f6-4c72-80b4-411276ba2023 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:15.243695 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 578/1135] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:52:15.249907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fb452-a4a4-42f3-ade3-a33e6bb45c7f None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:15.250446 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fb452-a4a4-42f3-ade3-a33e6bb45c7f None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:15.250446 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fb452-a4a4-42f3-ade3-a33e6bb45c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:15.269970 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-312fb452-a4a4-42f3-ade3-a33e6bb45c7f None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:52:15.271289 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-312fb452-a4a4-42f3-ade3-a33e6bb45c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:15.344102 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 558/1136] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:52:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:52:15.369507 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e469009-54f6-4c72-80b4-411276ba2023 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:15.480433 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e469009-54f6-4c72-80b4-411276ba2023 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:15.517046 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fe16e-d6ec-41c0-9bd3-3d9e2ff8ccd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:15.517748 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fe16e-d6ec-41c0-9bd3-3d9e2ff8ccd1 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:15.518065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fe16e-d6ec-41c0-9bd3-3d9e2ff8ccd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:15.518374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fe16e-d6ec-41c0-9bd3-3d9e2ff8ccd1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:15.519653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567fe16e-d6ec-41c0-9bd3-3d9e2ff8ccd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:15.521128 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567fe16e-d6ec-41c0-9bd3-3d9e2ff8ccd1 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:15.522877 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 579/1137] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:52:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:52:15.529581 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fb452-a4a4-42f3-ade3-a33e6bb45c7f None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:15.636567 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fb452-a4a4-42f3-ade3-a33e6bb45c7f None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:15.671161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32c65f-a827-4663-ba40-3433538edea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:15.671956 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32c65f-a827-4663-ba40-3433538edea9 None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:15.672333 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32c65f-a827-4663-ba40-3433538edea9 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:15.672688 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32c65f-a827-4663-ba40-3433538edea9 None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:15.673501 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32c65f-a827-4663-ba40-3433538edea9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:15.675077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32c65f-a827-4663-ba40-3433538edea9 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:15.697081 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 559/1138] 10.222.0.73 () {60 vars in 1132 bytes} [Fri May 13 14:52:15 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:52:18.096400 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b6a11-aa33-454e-8e47-83f49f37b1db None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:18.096961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b6a11-aa33-454e-8e47-83f49f37b1db None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:18.096961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b6a11-aa33-454e-8e47-83f49f37b1db None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:18.098487 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 580/1139] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:52:18.105047 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c5f2e-6cfe-4506-8cd8-970344ef50d6 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:18.105629 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c5f2e-6cfe-4506-8cd8-970344ef50d6 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:18.105629 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c5f2e-6cfe-4506-8cd8-970344ef50d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:18.123600 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-2b8c5f2e-6cfe-4506-8cd8-970344ef50d6 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:52:18.125442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-2b8c5f2e-6cfe-4506-8cd8-970344ef50d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:18.195841 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 560/1140] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:52:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:52:18.219900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b6a11-aa33-454e-8e47-83f49f37b1db None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:18.333381 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b6a11-aa33-454e-8e47-83f49f37b1db None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:18.368412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ededd7-5f9c-4a7d-acc6-56d19454c5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:18.369230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ededd7-5f9c-4a7d-acc6-56d19454c5a9 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:18.369510 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ededd7-5f9c-4a7d-acc6-56d19454c5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:18.369786 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ededd7-5f9c-4a7d-acc6-56d19454c5a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:18.381792 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ededd7-5f9c-4a7d-acc6-56d19454c5a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:52:18.389712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-53ededd7-5f9c-4a7d-acc6-56d19454c5a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:52:18.389712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:52:18.389712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:52:18.389712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:52:18.389712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:52:18.389712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:52:18.389712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:52:18.389712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:52:18.389712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:52:18.389712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:52:18.389712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:52:18.389712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:52:18.389712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:52:18.389712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:52:18.389712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:52:18.389712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:52:18.391568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:52:18.391568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:52:18.391568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:52:18.391568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:52:18.391568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:52:18.391568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:52:18.391568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:52:18.391568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:52:18.391568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:52:18.391568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:52:18.391568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:52:18.391568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:52:18.391568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:52:18.391568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:52:18.391568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:52:18.391568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:52:18.392494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:52:18.392494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:52:18.392494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:52:18.392494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:52:18.392494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:52:18.392494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:52:18.392494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:52:18.392494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:52:18.392494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:52:18.392494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:52:18.392494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:52:18.392494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:52:18.392494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 581/1141] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:52:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:52:18.400256 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c5f2e-6cfe-4506-8cd8-970344ef50d6 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:18.507140 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c5f2e-6cfe-4506-8cd8-970344ef50d6 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:18.544689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e873d-7207-4c7d-b532-4e8e8174b7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:18.545369 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e873d-7207-4c7d-b532-4e8e8174b7c7 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:18.545657 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e873d-7207-4c7d-b532-4e8e8174b7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:18.546485 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e873d-7207-4c7d-b532-4e8e8174b7c7 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:18.547286 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e873d-7207-4c7d-b532-4e8e8174b7c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:52:18.547591 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e873d-7207-4c7d-b532-4e8e8174b7c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:18.548989 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e873d-7207-4c7d-b532-4e8e8174b7c7 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:18.567035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 561/1142] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:52:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:18.573284 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ededd7-5f9c-4a7d-acc6-56d19454c5a9 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:18.680734 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ededd7-5f9c-4a7d-acc6-56d19454c5a9 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:18.715162 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed4a1c-3d8a-48c3-9d30-813da71484af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:18.716049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed4a1c-3d8a-48c3-9d30-813da71484af None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:18.716327 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed4a1c-3d8a-48c3-9d30-813da71484af None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:18.716602 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed4a1c-3d8a-48c3-9d30-813da71484af None admin] PATH_INFO: `/v3/users/12d9f32cbf32414e9955ffaf626b9536` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:18.731485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed4a1c-3d8a-48c3-9d30-813da71484af None admin] RBAC: Authorizing `identity:get_user(user_id=12d9f32cbf32414e9955ffaf626b9536)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:18.732944 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed4a1c-3d8a-48c3-9d30-813da71484af None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:18.735348 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 582/1143] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:52:18 2022] GET /identity/v3/users/12d9f32cbf32414e9955ffaf626b9536 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:18.744770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e873d-7207-4c7d-b532-4e8e8174b7c7 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:18.852254 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e873d-7207-4c7d-b532-4e8e8174b7c7 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:18.890407 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d7cfe-5197-42ce-99e7-48cdc9b63351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:18.891098 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d7cfe-5197-42ce-99e7-48cdc9b63351 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:18.891386 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d7cfe-5197-42ce-99e7-48cdc9b63351 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:18.891661 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d7cfe-5197-42ce-99e7-48cdc9b63351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:19.007046 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d7cfe-5197-42ce-99e7-48cdc9b63351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:19.009783 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d7cfe-5197-42ce-99e7-48cdc9b63351 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:19.137680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 562/1144] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:52:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 13 14:52:19.147182 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed4a1c-3d8a-48c3-9d30-813da71484af None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:19.326525 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed4a1c-3d8a-48c3-9d30-813da71484af None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:19.381849 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b7c80-41bb-446f-8745-019a6fb4f544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:19.383352 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b7c80-41bb-446f-8745-019a6fb4f544 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:19.383861 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b7c80-41bb-446f-8745-019a6fb4f544 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:19.384345 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b7c80-41bb-446f-8745-019a6fb4f544 None admin] PATH_INFO: `/v3/projects/93f090a95562408d99e9551da57fd3cf` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:19.386422 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b7c80-41bb-446f-8745-019a6fb4f544 None admin] RBAC: Authorizing `identity:get_project(project_id=93f090a95562408d99e9551da57fd3cf)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:19.389274 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b7c80-41bb-446f-8745-019a6fb4f544 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:19.392614 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 583/1145] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:52:19 2022] GET /identity/v3/projects/93f090a95562408d99e9551da57fd3cf => generated 311 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:19.398970 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d7cfe-5197-42ce-99e7-48cdc9b63351 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:19.504927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d7cfe-5197-42ce-99e7-48cdc9b63351 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:19.540295 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70dcf1-9e03-4a69-82b0-25ec5bd43f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:19.540955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70dcf1-9e03-4a69-82b0-25ec5bd43f31 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:19.541241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70dcf1-9e03-4a69-82b0-25ec5bd43f31 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:19.541520 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70dcf1-9e03-4a69-82b0-25ec5bd43f31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:19.542354 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70dcf1-9e03-4a69-82b0-25ec5bd43f31 None admin] RBAC: Adding query filter params (role.id=b6fbf976763d4795afbfb53a09ec6f6c, scope.project.id=93f090a95562408d99e9551da57fd3cf, user.id=12d9f32cbf32414e9955ffaf626b9536) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:52:19.542664 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70dcf1-9e03-4a69-82b0-25ec5bd43f31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:19.544142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70dcf1-9e03-4a69-82b0-25ec5bd43f31 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:19.550344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 563/1146] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:52:19 2022] GET /identity/v3/role_assignments?user.id=12d9f32cbf32414e9955ffaf626b9536&scope.project.id=93f090a95562408d99e9551da57fd3cf&role.id=b6fbf976763d4795afbfb53a09ec6f6c => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:21.958150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba69d6e-9bf9-4483-b65e-c08786cd9d73 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:21.958730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba69d6e-9bf9-4483-b65e-c08786cd9d73 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:21.958730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba69d6e-9bf9-4483-b65e-c08786cd9d73 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:21.960292 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 584/1147] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:52:21.966625 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420099b5-3a24-4686-9478-68e3bb63a52c None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:21.967204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420099b5-3a24-4686-9478-68e3bb63a52c None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:21.967380 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420099b5-3a24-4686-9478-68e3bb63a52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:21.985210 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-420099b5-3a24-4686-9478-68e3bb63a52c None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:52:21.986426 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-420099b5-3a24-4686-9478-68e3bb63a52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:22.057517 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 564/1148] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:52:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:52:22.081429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba69d6e-9bf9-4483-b65e-c08786cd9d73 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:22.191186 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba69d6e-9bf9-4483-b65e-c08786cd9d73 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:22.227518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0700c-46e1-4fc6-a6f3-074ff6c8f4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:22.228320 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0700c-46e1-4fc6-a6f3-074ff6c8f4f3 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:22.228601 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0700c-46e1-4fc6-a6f3-074ff6c8f4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:22.228871 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0700c-46e1-4fc6-a6f3-074ff6c8f4f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:22.240941 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0700c-46e1-4fc6-a6f3-074ff6c8f4f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:52:22.250028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-84b0700c-46e1-4fc6-a6f3-074ff6c8f4f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:52:22.250028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:52:22.250028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:52:22.250028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:52:22.250028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:52:22.250028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:52:22.250028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:52:22.250028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:52:22.250028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:52:22.250028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:52:22.250028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:52:22.250028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:52:22.250028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:52:22.250028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:52:22.250028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:52:22.250028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:52:22.251931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:52:22.251931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:52:22.251931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:52:22.251931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:52:22.251931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:52:22.251931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:52:22.251931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:52:22.251931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:52:22.251931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:52:22.251931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:52:22.251931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:52:22.251931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:52:22.251931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:52:22.251931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:52:22.251931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:52:22.251931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:52:22.252793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:52:22.252793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:52:22.252793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:52:22.252793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:52:22.252793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:52:22.252793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:52:22.252793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:52:22.252793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:52:22.252793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:52:22.252793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:52:22.252793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:52:22.252793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:52:22.252793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 585/1149] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:52:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:52:22.261495 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420099b5-3a24-4686-9478-68e3bb63a52c None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:22.386463 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420099b5-3a24-4686-9478-68e3bb63a52c None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:22.422726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6c249-0737-4ba1-8bc7-01bdbaafcbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:22.423443 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6c249-0737-4ba1-8bc7-01bdbaafcbff None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:22.423727 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6c249-0737-4ba1-8bc7-01bdbaafcbff None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:22.424004 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6c249-0737-4ba1-8bc7-01bdbaafcbff None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:22.424761 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6c249-0737-4ba1-8bc7-01bdbaafcbff None admin] RBAC: Adding query filter params (name=admin) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:52:22.425067 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6c249-0737-4ba1-8bc7-01bdbaafcbff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:22.426463 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6c249-0737-4ba1-8bc7-01bdbaafcbff None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:22.436780 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 565/1150] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:52:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:22.444059 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0700c-46e1-4fc6-a6f3-074ff6c8f4f3 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:22.549918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0700c-46e1-4fc6-a6f3-074ff6c8f4f3 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:22.586796 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4578994-ada6-428a-93cc-c317e607742c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:22.587714 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4578994-ada6-428a-93cc-c317e607742c None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:22.587992 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4578994-ada6-428a-93cc-c317e607742c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:22.588264 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4578994-ada6-428a-93cc-c317e607742c None admin] PATH_INFO: `/v3/users/12d9f32cbf32414e9955ffaf626b9536` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:22.589547 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4578994-ada6-428a-93cc-c317e607742c None admin] RBAC: Authorizing `identity:get_user(user_id=12d9f32cbf32414e9955ffaf626b9536)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:22.591055 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4578994-ada6-428a-93cc-c317e607742c None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:22.592866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 586/1151] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:52:22 2022] GET /identity/v3/users/12d9f32cbf32414e9955ffaf626b9536 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:22.599088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6c249-0737-4ba1-8bc7-01bdbaafcbff None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:22.702310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6c249-0737-4ba1-8bc7-01bdbaafcbff None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:22.737030 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cb424-a287-4362-bca1-b82e3a424740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:22.737963 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cb424-a287-4362-bca1-b82e3a424740 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:22.738295 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cb424-a287-4362-bca1-b82e3a424740 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:22.738619 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cb424-a287-4362-bca1-b82e3a424740 None admin] PATH_INFO: `/v3/projects/93f090a95562408d99e9551da57fd3cf` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:22.739922 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cb424-a287-4362-bca1-b82e3a424740 None admin] RBAC: Authorizing `identity:get_project(project_id=93f090a95562408d99e9551da57fd3cf)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:22.741422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cb424-a287-4362-bca1-b82e3a424740 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:22.743305 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 566/1152] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:52:22 2022] GET /identity/v3/projects/93f090a95562408d99e9551da57fd3cf => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:52:22.749673 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4578994-ada6-428a-93cc-c317e607742c None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:22.855648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4578994-ada6-428a-93cc-c317e607742c None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:22.891365 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b1f63-ad90-43c5-87b5-61dda5a00bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:22.892283 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b1f63-ad90-43c5-87b5-61dda5a00bfa None admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:22.892559 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b1f63-ad90-43c5-87b5-61dda5a00bfa None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:22.892832 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b1f63-ad90-43c5-87b5-61dda5a00bfa None admin] PATH_INFO: `/v3/projects/93f090a95562408d99e9551da57fd3cf/users/12d9f32cbf32414e9955ffaf626b9536/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:22.894887 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b1f63-ad90-43c5-87b5-61dda5a00bfa None admin] RBAC: Authorizing `identity:create_grant(project_id=93f090a95562408d99e9551da57fd3cf, user_id=12d9f32cbf32414e9955ffaf626b9536, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:22.896335 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b1f63-ad90-43c5-87b5-61dda5a00bfa None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:22.911922 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 587/1153] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:52:22 2022] PUT /identity/v3/projects/93f090a95562408d99e9551da57fd3cf/users/12d9f32cbf32414e9955ffaf626b9536/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 14:52:25.189913 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66bf00-950e-4a84-bf46-a5d91fd5195e None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:25.190450 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66bf00-950e-4a84-bf46-a5d91fd5195e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:25.190772 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66bf00-950e-4a84-bf46-a5d91fd5195e None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:25.192449 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 567/1154] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:52:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:52:25.198610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad295093-6c3e-40b3-8998-f478df47b6b2 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:25.199198 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad295093-6c3e-40b3-8998-f478df47b6b2 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:25.199334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad295093-6c3e-40b3-8998-f478df47b6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:25.218054 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-ad295093-6c3e-40b3-8998-f478df47b6b2 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:52:25.219457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ad295093-6c3e-40b3-8998-f478df47b6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:25.287438 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 588/1155] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:52:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:52:25.311725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66bf00-950e-4a84-bf46-a5d91fd5195e None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:25.414709 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66bf00-950e-4a84-bf46-a5d91fd5195e None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:25.449842 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc834a3b-850f-4e2d-944e-9c94d83597fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:25.450600 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc834a3b-850f-4e2d-944e-9c94d83597fd None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:25.450951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc834a3b-850f-4e2d-944e-9c94d83597fd None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:25.451283 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc834a3b-850f-4e2d-944e-9c94d83597fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:25.463459 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc834a3b-850f-4e2d-944e-9c94d83597fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:52:25.471207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-bc834a3b-850f-4e2d-944e-9c94d83597fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:52:25.471207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:52:25.471207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:52:25.471207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:52:25.471207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:52:25.471207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:52:25.471207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:52:25.471207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:52:25.471207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:52:25.471207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:52:25.471207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:52:25.471207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:52:25.471207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:52:25.471207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:52:25.471207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:52:25.471207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:52:25.472897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:52:25.472897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:52:25.472897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:52:25.472897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:52:25.472897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:52:25.472897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:52:25.472897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:52:25.472897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:52:25.472897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:52:25.472897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:52:25.472897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:52:25.472897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:52:25.472897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:52:25.472897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:52:25.472897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:52:25.472897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:52:25.473805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:52:25.473805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:52:25.473805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:52:25.473805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:52:25.473805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:52:25.473805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:52:25.473805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:52:25.473805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:52:25.473805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:52:25.473805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:52:25.473805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:52:25.473805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:52:25.473805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 568/1156] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:52:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:52:25.478870 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad295093-6c3e-40b3-8998-f478df47b6b2 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:25.585966 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad295093-6c3e-40b3-8998-f478df47b6b2 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:25.622587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b16593-5e62-4ab4-b30c-addf2278da29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:25.623403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b16593-5e62-4ab4-b30c-addf2278da29 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:25.624301 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b16593-5e62-4ab4-b30c-addf2278da29 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:25.624626 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b16593-5e62-4ab4-b30c-addf2278da29 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:25.625449 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b16593-5e62-4ab4-b30c-addf2278da29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:52:25.625801 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b16593-5e62-4ab4-b30c-addf2278da29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:25.627389 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b16593-5e62-4ab4-b30c-addf2278da29 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:25.636619 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 589/1157] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:52:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:52:25.642577 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc834a3b-850f-4e2d-944e-9c94d83597fd None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:25.791419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc834a3b-850f-4e2d-944e-9c94d83597fd None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:25.830271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa8de5-88b6-4bd1-b42c-d0f832a9010d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:25.831240 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa8de5-88b6-4bd1-b42c-d0f832a9010d None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:25.831609 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa8de5-88b6-4bd1-b42c-d0f832a9010d None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:25.832017 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa8de5-88b6-4bd1-b42c-d0f832a9010d None admin] PATH_INFO: `/v3/users/12d9f32cbf32414e9955ffaf626b9536` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:25.833385 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa8de5-88b6-4bd1-b42c-d0f832a9010d None admin] RBAC: Authorizing `identity:get_user(user_id=12d9f32cbf32414e9955ffaf626b9536)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:25.834871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa8de5-88b6-4bd1-b42c-d0f832a9010d None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:25.836574 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 569/1158] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:52:25 2022] GET /identity/v3/users/12d9f32cbf32414e9955ffaf626b9536 => generated 286 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:25.843457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b16593-5e62-4ab4-b30c-addf2278da29 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:25.951137 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b16593-5e62-4ab4-b30c-addf2278da29 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:25.987220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3368ae9-c576-4559-a6f2-95d6a115c70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:25.987941 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3368ae9-c576-4559-a6f2-95d6a115c70e None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:25.988222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3368ae9-c576-4559-a6f2-95d6a115c70e None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:25.988495 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3368ae9-c576-4559-a6f2-95d6a115c70e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:26.071637 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3368ae9-c576-4559-a6f2-95d6a115c70e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:26.073109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3368ae9-c576-4559-a6f2-95d6a115c70e None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:26.198538 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 590/1159] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:52:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:52:26.207718 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa8de5-88b6-4bd1-b42c-d0f832a9010d None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:26.310012 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa8de5-88b6-4bd1-b42c-d0f832a9010d None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:26.346983 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb529c44-3453-4eb3-b9b8-49bea7467cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:26.347899 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb529c44-3453-4eb3-b9b8-49bea7467cba None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:26.348178 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb529c44-3453-4eb3-b9b8-49bea7467cba None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:26.348456 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb529c44-3453-4eb3-b9b8-49bea7467cba None admin] PATH_INFO: `/v3/projects/93f090a95562408d99e9551da57fd3cf` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:26.349859 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb529c44-3453-4eb3-b9b8-49bea7467cba None admin] RBAC: Authorizing `identity:get_project(project_id=93f090a95562408d99e9551da57fd3cf)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:26.351397 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb529c44-3453-4eb3-b9b8-49bea7467cba None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:26.353272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 570/1160] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:52:26 2022] GET /identity/v3/projects/93f090a95562408d99e9551da57fd3cf => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:26.359972 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3368ae9-c576-4559-a6f2-95d6a115c70e None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:26.465215 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3368ae9-c576-4559-a6f2-95d6a115c70e None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:26.499332 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e89fa-0da7-48a9-95bf-a47adb5e2bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:26.499988 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e89fa-0da7-48a9-95bf-a47adb5e2bb1 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:26.500267 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e89fa-0da7-48a9-95bf-a47adb5e2bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:26.500542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e89fa-0da7-48a9-95bf-a47adb5e2bb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:26.501376 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e89fa-0da7-48a9-95bf-a47adb5e2bb1 None admin] RBAC: Adding query filter params (role.id=b6fbf976763d4795afbfb53a09ec6f6c, scope.project.id=93f090a95562408d99e9551da57fd3cf, user.id=12d9f32cbf32414e9955ffaf626b9536) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:52:26.501691 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e89fa-0da7-48a9-95bf-a47adb5e2bb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:26.503192 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e89fa-0da7-48a9-95bf-a47adb5e2bb1 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:26.509780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 591/1161] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:52:26 2022] GET /identity/v3/role_assignments?user.id=12d9f32cbf32414e9955ffaf626b9536&scope.project.id=93f090a95562408d99e9551da57fd3cf&role.id=b6fbf976763d4795afbfb53a09ec6f6c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:28.846811 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfa84f-c76d-442d-84e7-8f6a4804b963 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:28.847458 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfa84f-c76d-442d-84e7-8f6a4804b963 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:28.847937 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfa84f-c76d-442d-84e7-8f6a4804b963 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:28.851016 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 571/1162] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:52:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:52:28.857320 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd46fe-7852-485d-af43-5bb7239b84d6 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:28.858423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd46fe-7852-485d-af43-5bb7239b84d6 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:28.858423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd46fe-7852-485d-af43-5bb7239b84d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:28.877199 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-94fd46fe-7852-485d-af43-5bb7239b84d6 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:52:28.878591 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-94fd46fe-7852-485d-af43-5bb7239b84d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:28.958363 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 592/1163] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:52:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:52:28.986406 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acfa84f-c76d-442d-84e7-8f6a4804b963 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:29.106356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acfa84f-c76d-442d-84e7-8f6a4804b963 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:29.142531 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acc27b-8b6e-4bbc-a769-7f2f8c20a497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:29.143232 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acc27b-8b6e-4bbc-a769-7f2f8c20a497 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:29.143634 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acc27b-8b6e-4bbc-a769-7f2f8c20a497 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:29.144008 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acc27b-8b6e-4bbc-a769-7f2f8c20a497 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:29.213549 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63acc27b-8b6e-4bbc-a769-7f2f8c20a497 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:29.215039 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63acc27b-8b6e-4bbc-a769-7f2f8c20a497 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:29.316128 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 572/1164] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:52:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 13 14:52:29.322545 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd46fe-7852-485d-af43-5bb7239b84d6 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:29.422492 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd46fe-7852-485d-af43-5bb7239b84d6 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:29.458136 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4354a0-9163-4620-abe7-b878f0d52ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:29.458971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4354a0-9163-4620-abe7-b878f0d52ed9 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:29.459255 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4354a0-9163-4620-abe7-b878f0d52ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:29.459538 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4354a0-9163-4620-abe7-b878f0d52ed9 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:29.466685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4354a0-9163-4620-abe7-b878f0d52ed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:29.468770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4354a0-9163-4620-abe7-b878f0d52ed9 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:29.483628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-4f4354a0-9163-4620-abe7-b878f0d52ed9 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 13 14:52:29.483628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:52:29.483628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 13 14:52:29.483628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 13 14:52:29.483628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:52:29.483628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:52:29.483628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:52:29.483628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:52:29.483628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 13 14:52:29.483628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:52:29.483628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:52:29.483628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:52:29.483628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:52:29.483628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:52:29.483628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:52:29.483628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:52:29.483628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:52:29.485558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:52:29.485558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:52:29.485558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:52:29.485558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:52:29.485558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:52:29.485558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:52:29.485558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:52:29.485558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:52:29.485558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:52:29.485558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:52:29.485558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:52:29.485558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:52:29.485558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:52:29.485558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:52:29.485558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:52:29.485558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:52:29.487296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:52:29.487296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:52:29.487296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:52:29.487296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:52:29.487296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:52:29.487296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:52:29.487296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:52:29.487296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:52:29.487296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:52:29.487296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:52:29.487296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 13 14:52:29.487296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:52:29.487296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 13 14:52:29.487296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:52:29.487296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 593/1165] 10.222.0.73 () {56 vars in 1117 bytes} [Fri May 13 14:52:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:52:29.491436 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acc27b-8b6e-4bbc-a769-7f2f8c20a497 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:29.604384 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acc27b-8b6e-4bbc-a769-7f2f8c20a497 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:29.644984 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ed7ff-651b-48c6-b8fe-1f7a7a4bc2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:29.645664 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ed7ff-651b-48c6-b8fe-1f7a7a4bc2dc None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:29.645947 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ed7ff-651b-48c6-b8fe-1f7a7a4bc2dc None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:29.646224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ed7ff-651b-48c6-b8fe-1f7a7a4bc2dc None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:29.646995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ed7ff-651b-48c6-b8fe-1f7a7a4bc2dc None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:52:29.647308 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ed7ff-651b-48c6-b8fe-1f7a7a4bc2dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:29.648789 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ed7ff-651b-48c6-b8fe-1f7a7a4bc2dc None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:29.657283 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 573/1166] 10.222.0.73 () {56 vars in 1115 bytes} [Fri May 13 14:52:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:52:32.034967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04925931-bc93-4f70-b89b-5df2ed17362a None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:32.035567 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04925931-bc93-4f70-b89b-5df2ed17362a None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:32.035567 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04925931-bc93-4f70-b89b-5df2ed17362a None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:32.036888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 594/1167] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:52:32.043134 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6a8f2-6906-41fb-9efe-538de1d56161 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:32.043955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6a8f2-6906-41fb-9efe-538de1d56161 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:32.044123 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6a8f2-6906-41fb-9efe-538de1d56161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:32.062048 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-c1d6a8f2-6906-41fb-9efe-538de1d56161 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:52:32.063561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c1d6a8f2-6906-41fb-9efe-538de1d56161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:32.139030 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 574/1168] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:52:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:52:32.163257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04925931-bc93-4f70-b89b-5df2ed17362a None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:32.272525 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04925931-bc93-4f70-b89b-5df2ed17362a None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:32.307847 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef7502-5465-4e79-9e9e-6e708bd42f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:32.308515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef7502-5465-4e79-9e9e-6e708bd42f73 None admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:32.308793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef7502-5465-4e79-9e9e-6e708bd42f73 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:32.309062 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef7502-5465-4e79-9e9e-6e708bd42f73 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:32.309825 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef7502-5465-4e79-9e9e-6e708bd42f73 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:32.311355 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef7502-5465-4e79-9e9e-6e708bd42f73 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:32.329547 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 595/1169] 10.222.0.73 () {60 vars in 1138 bytes} [Fri May 13 14:52:32 2022] POST /identity/v3/domains => generated 267 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:52:34.821173 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d620ab-7840-4cc0-adfc-200141fedb21 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:34.821778 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d620ab-7840-4cc0-adfc-200141fedb21 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:34.821778 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d620ab-7840-4cc0-adfc-200141fedb21 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:34.823361 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 575/1170] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:52:34.829945 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff29bc-9780-4dbc-9f10-0d804b4dd6d6 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:34.830537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff29bc-9780-4dbc-9f10-0d804b4dd6d6 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:34.830537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff29bc-9780-4dbc-9f10-0d804b4dd6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:34.848338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-15ff29bc-9780-4dbc-9f10-0d804b4dd6d6 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:52:34.849542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-15ff29bc-9780-4dbc-9f10-0d804b4dd6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:34.941302 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 596/1171] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:52:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:52:34.965862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d620ab-7840-4cc0-adfc-200141fedb21 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:35.069486 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d620ab-7840-4cc0-adfc-200141fedb21 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:35.103872 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09936e1b-0be0-4c13-b8b4-728d0cfc53d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:35.104736 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09936e1b-0be0-4c13-b8b4-728d0cfc53d7 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:35.105014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09936e1b-0be0-4c13-b8b4-728d0cfc53d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:35.105285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09936e1b-0be0-4c13-b8b4-728d0cfc53d7 None admin] PATH_INFO: `/v3/domains/8377002e224240b58f0a737d2f4f27c3` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:35.116240 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09936e1b-0be0-4c13-b8b4-728d0cfc53d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8377002e224240b58f0a737d2f4f27c3)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:35.117699 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09936e1b-0be0-4c13-b8b4-728d0cfc53d7 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:35.119454 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 576/1172] 10.222.0.73 () {56 vars in 1183 bytes} [Fri May 13 14:52:34 2022] GET /identity/v3/domains/8377002e224240b58f0a737d2f4f27c3 => generated 267 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:52:35.125994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff29bc-9780-4dbc-9f10-0d804b4dd6d6 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:35.225839 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff29bc-9780-4dbc-9f10-0d804b4dd6d6 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:35.261675 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e5542-537e-4c5a-8c47-829e91c7e100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:35.262336 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e5542-537e-4c5a-8c47-829e91c7e100 None admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:35.262615 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e5542-537e-4c5a-8c47-829e91c7e100 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:35.262910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e5542-537e-4c5a-8c47-829e91c7e100 None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:35.264215 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e5542-537e-4c5a-8c47-829e91c7e100 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:35.265664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e5542-537e-4c5a-8c47-829e91c7e100 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:35.296373 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 597/1173] 10.222.0.73 () {60 vars in 1141 bytes} [Fri May 13 14:52:35 2022] POST /identity/v3/projects => generated 361 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 14:52:37.635307 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44e2f9-f816-43a6-9b2e-3c5b06f26e68 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:37.636237 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44e2f9-f816-43a6-9b2e-3c5b06f26e68 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:37.636237 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44e2f9-f816-43a6-9b2e-3c5b06f26e68 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:37.637514 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 577/1174] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:52:37.643379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ac452-4777-487f-866d-589cc6057d25 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:37.643919 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ac452-4777-487f-866d-589cc6057d25 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:37.643919 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ac452-4777-487f-866d-589cc6057d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:37.661266 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-4c1ac452-4777-487f-866d-589cc6057d25 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:52:37.662468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-4c1ac452-4777-487f-866d-589cc6057d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:37.731163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 598/1175] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:52:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:52:37.757314 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44e2f9-f816-43a6-9b2e-3c5b06f26e68 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:37.868524 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44e2f9-f816-43a6-9b2e-3c5b06f26e68 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:37.906404 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc6929-0687-463d-a651-c982b6972947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:37.907244 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc6929-0687-463d-a651-c982b6972947 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:37.907533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc6929-0687-463d-a651-c982b6972947 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:37.907808 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc6929-0687-463d-a651-c982b6972947 None admin] PATH_INFO: `/v3/domains/8377002e224240b58f0a737d2f4f27c3` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:37.909035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc6929-0687-463d-a651-c982b6972947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8377002e224240b58f0a737d2f4f27c3)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:37.910489 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc6929-0687-463d-a651-c982b6972947 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:37.912195 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 578/1176] 10.222.0.73 () {56 vars in 1183 bytes} [Fri May 13 14:52:37 2022] GET /identity/v3/domains/8377002e224240b58f0a737d2f4f27c3 => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:37.918264 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ac452-4777-487f-866d-589cc6057d25 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:38.026034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ac452-4777-487f-866d-589cc6057d25 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:38.063471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf472b6-205e-4a33-8e61-760c41e0ce9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:38.064171 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf472b6-205e-4a33-8e61-760c41e0ce9c None admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:38.064452 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf472b6-205e-4a33-8e61-760c41e0ce9c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:38.064721 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf472b6-205e-4a33-8e61-760c41e0ce9c None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:38.065463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf472b6-205e-4a33-8e61-760c41e0ce9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:38.066963 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf472b6-205e-4a33-8e61-760c41e0ce9c None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:38.093933 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 599/1177] 10.222.0.73 () {60 vars in 1132 bytes} [Fri May 13 14:52:37 2022] POST /identity/v3/users => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:52:40.474626 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d566509-70aa-4ee4-bd87-b6a17aa9eb6f None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:40.475278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d566509-70aa-4ee4-bd87-b6a17aa9eb6f None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:40.475532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d566509-70aa-4ee4-bd87-b6a17aa9eb6f None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:40.476951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 579/1178] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:52:40.483371 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d6a4f-cc05-4728-8345-8543e742aa91 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:40.484182 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d6a4f-cc05-4728-8345-8543e742aa91 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:40.484341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d6a4f-cc05-4728-8345-8543e742aa91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:40.508067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-963d6a4f-cc05-4728-8345-8543e742aa91 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:52:40.509436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-963d6a4f-cc05-4728-8345-8543e742aa91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:40.583940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 600/1179] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:52:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:52:40.608516 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d566509-70aa-4ee4-bd87-b6a17aa9eb6f None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:40.714219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d566509-70aa-4ee4-bd87-b6a17aa9eb6f None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:40.749233 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eda113-78f1-4466-affb-09dfc8ac0d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:40.749947 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda113-78f1-4466-affb-09dfc8ac0d19 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:40.750231 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda113-78f1-4466-affb-09dfc8ac0d19 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:40.750509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda113-78f1-4466-affb-09dfc8ac0d19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:40.762065 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eda113-78f1-4466-affb-09dfc8ac0d19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:52:40.770534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-e4eda113-78f1-4466-affb-09dfc8ac0d19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:52:40.770534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:52:40.770534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:52:40.770534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:52:40.770534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:52:40.770534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:52:40.770534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:52:40.770534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:52:40.770534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:52:40.770534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:52:40.770534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:52:40.770534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:52:40.770534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:52:40.770534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:52:40.770534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:52:40.770534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:52:40.771916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:52:40.771916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:52:40.771916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:52:40.771916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:52:40.771916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:52:40.771916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:52:40.771916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:52:40.771916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:52:40.771916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:52:40.771916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:52:40.771916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:52:40.771916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:52:40.771916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:52:40.771916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:52:40.771916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:52:40.771916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:52:40.773655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:52:40.773655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:52:40.773655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:52:40.773655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:52:40.773655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:52:40.773655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:52:40.773655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:52:40.773655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:52:40.773655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:52:40.773655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:52:40.773655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:52:40.773655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:52:40.773655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 580/1180] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:52:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:52:40.778376 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d6a4f-cc05-4728-8345-8543e742aa91 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:40.882594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d6a4f-cc05-4728-8345-8543e742aa91 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:40.920357 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a582c-e875-4843-8efc-3fd708414592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:40.921249 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a582c-e875-4843-8efc-3fd708414592 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:40.921531 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a582c-e875-4843-8efc-3fd708414592 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:40.921806 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a582c-e875-4843-8efc-3fd708414592 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:40.923209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a582c-e875-4843-8efc-3fd708414592 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:52:40.923209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a582c-e875-4843-8efc-3fd708414592 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:40.924327 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a582c-e875-4843-8efc-3fd708414592 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:40.933790 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 601/1181] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:52:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:40.940274 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eda113-78f1-4466-affb-09dfc8ac0d19 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:41.045758 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eda113-78f1-4466-affb-09dfc8ac0d19 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:41.084895 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29254da5-86e0-47ed-91bc-63703da6545a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:41.085778 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29254da5-86e0-47ed-91bc-63703da6545a None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:41.086063 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29254da5-86e0-47ed-91bc-63703da6545a None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:41.086338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29254da5-86e0-47ed-91bc-63703da6545a None admin] PATH_INFO: `/v3/users/c045bb6bfcd74f4f8ef138d86b88c5f4` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:41.100522 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29254da5-86e0-47ed-91bc-63703da6545a None admin] RBAC: Authorizing `identity:get_user(user_id=c045bb6bfcd74f4f8ef138d86b88c5f4)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:41.101985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29254da5-86e0-47ed-91bc-63703da6545a None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:41.103800 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 581/1182] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:52:40 2022] GET /identity/v3/users/c045bb6bfcd74f4f8ef138d86b88c5f4 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:41.112043 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a582c-e875-4843-8efc-3fd708414592 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:41.263735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a582c-e875-4843-8efc-3fd708414592 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:41.314273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb439ef4-9f80-4875-805a-1f9dd5a5e0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:41.315125 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb439ef4-9f80-4875-805a-1f9dd5a5e0b1 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:41.315516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb439ef4-9f80-4875-805a-1f9dd5a5e0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:41.315932 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb439ef4-9f80-4875-805a-1f9dd5a5e0b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:41.405954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb439ef4-9f80-4875-805a-1f9dd5a5e0b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:41.407464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb439ef4-9f80-4875-805a-1f9dd5a5e0b1 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:41.509356 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 602/1183] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:52:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:52:41.515908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29254da5-86e0-47ed-91bc-63703da6545a None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:41.624015 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29254da5-86e0-47ed-91bc-63703da6545a None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:41.659548 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7fb48-b46c-46c7-99ee-6b9154d5e4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:41.660542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7fb48-b46c-46c7-99ee-6b9154d5e4e6 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:41.660828 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7fb48-b46c-46c7-99ee-6b9154d5e4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:41.661100 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7fb48-b46c-46c7-99ee-6b9154d5e4e6 None admin] PATH_INFO: `/v3/projects/4dc484bab35b41b38fce7cd0ca06664e` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:41.662290 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7fb48-b46c-46c7-99ee-6b9154d5e4e6 None admin] RBAC: Authorizing `identity:get_project(project_id=4dc484bab35b41b38fce7cd0ca06664e)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:41.663757 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7fb48-b46c-46c7-99ee-6b9154d5e4e6 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:41.665487 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 582/1184] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:52:41 2022] GET /identity/v3/projects/4dc484bab35b41b38fce7cd0ca06664e => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:41.672512 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb439ef4-9f80-4875-805a-1f9dd5a5e0b1 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:41.777484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb439ef4-9f80-4875-805a-1f9dd5a5e0b1 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:41.813211 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36fb72-95c0-450a-ba7d-0e920cb00b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:41.813924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36fb72-95c0-450a-ba7d-0e920cb00b2a None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:41.814236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36fb72-95c0-450a-ba7d-0e920cb00b2a None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:41.814553 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36fb72-95c0-450a-ba7d-0e920cb00b2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:41.815483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36fb72-95c0-450a-ba7d-0e920cb00b2a None admin] RBAC: Adding query filter params (role.id=b6fbf976763d4795afbfb53a09ec6f6c, scope.project.id=4dc484bab35b41b38fce7cd0ca06664e, user.id=c045bb6bfcd74f4f8ef138d86b88c5f4) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:52:41.815827 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36fb72-95c0-450a-ba7d-0e920cb00b2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:41.817497 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36fb72-95c0-450a-ba7d-0e920cb00b2a None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:41.824175 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 603/1185] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:52:41 2022] GET /identity/v3/role_assignments?user.id=c045bb6bfcd74f4f8ef138d86b88c5f4&scope.project.id=4dc484bab35b41b38fce7cd0ca06664e&role.id=b6fbf976763d4795afbfb53a09ec6f6c => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:44.153981 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dafa9-ba75-4c79-a3e2-14f93506c306 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:44.154583 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dafa9-ba75-4c79-a3e2-14f93506c306 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:44.154583 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dafa9-ba75-4c79-a3e2-14f93506c306 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:44.156020 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 583/1186] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:52:44.164553 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce113d-96f9-424e-b6e1-ed9a158784fa None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:44.165388 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce113d-96f9-424e-b6e1-ed9a158784fa None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:44.165388 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce113d-96f9-424e-b6e1-ed9a158784fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:44.183674 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-92ce113d-96f9-424e-b6e1-ed9a158784fa None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:52:44.185442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-92ce113d-96f9-424e-b6e1-ed9a158784fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:44.253671 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 604/1187] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:52:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:52:44.277050 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70dafa9-ba75-4c79-a3e2-14f93506c306 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:44.379354 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70dafa9-ba75-4c79-a3e2-14f93506c306 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:44.414422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff0c9b-7750-4a36-85b8-2a834875ff87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:44.415331 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff0c9b-7750-4a36-85b8-2a834875ff87 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:44.415656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff0c9b-7750-4a36-85b8-2a834875ff87 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:44.415970 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff0c9b-7750-4a36-85b8-2a834875ff87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:44.429031 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff0c9b-7750-4a36-85b8-2a834875ff87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:52:44.438339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-7cff0c9b-7750-4a36-85b8-2a834875ff87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:52:44.438339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:52:44.438339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:52:44.438339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:52:44.438339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:52:44.438339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:52:44.438339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:52:44.438339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:52:44.438339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:52:44.438339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:52:44.438339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:52:44.438339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:52:44.438339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:52:44.438339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:52:44.438339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:52:44.438339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:52:44.440371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:52:44.440371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:52:44.440371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:52:44.440371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:52:44.440371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:52:44.440371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:52:44.440371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:52:44.440371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:52:44.440371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:52:44.440371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:52:44.440371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:52:44.440371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:52:44.440371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:52:44.440371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:52:44.440371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:52:44.440371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:52:44.442217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:52:44.442217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:52:44.442217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:52:44.442217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:52:44.442217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:52:44.442217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:52:44.442217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:52:44.442217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:52:44.442217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:52:44.442217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:52:44.442217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:52:44.442217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:52:44.442217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 584/1188] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:52:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:52:44.448026 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce113d-96f9-424e-b6e1-ed9a158784fa None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:44.550372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce113d-96f9-424e-b6e1-ed9a158784fa None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:44.588073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cad53-7b05-4222-90d0-6ea6d4c47bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:44.588752 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cad53-7b05-4222-90d0-6ea6d4c47bea None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:44.589035 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cad53-7b05-4222-90d0-6ea6d4c47bea None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:44.589311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cad53-7b05-4222-90d0-6ea6d4c47bea None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:44.590072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363cad53-7b05-4222-90d0-6ea6d4c47bea None admin] RBAC: Adding query filter params (name=admin) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:52:44.590380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363cad53-7b05-4222-90d0-6ea6d4c47bea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:44.591842 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363cad53-7b05-4222-90d0-6ea6d4c47bea None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:44.600893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 605/1189] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:52:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:44.610664 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff0c9b-7750-4a36-85b8-2a834875ff87 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:44.721984 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff0c9b-7750-4a36-85b8-2a834875ff87 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:44.783822 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1c37c-909a-4a91-bff2-fbc5e86c8789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:44.785274 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1c37c-909a-4a91-bff2-fbc5e86c8789 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:44.785773 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1c37c-909a-4a91-bff2-fbc5e86c8789 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:44.786260 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1c37c-909a-4a91-bff2-fbc5e86c8789 None admin] PATH_INFO: `/v3/users/c045bb6bfcd74f4f8ef138d86b88c5f4` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:44.788509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1c37c-909a-4a91-bff2-fbc5e86c8789 None admin] RBAC: Authorizing `identity:get_user(user_id=c045bb6bfcd74f4f8ef138d86b88c5f4)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:44.791709 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1c37c-909a-4a91-bff2-fbc5e86c8789 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:44.798927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 585/1190] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:52:44 2022] GET /identity/v3/users/c045bb6bfcd74f4f8ef138d86b88c5f4 => generated 311 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:44.803481 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cad53-7b05-4222-90d0-6ea6d4c47bea None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:44.916258 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cad53-7b05-4222-90d0-6ea6d4c47bea None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:44.955405 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f475a66-5c51-4563-b881-d5d841c4149e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:44.956611 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f475a66-5c51-4563-b881-d5d841c4149e None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:44.956995 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f475a66-5c51-4563-b881-d5d841c4149e None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:44.957363 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f475a66-5c51-4563-b881-d5d841c4149e None admin] PATH_INFO: `/v3/projects/4dc484bab35b41b38fce7cd0ca06664e` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:44.958964 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f475a66-5c51-4563-b881-d5d841c4149e None admin] RBAC: Authorizing `identity:get_project(project_id=4dc484bab35b41b38fce7cd0ca06664e)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:44.961094 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f475a66-5c51-4563-b881-d5d841c4149e None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:44.963061 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 606/1191] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:52:44 2022] GET /identity/v3/projects/4dc484bab35b41b38fce7cd0ca06664e => generated 361 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:44.969796 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1c37c-909a-4a91-bff2-fbc5e86c8789 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:45.129355 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1c37c-909a-4a91-bff2-fbc5e86c8789 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:45.185489 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b93da-4e89-47b0-8b95-609641e79d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:45.186432 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b93da-4e89-47b0-8b95-609641e79d58 None admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:45.186710 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b93da-4e89-47b0-8b95-609641e79d58 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:45.187179 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b93da-4e89-47b0-8b95-609641e79d58 None admin] PATH_INFO: `/v3/projects/4dc484bab35b41b38fce7cd0ca06664e/users/c045bb6bfcd74f4f8ef138d86b88c5f4/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:45.189527 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b93da-4e89-47b0-8b95-609641e79d58 None admin] RBAC: Authorizing `identity:create_grant(project_id=4dc484bab35b41b38fce7cd0ca06664e, user_id=c045bb6bfcd74f4f8ef138d86b88c5f4, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:45.191007 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b93da-4e89-47b0-8b95-609641e79d58 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:45.205719 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 586/1192] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:52:44 2022] PUT /identity/v3/projects/4dc484bab35b41b38fce7cd0ca06664e/users/c045bb6bfcd74f4f8ef138d86b88c5f4/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:52:47.549869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04596b17-dcac-4508-8fee-caadb6f0714d None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:47.550458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04596b17-dcac-4508-8fee-caadb6f0714d None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:47.550458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04596b17-dcac-4508-8fee-caadb6f0714d None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:47.552123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 607/1193] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:52:47.558253 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee5d02-3896-4405-8be4-75dcf6fb4094 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:47.558774 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee5d02-3896-4405-8be4-75dcf6fb4094 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:47.558935 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee5d02-3896-4405-8be4-75dcf6fb4094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:47.577180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-97ee5d02-3896-4405-8be4-75dcf6fb4094 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:52:47.578404 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-97ee5d02-3896-4405-8be4-75dcf6fb4094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:52:47.646665 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 587/1194] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:52:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:52:47.671750 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04596b17-dcac-4508-8fee-caadb6f0714d None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:47.779933 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04596b17-dcac-4508-8fee-caadb6f0714d None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:47.820608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c01b5-a914-471e-a751-fd3a46dd6d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:47.821313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c01b5-a914-471e-a751-fd3a46dd6d00 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:47.821592 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c01b5-a914-471e-a751-fd3a46dd6d00 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:47.821863 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c01b5-a914-471e-a751-fd3a46dd6d00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:47.833988 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c01b5-a914-471e-a751-fd3a46dd6d00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:52:47.841780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-a50c01b5-a914-471e-a751-fd3a46dd6d00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:52:47.841780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:52:47.841780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:52:47.841780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:52:47.841780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:52:47.841780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:52:47.841780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:52:47.841780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:52:47.841780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:52:47.841780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:52:47.841780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:52:47.841780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:52:47.841780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:52:47.841780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:52:47.841780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:52:47.841780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:52:47.843693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:52:47.843693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:52:47.843693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:52:47.843693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:52:47.843693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:52:47.843693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:52:47.843693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:52:47.843693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:52:47.843693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:52:47.843693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:52:47.843693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:52:47.843693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:52:47.843693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:52:47.843693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:52:47.843693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:52:47.843693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:52:47.845723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:52:47.845723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:52:47.845723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:52:47.845723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:52:47.845723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:52:47.845723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:52:47.845723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:52:47.845723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:52:47.845723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:52:47.845723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:52:47.845723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:52:47.845723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:52:47.845723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 608/1195] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:52:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:52:47.850951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee5d02-3896-4405-8be4-75dcf6fb4094 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:47.973326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee5d02-3896-4405-8be4-75dcf6fb4094 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:48.007478 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe80b5-cb5c-48dc-ae2c-3d38f73ab1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:48.008150 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe80b5-cb5c-48dc-ae2c-3d38f73ab1e8 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:48.008430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe80b5-cb5c-48dc-ae2c-3d38f73ab1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:48.008704 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe80b5-cb5c-48dc-ae2c-3d38f73ab1e8 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:48.009455 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe80b5-cb5c-48dc-ae2c-3d38f73ab1e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:52:48.009757 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe80b5-cb5c-48dc-ae2c-3d38f73ab1e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:48.011237 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe80b5-cb5c-48dc-ae2c-3d38f73ab1e8 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:48.022103 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 588/1196] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:52:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:48.028008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c01b5-a914-471e-a751-fd3a46dd6d00 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:48.132727 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c01b5-a914-471e-a751-fd3a46dd6d00 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:48.166562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e15c9-d28f-474a-b15b-7187ba03afde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:48.167471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e15c9-d28f-474a-b15b-7187ba03afde None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:48.167751 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e15c9-d28f-474a-b15b-7187ba03afde None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:48.168020 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e15c9-d28f-474a-b15b-7187ba03afde None admin] PATH_INFO: `/v3/users/c045bb6bfcd74f4f8ef138d86b88c5f4` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:48.169809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e15c9-d28f-474a-b15b-7187ba03afde None admin] RBAC: Authorizing `identity:get_user(user_id=c045bb6bfcd74f4f8ef138d86b88c5f4)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:48.171354 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e15c9-d28f-474a-b15b-7187ba03afde None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:48.172985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 609/1197] 10.222.0.73 () {56 vars in 1177 bytes} [Fri May 13 14:52:48 2022] GET /identity/v3/users/c045bb6bfcd74f4f8ef138d86b88c5f4 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:52:48.179422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe80b5-cb5c-48dc-ae2c-3d38f73ab1e8 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:48.282188 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe80b5-cb5c-48dc-ae2c-3d38f73ab1e8 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:48.331911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b87cf-7d7e-4f23-abb6-74745221cc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:48.332845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b87cf-7d7e-4f23-abb6-74745221cc34 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:48.333239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b87cf-7d7e-4f23-abb6-74745221cc34 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:48.333618 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b87cf-7d7e-4f23-abb6-74745221cc34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:48.431662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b87cf-7d7e-4f23-abb6-74745221cc34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:48.433709 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b87cf-7d7e-4f23-abb6-74745221cc34 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:48.551208 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 589/1198] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:52:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 13 14:52:48.561586 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e15c9-d28f-474a-b15b-7187ba03afde None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:48.713036 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e15c9-d28f-474a-b15b-7187ba03afde None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:48.748071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551d8de-2ad4-4390-ab7a-6bfd8f7ff546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:48.749049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551d8de-2ad4-4390-ab7a-6bfd8f7ff546 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:48.749415 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551d8de-2ad4-4390-ab7a-6bfd8f7ff546 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:48.749788 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551d8de-2ad4-4390-ab7a-6bfd8f7ff546 None admin] PATH_INFO: `/v3/projects/4dc484bab35b41b38fce7cd0ca06664e` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:48.751199 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551d8de-2ad4-4390-ab7a-6bfd8f7ff546 None admin] RBAC: Authorizing `identity:get_project(project_id=4dc484bab35b41b38fce7cd0ca06664e)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:48.752822 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551d8de-2ad4-4390-ab7a-6bfd8f7ff546 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:48.754570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 610/1199] 10.222.0.73 () {56 vars in 1186 bytes} [Fri May 13 14:52:48 2022] GET /identity/v3/projects/4dc484bab35b41b38fce7cd0ca06664e => generated 361 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:52:48.760896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b87cf-7d7e-4f23-abb6-74745221cc34 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:52:48.865916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b87cf-7d7e-4f23-abb6-74745221cc34 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:52:48.902622 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bf788-f680-4dd6-90fe-90763dd2def1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:52:48.903883 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bf788-f680-4dd6-90fe-90763dd2def1 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:52:48.904166 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bf788-f680-4dd6-90fe-90763dd2def1 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:52:48.904438 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bf788-f680-4dd6-90fe-90763dd2def1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:52:48.905283 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434bf788-f680-4dd6-90fe-90763dd2def1 None admin] RBAC: Adding query filter params (role.id=b6fbf976763d4795afbfb53a09ec6f6c, scope.project.id=4dc484bab35b41b38fce7cd0ca06664e, user.id=c045bb6bfcd74f4f8ef138d86b88c5f4) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:52:48.905593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434bf788-f680-4dd6-90fe-90763dd2def1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:52:48.907078 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434bf788-f680-4dd6-90fe-90763dd2def1 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:52:48.913596 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 590/1200] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:52:48 2022] GET /identity/v3/role_assignments?user.id=c045bb6bfcd74f4f8ef138d86b88c5f4&scope.project.id=4dc484bab35b41b38fce7cd0ca06664e&role.id=b6fbf976763d4795afbfb53a09ec6f6c => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:53:55.275520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b2ec6-626e-4c89-82b1-055381e94b12 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:55.276273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b2ec6-626e-4c89-82b1-055381e94b12 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:55.276273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b2ec6-626e-4c89-82b1-055381e94b12 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:55.277665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 611/1201] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:53:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:53:55.284364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95332e5f-a5c8-4291-b201-9a53e7463f15 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:55.284916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95332e5f-a5c8-4291-b201-9a53e7463f15 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:55.284916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95332e5f-a5c8-4291-b201-9a53e7463f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:55.304964 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-95332e5f-a5c8-4291-b201-9a53e7463f15 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:55.306170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-95332e5f-a5c8-4291-b201-9a53e7463f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:55.401009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 591/1202] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:53:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:53:55.427285 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b2ec6-626e-4c89-82b1-055381e94b12 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:55.599072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b2ec6-626e-4c89-82b1-055381e94b12 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:55.665904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4b109-08d6-4ff3-9013-f9af9a4f9cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:55.667362 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4b109-08d6-4ff3-9013-f9af9a4f9cef None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:55.668166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4b109-08d6-4ff3-9013-f9af9a4f9cef None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:55.668777 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4b109-08d6-4ff3-9013-f9af9a4f9cef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:55.692263 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4b109-08d6-4ff3-9013-f9af9a4f9cef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:55.695065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4b109-08d6-4ff3-9013-f9af9a4f9cef None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:55.731032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-3fd4b109-08d6-4ff3-9013-f9af9a4f9cef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:53:55.731032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:53:55.731032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:53:55.731032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:53:55.731032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:53:55.731032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:53:55.731032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:53:55.731032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:53:55.731032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:53:55.731032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:53:55.731032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:53:55.731032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:53:55.731032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:53:55.731032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:53:55.731032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:53:55.732133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:53:55.732133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:53:55.732133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:53:55.732133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:53:55.732133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:53:55.732133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:53:55.732133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:53:55.732133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:53:55.732133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:53:55.732133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:53:55.732133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:53:55.732133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:53:55.732133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:53:55.732133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:53:55.732133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:53:55.732133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:53:55.732133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:53:55.733168 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:53:55.733168 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:53:55.733168 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:53:55.733168 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:53:55.733425 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 612/1203] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:53:55.740711 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95332e5f-a5c8-4291-b201-9a53e7463f15 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:55.890150 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95332e5f-a5c8-4291-b201-9a53e7463f15 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:55.935008 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3441ab3-b0de-44ab-9380-5b71fd366a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:55.936060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3441ab3-b0de-44ab-9380-5b71fd366a93 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:55.936407 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3441ab3-b0de-44ab-9380-5b71fd366a93 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:55.936746 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3441ab3-b0de-44ab-9380-5b71fd366a93 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:55.937580 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3441ab3-b0de-44ab-9380-5b71fd366a93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:53:55.937949 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3441ab3-b0de-44ab-9380-5b71fd366a93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:55.939464 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3441ab3-b0de-44ab-9380-5b71fd366a93 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:55.953956 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 592/1204] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:53:55.962067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4b109-08d6-4ff3-9013-f9af9a4f9cef None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:56.138206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4b109-08d6-4ff3-9013-f9af9a4f9cef None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:56.195739 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18146fdb-0e52-43d3-b8b9-2048a57e4b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:56.196783 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18146fdb-0e52-43d3-b8b9-2048a57e4b05 None admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:56.197321 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18146fdb-0e52-43d3-b8b9-2048a57e4b05 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:56.197882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18146fdb-0e52-43d3-b8b9-2048a57e4b05 None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:56.198843 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18146fdb-0e52-43d3-b8b9-2048a57e4b05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:53:56.200631 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18146fdb-0e52-43d3-b8b9-2048a57e4b05 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:53:56.246936 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 613/1205] 10.222.0.73 () {60 vars in 1132 bytes} [Fri May 13 14:53:55 2022] POST /identity/v3/users => generated 251 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:53:59.578371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af301810-cd87-475f-bb1a-4f9fb49903d6 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:59.579873 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af301810-cd87-475f-bb1a-4f9fb49903d6 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:59.579873 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af301810-cd87-475f-bb1a-4f9fb49903d6 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:59.581949 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 593/1206] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:53:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:53:59.590228 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27bbf4-316a-4587-a3a7-919e7709306b None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:59.591004 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27bbf4-316a-4587-a3a7-919e7709306b None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:59.591174 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27bbf4-316a-4587-a3a7-919e7709306b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:59.614702 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-ff27bbf4-316a-4587-a3a7-919e7709306b None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:53:59.616515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ff27bbf4-316a-4587-a3a7-919e7709306b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:53:59.729745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 614/1207] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:53:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:53:59.764217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af301810-cd87-475f-bb1a-4f9fb49903d6 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:53:59.928918 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af301810-cd87-475f-bb1a-4f9fb49903d6 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:53:59.975417 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e5c4e-b6db-4313-932e-e5db014dc055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:53:59.976307 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e5c4e-b6db-4313-932e-e5db014dc055 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:53:59.977327 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e5c4e-b6db-4313-932e-e5db014dc055 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:53:59.977766 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e5c4e-b6db-4313-932e-e5db014dc055 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:53:59.998866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e5c4e-b6db-4313-932e-e5db014dc055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:54:00.007838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-2e0e5c4e-b6db-4313-932e-e5db014dc055 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:54:00.007838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:00.007838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:00.007838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:00.007838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:00.007838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:00.007838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:00.007838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:00.007838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:00.007838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:00.007838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:00.007838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:00.007838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:54:00.007838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:54:00.007838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:54:00.007838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:54:00.015467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:54:00.015467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:54:00.015467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:54:00.015467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:54:00.015467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:00.015467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:00.015467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:00.015467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:00.015467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:00.015467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:00.015467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:00.015467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:54:00.015467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:00.015467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:00.015467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:00.015467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:00.016708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:00.016708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:00.016708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:00.016708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:00.016708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:54:00.016708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:54:00.016708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:54:00.016708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:54:00.016708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:54:00.016708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:54:00.016708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:54:00.016708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:00.016708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 594/1208] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:53:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:00.017480 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27bbf4-316a-4587-a3a7-919e7709306b None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:00.170189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27bbf4-316a-4587-a3a7-919e7709306b None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:00.226593 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa1019-6b0e-4c49-85e2-07dfeb6dd1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:00.227673 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa1019-6b0e-4c49-85e2-07dfeb6dd1ec None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:00.228066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa1019-6b0e-4c49-85e2-07dfeb6dd1ec None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:00.228528 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa1019-6b0e-4c49-85e2-07dfeb6dd1ec None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:00.229606 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa1019-6b0e-4c49-85e2-07dfeb6dd1ec None admin] RBAC: Adding query filter params (name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:00.230123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa1019-6b0e-4c49-85e2-07dfeb6dd1ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:00.232344 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa1019-6b0e-4c49-85e2-07dfeb6dd1ec None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:00.245001 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 615/1209] 10.222.0.73 () {56 vars in 1103 bytes} [Fri May 13 14:54:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:00.251446 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e5c4e-b6db-4313-932e-e5db014dc055 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:00.427310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e5c4e-b6db-4313-932e-e5db014dc055 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:00.480935 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d0535-b619-462c-a635-80abc47dd13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:00.482266 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d0535-b619-462c-a635-80abc47dd13d None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:00.482764 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d0535-b619-462c-a635-80abc47dd13d None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:00.483298 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d0535-b619-462c-a635-80abc47dd13d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:00.503302 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d0535-b619-462c-a635-80abc47dd13d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:00.506057 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d0535-b619-462c-a635-80abc47dd13d None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:00.539543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-5f4d0535-b619-462c-a635-80abc47dd13d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:00.539543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:00.539543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:00.539543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:00.539543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:00.539543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:00.539543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:00.539543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:00.539543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:00.539543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:00.539543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:00.539543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:00.539543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:54:00.539543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:54:00.539543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:54:00.540589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:54:00.540589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:00.540589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:00.540589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:00.540589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:00.540589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:00.540589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:00.540589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:00.540589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:54:00.540589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:00.540589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:00.540589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:00.540589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:00.540589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:00.540589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:00.540589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:00.540589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:00.541509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:54:00.541509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:54:00.541509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:00.541509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:00.541760 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 595/1210] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:00.550017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa1019-6b0e-4c49-85e2-07dfeb6dd1ec None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:00.712118 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa1019-6b0e-4c49-85e2-07dfeb6dd1ec None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:00.758660 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c190c-2330-4914-aa86-5d7f273dbbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:00.758660 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c190c-2330-4914-aa86-5d7f273dbbc7 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:00.758660 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c190c-2330-4914-aa86-5d7f273dbbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:00.758660 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c190c-2330-4914-aa86-5d7f273dbbc7 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:00.759736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c190c-2330-4914-aa86-5d7f273dbbc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:00.760243 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c190c-2330-4914-aa86-5d7f273dbbc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:00.762778 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c190c-2330-4914-aa86-5d7f273dbbc7 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:00.785399 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 616/1211] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:00.791983 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d0535-b619-462c-a635-80abc47dd13d None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:00.954610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d0535-b619-462c-a635-80abc47dd13d None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:01.009512 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a0b24-118c-4d0a-a45b-9ba7b71f414d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:01.010310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a0b24-118c-4d0a-a45b-9ba7b71f414d None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:01.010593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a0b24-118c-4d0a-a45b-9ba7b71f414d None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:01.010911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a0b24-118c-4d0a-a45b-9ba7b71f414d None admin] PATH_INFO: `/v3/users/placement` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:01.022173 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a0b24-118c-4d0a-a45b-9ba7b71f414d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:01.024133 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a0b24-118c-4d0a-a45b-9ba7b71f414d None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:01.047071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-c80a0b24-118c-4d0a-a45b-9ba7b71f414d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 14:54:01.047071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:01.047071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:01.047071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:01.047071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:01.047071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:01.047071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:01.047071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:01.047071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:01.047071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:01.047071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:01.047071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:01.047071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:54:01.047071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:54:01.047071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:54:01.047071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:54:01.048190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:01.048190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:01.048190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:54:01.048190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:54:01.048190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:54:01.048190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:54:01.048190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:01.048190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:01.048190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:01.048190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:01.048190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:01.048190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:54:01.048190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:01.048190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:01.048190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:01.048190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:01.048190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:01.048190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:01.049186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:01.049186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:01.049186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:54:01.049186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:54:01.049186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:54:01.049186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:54:01.049186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:54:01.049186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:54:01.049186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 14:54:01.049186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:01.055602 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 596/1212] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:54:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:01.057889 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c190c-2330-4914-aa86-5d7f273dbbc7 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:01.204229 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c190c-2330-4914-aa86-5d7f273dbbc7 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:01.260624 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01c903-d299-4661-ab94-34565d2e7bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:01.261697 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01c903-d299-4661-ab94-34565d2e7bba None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:01.262184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01c903-d299-4661-ab94-34565d2e7bba None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:01.262654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01c903-d299-4661-ab94-34565d2e7bba None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:01.264339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01c903-d299-4661-ab94-34565d2e7bba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:01.264864 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01c903-d299-4661-ab94-34565d2e7bba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:01.267735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01c903-d299-4661-ab94-34565d2e7bba None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:01.304389 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 617/1213] 10.222.0.73 () {56 vars in 1143 bytes} [Fri May 13 14:54:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:01.313796 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a0b24-118c-4d0a-a45b-9ba7b71f414d None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:01.498110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a0b24-118c-4d0a-a45b-9ba7b71f414d None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:01.548439 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9062bf-dd5f-4372-b478-fa8f8a8e0948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:01.549343 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9062bf-dd5f-4372-b478-fa8f8a8e0948 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:01.549828 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9062bf-dd5f-4372-b478-fa8f8a8e0948 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:01.550262 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9062bf-dd5f-4372-b478-fa8f8a8e0948 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:01.705106 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9062bf-dd5f-4372-b478-fa8f8a8e0948 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:01.708325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9062bf-dd5f-4372-b478-fa8f8a8e0948 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:01.901995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 597/1214] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:54:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 13 14:54:01.911889 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01c903-d299-4661-ab94-34565d2e7bba None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:02.086306 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01c903-d299-4661-ab94-34565d2e7bba None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:02.149947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88d77c-da76-4ad7-98ce-fd66072ca8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:02.151362 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88d77c-da76-4ad7-98ce-fd66072ca8c1 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:02.151876 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88d77c-da76-4ad7-98ce-fd66072ca8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:02.152427 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88d77c-da76-4ad7-98ce-fd66072ca8c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:02.172728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88d77c-da76-4ad7-98ce-fd66072ca8c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:02.175531 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88d77c-da76-4ad7-98ce-fd66072ca8c1 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:02.214935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-ed88d77c-da76-4ad7-98ce-fd66072ca8c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:02.214935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:02.214935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:02.214935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:02.214935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:02.214935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:02.214935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:02.214935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:02.214935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:02.214935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:02.214935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:02.214935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:02.214935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:54:02.214935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:54:02.214935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:54:02.216536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:54:02.216536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:02.216536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:02.216536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:02.216536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:02.216536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:02.216536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:02.216536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:02.216536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:54:02.216536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:02.216536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:02.216536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:02.216536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:02.216536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:02.216536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:02.216536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:02.216536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:02.218325 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:54:02.218325 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:54:02.218325 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:02.218325 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:54:02.218325 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 618/1215] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:54:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:02.230184 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9062bf-dd5f-4372-b478-fa8f8a8e0948 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:02.403730 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9062bf-dd5f-4372-b478-fa8f8a8e0948 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:02.466907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd70169-c0d2-444f-9907-282a7f76cef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:02.468069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd70169-c0d2-444f-9907-282a7f76cef3 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:02.468566 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd70169-c0d2-444f-9907-282a7f76cef3 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:02.469046 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd70169-c0d2-444f-9907-282a7f76cef3 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:02.470433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd70169-c0d2-444f-9907-282a7f76cef3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:02.471012 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd70169-c0d2-444f-9907-282a7f76cef3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:02.474207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd70169-c0d2-444f-9907-282a7f76cef3 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:02.491367 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 598/1216] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:02.501041 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88d77c-da76-4ad7-98ce-fd66072ca8c1 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:02.685301 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88d77c-da76-4ad7-98ce-fd66072ca8c1 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:02.746835 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b854123-0f21-45cc-9ede-863279220007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:02.748133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b854123-0f21-45cc-9ede-863279220007 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:02.748624 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b854123-0f21-45cc-9ede-863279220007 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:02.749072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b854123-0f21-45cc-9ede-863279220007 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:02.761783 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b854123-0f21-45cc-9ede-863279220007 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:02.764372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b854123-0f21-45cc-9ede-863279220007 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:02.791814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-5b854123-0f21-45cc-9ede-863279220007 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:54:02.791814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:02.791814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:02.791814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:02.791814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:02.791814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:02.791814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:02.791814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:02.791814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:02.791814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:02.791814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:02.791814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:02.791814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:54:02.791814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:54:02.791814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:54:02.793826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:54:02.793826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:02.793826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:02.793826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:02.793826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:02.793826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:02.793826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:02.793826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:02.793826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:54:02.793826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:02.793826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:02.793826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:02.793826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:02.793826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:02.793826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:02.793826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:02.793826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:02.795169 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:54:02.795169 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:54:02.795169 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:54:02.795169 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:54:02.795169 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:54:02.795169 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:54:02.795169 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:54:02.795169 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:54:02.798048 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 619/1217] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:54:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:02.809754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd70169-c0d2-444f-9907-282a7f76cef3 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:02.962331 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd70169-c0d2-444f-9907-282a7f76cef3 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:03.016603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f20995-7137-48bc-a435-7cdf6f392e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:03.017553 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f20995-7137-48bc-a435-7cdf6f392e85 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:03.018034 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f20995-7137-48bc-a435-7cdf6f392e85 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:03.018358 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f20995-7137-48bc-a435-7cdf6f392e85 None admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:03.019583 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f20995-7137-48bc-a435-7cdf6f392e85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:03.020109 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f20995-7137-48bc-a435-7cdf6f392e85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:03.022924 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f20995-7137-48bc-a435-7cdf6f392e85 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:03.043767 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 599/1218] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:54:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:03.050616 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b854123-0f21-45cc-9ede-863279220007 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:03.192115 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b854123-0f21-45cc-9ede-863279220007 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:03.245783 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62025f26-2dfa-47c0-9d46-d777a9aa274d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:03.246942 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62025f26-2dfa-47c0-9d46-d777a9aa274d None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:03.247430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62025f26-2dfa-47c0-9d46-d777a9aa274d None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:03.247990 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62025f26-2dfa-47c0-9d46-d777a9aa274d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:03.249746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62025f26-2dfa-47c0-9d46-d777a9aa274d None admin] RBAC: Adding query filter params (role.id=354a460a8146476989f8a7b4fc1aac93, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=908d23b035f14756b438b3a61a63b2cd) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:03.250329 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62025f26-2dfa-47c0-9d46-d777a9aa274d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:03.253167 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62025f26-2dfa-47c0-9d46-d777a9aa274d None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:03.274859 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 620/1219] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:54:03 2022] GET /identity/v3/role_assignments?user.id=908d23b035f14756b438b3a61a63b2cd&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=354a460a8146476989f8a7b4fc1aac93 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:54:05.990962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471224b-4b2c-4b8f-8e57-592cfac9b005 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:05.991531 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471224b-4b2c-4b8f-8e57-592cfac9b005 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:05.992114 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471224b-4b2c-4b8f-8e57-592cfac9b005 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:05.995141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 600/1220] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:54:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:54:06.001326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb0e5a-e375-484e-b551-73235a9e8693 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:06.002114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb0e5a-e375-484e-b551-73235a9e8693 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:06.002281 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb0e5a-e375-484e-b551-73235a9e8693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:06.022731 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-abdb0e5a-e375-484e-b551-73235a9e8693 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:06.025158 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-abdb0e5a-e375-484e-b551-73235a9e8693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:06.136555 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 621/1221] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:54:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:54:06.181732 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471224b-4b2c-4b8f-8e57-592cfac9b005 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:06.373255 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471224b-4b2c-4b8f-8e57-592cfac9b005 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:06.417714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd1564-01e5-451e-9166-19361988e570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:06.423755 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd1564-01e5-451e-9166-19361988e570 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:06.423755 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd1564-01e5-451e-9166-19361988e570 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:06.423755 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd1564-01e5-451e-9166-19361988e570 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:06.432061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd1564-01e5-451e-9166-19361988e570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:54:06.442430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-28dd1564-01e5-451e-9166-19361988e570 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:54:06.442430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:06.442430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:06.442430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:06.442430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:06.442430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:06.442430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:06.442430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:06.442430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:06.442430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:06.442430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:06.442430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:06.442430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:54:06.442430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:54:06.442430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:54:06.442430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:54:06.443819 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:54:06.443819 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:54:06.443819 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:54:06.443819 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:54:06.443819 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:06.443819 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:06.443819 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:06.443819 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:06.443819 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:06.443819 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:06.443819 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:06.443819 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:54:06.443819 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:06.443819 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:06.443819 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:06.443819 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:06.444987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:06.444987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:06.444987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:06.444987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:06.444987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:54:06.444987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:54:06.444987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:54:06.444987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:54:06.444987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:54:06.444987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:54:06.444987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:54:06.444987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:06.444987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 601/1222] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:54:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:06.451671 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb0e5a-e375-484e-b551-73235a9e8693 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:06.593767 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb0e5a-e375-484e-b551-73235a9e8693 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:06.636770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5340fdb-97b0-4274-8021-983f40c4f052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:06.637468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5340fdb-97b0-4274-8021-983f40c4f052 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:06.637746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5340fdb-97b0-4274-8021-983f40c4f052 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:06.638025 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5340fdb-97b0-4274-8021-983f40c4f052 None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:06.638797 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5340fdb-97b0-4274-8021-983f40c4f052 None admin] RBAC: Adding query filter params (name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:06.639138 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5340fdb-97b0-4274-8021-983f40c4f052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:06.640553 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5340fdb-97b0-4274-8021-983f40c4f052 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:06.650558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 622/1223] 10.222.0.73 () {56 vars in 1103 bytes} [Fri May 13 14:54:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:06.659525 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd1564-01e5-451e-9166-19361988e570 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:06.806587 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd1564-01e5-451e-9166-19361988e570 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:06.858422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af870ea-5f07-42a2-b5d2-1a3f0f53fc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:06.859836 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af870ea-5f07-42a2-b5d2-1a3f0f53fc21 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:06.860306 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af870ea-5f07-42a2-b5d2-1a3f0f53fc21 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:06.860480 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af870ea-5f07-42a2-b5d2-1a3f0f53fc21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:06.879546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af870ea-5f07-42a2-b5d2-1a3f0f53fc21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:06.882857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af870ea-5f07-42a2-b5d2-1a3f0f53fc21 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:06.921148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-9af870ea-5f07-42a2-b5d2-1a3f0f53fc21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:06.921148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:06.921148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:06.921148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:06.921148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:06.921148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:06.921148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:06.921148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:06.921148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:06.921148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:06.921148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:06.921148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:06.921148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:54:06.921148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:54:06.921148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:54:06.922978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:54:06.922978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:06.922978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:06.922978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:06.922978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:06.922978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:06.922978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:06.922978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:06.922978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:54:06.922978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:06.922978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:06.922978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:06.922978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:06.922978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:06.922978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:06.922978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:06.922978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:06.924795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:54:06.924795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:54:06.924795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:06.924795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:06.924795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 602/1224] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:54:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:06.930312 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5340fdb-97b0-4274-8021-983f40c4f052 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:07.050235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5340fdb-97b0-4274-8021-983f40c4f052 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:07.092722 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67558160-713d-4b2f-9822-2fffc6f75531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:07.093532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67558160-713d-4b2f-9822-2fffc6f75531 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:07.093816 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67558160-713d-4b2f-9822-2fffc6f75531 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:07.094140 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67558160-713d-4b2f-9822-2fffc6f75531 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:07.094867 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67558160-713d-4b2f-9822-2fffc6f75531 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:07.095238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67558160-713d-4b2f-9822-2fffc6f75531 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:07.096597 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67558160-713d-4b2f-9822-2fffc6f75531 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:07.111584 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 623/1225] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:54:07.117822 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af870ea-5f07-42a2-b5d2-1a3f0f53fc21 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:07.273549 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af870ea-5f07-42a2-b5d2-1a3f0f53fc21 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:07.328611 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4639f-c141-47a9-9e80-d5ec4458b786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:07.329611 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4639f-c141-47a9-9e80-d5ec4458b786 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:07.329985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4639f-c141-47a9-9e80-d5ec4458b786 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:07.330362 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4639f-c141-47a9-9e80-d5ec4458b786 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:07.340740 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4639f-c141-47a9-9e80-d5ec4458b786 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:07.342374 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4639f-c141-47a9-9e80-d5ec4458b786 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:07.360338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-42b4639f-c141-47a9-9e80-d5ec4458b786 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 14:54:07.360338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:07.360338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:07.360338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:07.360338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:07.360338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:07.360338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:07.360338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:07.360338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:07.360338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:07.360338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:07.360338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:07.360338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:54:07.360338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:54:07.360338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:54:07.360338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:54:07.362418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:07.362418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:07.362418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:54:07.362418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:54:07.362418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:54:07.362418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:54:07.362418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:07.362418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:07.362418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:07.362418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:07.362418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:07.362418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:54:07.362418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:07.362418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:07.362418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:07.362418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:07.362418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:07.362418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:07.364551 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:07.364551 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:07.364551 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:54:07.364551 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:54:07.364551 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:54:07.364551 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:54:07.364551 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:54:07.364551 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:54:07.364551 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 14:54:07.364551 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:07.364551 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 603/1226] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:54:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:54:07.372850 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67558160-713d-4b2f-9822-2fffc6f75531 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:07.519830 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67558160-713d-4b2f-9822-2fffc6f75531 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:07.575811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20289a-a07d-4282-bc02-1b6ec25eb5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:07.576642 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20289a-a07d-4282-bc02-1b6ec25eb5fa None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:07.576976 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20289a-a07d-4282-bc02-1b6ec25eb5fa None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:07.577221 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20289a-a07d-4282-bc02-1b6ec25eb5fa None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:07.578177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20289a-a07d-4282-bc02-1b6ec25eb5fa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:07.578608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20289a-a07d-4282-bc02-1b6ec25eb5fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:07.580447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20289a-a07d-4282-bc02-1b6ec25eb5fa None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:07.609362 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 624/1227] 10.222.0.73 () {56 vars in 1143 bytes} [Fri May 13 14:54:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:07.619435 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4639f-c141-47a9-9e80-d5ec4458b786 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:07.782947 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4639f-c141-47a9-9e80-d5ec4458b786 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:07.840661 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf85776-bf18-41ae-b1aa-dbd1a2a03fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:07.841546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf85776-bf18-41ae-b1aa-dbd1a2a03fc3 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:07.841847 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf85776-bf18-41ae-b1aa-dbd1a2a03fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:07.842158 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf85776-bf18-41ae-b1aa-dbd1a2a03fc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:07.861224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf85776-bf18-41ae-b1aa-dbd1a2a03fc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:07.863080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf85776-bf18-41ae-b1aa-dbd1a2a03fc3 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:07.892557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-daf85776-bf18-41ae-b1aa-dbd1a2a03fc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:07.892557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:07.892557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:07.892557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:07.892557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:07.892557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:07.892557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:07.892557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:07.892557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:07.892557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:07.892557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:07.892557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:07.892557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:54:07.892557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:54:07.892557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:54:07.894722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:54:07.894722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:07.894722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:07.894722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:07.894722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:07.894722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:07.894722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:07.894722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:07.894722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:54:07.894722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:07.894722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:07.894722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:07.894722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:07.894722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:07.894722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:07.894722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:07.894722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:07.896040 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:54:07.896040 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:54:07.896040 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:07.896040 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:07.896040 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 604/1228] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:54:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:07.901198 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20289a-a07d-4282-bc02-1b6ec25eb5fa None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:08.054803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20289a-a07d-4282-bc02-1b6ec25eb5fa None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:08.120353 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736d5e3-4177-4095-832d-09d1a337d3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:08.121503 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736d5e3-4177-4095-832d-09d1a337d3c7 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:08.122092 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736d5e3-4177-4095-832d-09d1a337d3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:08.122543 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736d5e3-4177-4095-832d-09d1a337d3c7 None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:08.123809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736d5e3-4177-4095-832d-09d1a337d3c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:08.124323 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736d5e3-4177-4095-832d-09d1a337d3c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:08.126908 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736d5e3-4177-4095-832d-09d1a337d3c7 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:08.154543 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 625/1229] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:08.156456 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf85776-bf18-41ae-b1aa-dbd1a2a03fc3 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:08.326518 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf85776-bf18-41ae-b1aa-dbd1a2a03fc3 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:08.370606 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1830-d589-4b10-baea-72cc73e527a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:08.371993 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1830-d589-4b10-baea-72cc73e527a8 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:08.372472 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1830-d589-4b10-baea-72cc73e527a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:08.372968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1830-d589-4b10-baea-72cc73e527a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:08.384304 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c1830-d589-4b10-baea-72cc73e527a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:08.386508 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c1830-d589-4b10-baea-72cc73e527a8 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:08.418812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-942c1830-d589-4b10-baea-72cc73e527a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:54:08.418812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:08.418812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:08.418812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:08.418812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:08.418812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:08.418812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:08.418812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:08.418812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:08.418812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:08.418812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:08.418812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:08.418812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:54:08.418812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:54:08.418812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:54:08.420246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:54:08.420246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:08.420246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:08.420246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:08.420246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:08.420246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:08.420246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:08.420246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:08.420246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:54:08.420246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:08.420246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:08.420246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:08.420246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:08.420246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:08.420246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:08.420246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:08.420246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:08.421342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:54:08.421342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:54:08.421342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:54:08.421342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:54:08.421342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:54:08.421342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:54:08.421342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:54:08.421342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:08.421342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 605/1230] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:54:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:08.432962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736d5e3-4177-4095-832d-09d1a337d3c7 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:08.590722 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736d5e3-4177-4095-832d-09d1a337d3c7 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:08.640236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86b52f-23d3-403d-8232-f8f33acacac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:08.641534 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86b52f-23d3-403d-8232-f8f33acacac0 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:08.641998 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86b52f-23d3-403d-8232-f8f33acacac0 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:08.642458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86b52f-23d3-403d-8232-f8f33acacac0 None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:08.643791 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86b52f-23d3-403d-8232-f8f33acacac0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:08.644236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86b52f-23d3-403d-8232-f8f33acacac0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:08.646461 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86b52f-23d3-403d-8232-f8f33acacac0 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:08.663318 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 626/1231] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:54:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:08.671429 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1830-d589-4b10-baea-72cc73e527a8 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:08.806497 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1830-d589-4b10-baea-72cc73e527a8 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:08.860656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c075a83-0fcf-417d-86e3-5cb56207edd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:08.861751 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c075a83-0fcf-417d-86e3-5cb56207edd8 None admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:08.862057 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c075a83-0fcf-417d-86e3-5cb56207edd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:08.862414 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c075a83-0fcf-417d-86e3-5cb56207edd8 None admin] PATH_INFO: `/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/908d23b035f14756b438b3a61a63b2cd/roles/354a460a8146476989f8a7b4fc1aac93` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:08.881571 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c075a83-0fcf-417d-86e3-5cb56207edd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=48788e7517a14ca5b5af9f161512ac9c, user_id=908d23b035f14756b438b3a61a63b2cd, role_id=354a460a8146476989f8a7b4fc1aac93)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:08.884649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c075a83-0fcf-417d-86e3-5cb56207edd8 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:08.901475 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 606/1232] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:54:08 2022] PUT /identity/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/908d23b035f14756b438b3a61a63b2cd/roles/354a460a8146476989f8a7b4fc1aac93 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:12.352288 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1795e-b0ee-4cd4-95f5-fbcf0821d290 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:12.353236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1795e-b0ee-4cd4-95f5-fbcf0821d290 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:12.353236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1795e-b0ee-4cd4-95f5-fbcf0821d290 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:12.358921 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 627/1233] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:54:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:54:12.363872 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba568317-1639-4e81-a6e8-cf1e38faa5f0 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:12.364779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba568317-1639-4e81-a6e8-cf1e38faa5f0 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:12.364779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba568317-1639-4e81-a6e8-cf1e38faa5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:12.388454 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-ba568317-1639-4e81-a6e8-cf1e38faa5f0 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:12.390300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ba568317-1639-4e81-a6e8-cf1e38faa5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:12.494863 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 607/1234] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:54:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:54:12.526643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1795e-b0ee-4cd4-95f5-fbcf0821d290 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:12.685593 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1795e-b0ee-4cd4-95f5-fbcf0821d290 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:12.737695 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6aa960-f855-4474-82d9-29e8517f4daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:12.738703 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aa960-f855-4474-82d9-29e8517f4daa None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:12.739226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aa960-f855-4474-82d9-29e8517f4daa None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:12.739661 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aa960-f855-4474-82d9-29e8517f4daa None admin] PATH_INFO: `/v3/roles/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:12.755036 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6aa960-f855-4474-82d9-29e8517f4daa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:54:12.763119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-6e6aa960-f855-4474-82d9-29e8517f4daa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 14:54:12.763119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:12.763119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:12.763119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:12.763119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:12.763119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:12.763119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:12.763119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:12.763119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:12.763119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:12.763119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:12.763119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:12.763119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:54:12.763119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:54:12.763119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:54:12.763119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:54:12.764948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:54:12.764948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:54:12.764948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:54:12.764948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:54:12.764948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:12.764948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:12.764948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:12.764948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:12.764948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:12.764948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:12.764948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:12.764948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:54:12.764948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:12.764948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:12.764948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:12.764948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:12.766034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:12.766034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:12.766034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:12.766034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:12.766034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:54:12.766034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:54:12.766034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:54:12.766034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:54:12.766034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:54:12.766034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:54:12.766034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 14:54:12.766034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:54:12.766034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 628/1235] 10.222.0.73 () {56 vars in 1102 bytes} [Fri May 13 14:54:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:12.775316 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba568317-1639-4e81-a6e8-cf1e38faa5f0 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:12.938194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba568317-1639-4e81-a6e8-cf1e38faa5f0 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:12.993519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fa357-5e62-44ed-8877-0b3fd06dee73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:12.994316 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fa357-5e62-44ed-8877-0b3fd06dee73 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:12.994656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fa357-5e62-44ed-8877-0b3fd06dee73 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:12.995059 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fa357-5e62-44ed-8877-0b3fd06dee73 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:12.995898 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fa357-5e62-44ed-8877-0b3fd06dee73 None admin] RBAC: Adding query filter params (name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:12.996293 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fa357-5e62-44ed-8877-0b3fd06dee73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:12.997952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fa357-5e62-44ed-8877-0b3fd06dee73 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:13.009954 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 608/1236] 10.222.0.73 () {56 vars in 1103 bytes} [Fri May 13 14:54:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:13.016161 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6aa960-f855-4474-82d9-29e8517f4daa None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:13.129194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6aa960-f855-4474-82d9-29e8517f4daa None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:13.179693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559d5ec-4160-4d4b-a06f-da49bf4534ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:13.181051 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559d5ec-4160-4d4b-a06f-da49bf4534ee None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:13.181527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559d5ec-4160-4d4b-a06f-da49bf4534ee None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:13.181968 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559d5ec-4160-4d4b-a06f-da49bf4534ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:13.204240 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559d5ec-4160-4d4b-a06f-da49bf4534ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:13.206959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559d5ec-4160-4d4b-a06f-da49bf4534ee None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:13.242314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-a559d5ec-4160-4d4b-a06f-da49bf4534ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:13.242314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:13.242314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:13.242314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:13.242314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:13.242314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:13.242314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:13.242314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:13.242314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:13.242314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:13.242314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:13.242314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:13.242314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:54:13.242314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:54:13.242314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:54:13.243447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:54:13.243447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:13.243447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:13.243447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:13.243447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:13.243447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:13.243447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:13.243447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:13.243447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:54:13.243447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:13.243447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:13.243447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:13.243447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:13.243447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:13.243447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:13.243447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:13.243447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:13.244714 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:54:13.244714 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:54:13.244714 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:13.244714 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:54:13.244714 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 629/1237] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:54:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:54:13.252360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fa357-5e62-44ed-8877-0b3fd06dee73 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:13.395207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fa357-5e62-44ed-8877-0b3fd06dee73 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:13.441423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219e05b-8709-4e83-8d05-1e8281b42427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:13.442219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219e05b-8709-4e83-8d05-1e8281b42427 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:13.442663 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219e05b-8709-4e83-8d05-1e8281b42427 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:13.443124 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219e05b-8709-4e83-8d05-1e8281b42427 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:13.444340 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219e05b-8709-4e83-8d05-1e8281b42427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:13.445257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219e05b-8709-4e83-8d05-1e8281b42427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:13.447260 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219e05b-8709-4e83-8d05-1e8281b42427 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:13.467010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 609/1238] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:54:13.470302 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559d5ec-4160-4d4b-a06f-da49bf4534ee None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:13.613630 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559d5ec-4160-4d4b-a06f-da49bf4534ee None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:13.666179 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e10d20-3c8a-483a-b276-aa182e9e7dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:13.667587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e10d20-3c8a-483a-b276-aa182e9e7dd3 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:13.668084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e10d20-3c8a-483a-b276-aa182e9e7dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:13.668423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e10d20-3c8a-483a-b276-aa182e9e7dd3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:13.681892 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e10d20-3c8a-483a-b276-aa182e9e7dd3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:13.684089 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e10d20-3c8a-483a-b276-aa182e9e7dd3 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:13.706343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-b0e10d20-3c8a-483a-b276-aa182e9e7dd3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 14:54:13.706343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:13.706343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:13.706343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:13.706343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:13.706343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:13.706343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:13.706343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:13.706343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:13.706343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:13.706343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:13.706343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:13.706343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:54:13.706343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:54:13.706343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:54:13.706343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:54:13.708726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:13.708726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:13.708726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:54:13.708726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:54:13.708726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:54:13.708726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:54:13.708726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:13.708726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:13.708726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:13.708726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:13.708726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:13.708726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:54:13.708726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:13.708726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:13.708726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:13.708726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:13.708726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:13.708726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:13.710184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:13.710184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:13.710184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:54:13.710184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:54:13.710184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:54:13.710184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:54:13.710184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:54:13.710184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:54:13.710184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 14:54:13.710184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:54:13.710184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 630/1239] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:54:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:13.715482 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219e05b-8709-4e83-8d05-1e8281b42427 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:13.879866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219e05b-8709-4e83-8d05-1e8281b42427 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:13.943288 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8ad3b-9f2c-4831-a782-e2ac19f2db7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:13.945064 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8ad3b-9f2c-4831-a782-e2ac19f2db7c None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:13.945521 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8ad3b-9f2c-4831-a782-e2ac19f2db7c None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:13.945941 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8ad3b-9f2c-4831-a782-e2ac19f2db7c None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:13.947181 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8ad3b-9f2c-4831-a782-e2ac19f2db7c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:13.947638 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8ad3b-9f2c-4831-a782-e2ac19f2db7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:13.949752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8ad3b-9f2c-4831-a782-e2ac19f2db7c None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:13.985586 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 610/1240] 10.222.0.73 () {56 vars in 1143 bytes} [Fri May 13 14:54:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:13.991817 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e10d20-3c8a-483a-b276-aa182e9e7dd3 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:14.142431 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e10d20-3c8a-483a-b276-aa182e9e7dd3 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:14.186612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ceea0-3991-4bda-973a-676e8fe6cb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:14.187916 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ceea0-3991-4bda-973a-676e8fe6cb5c None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:14.188438 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ceea0-3991-4bda-973a-676e8fe6cb5c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:14.188961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ceea0-3991-4bda-973a-676e8fe6cb5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:14.301110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ceea0-3991-4bda-973a-676e8fe6cb5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:14.303557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ceea0-3991-4bda-973a-676e8fe6cb5c None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:14.455351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 631/1241] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:54:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:54:14.464466 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8ad3b-9f2c-4831-a782-e2ac19f2db7c None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:14.618841 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8ad3b-9f2c-4831-a782-e2ac19f2db7c None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:14.672879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98d4fa-7a46-45b5-be9c-6b3634bfa363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:14.674366 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98d4fa-7a46-45b5-be9c-6b3634bfa363 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:14.674931 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98d4fa-7a46-45b5-be9c-6b3634bfa363 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:14.675494 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98d4fa-7a46-45b5-be9c-6b3634bfa363 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:14.690801 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98d4fa-7a46-45b5-be9c-6b3634bfa363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:14.692829 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98d4fa-7a46-45b5-be9c-6b3634bfa363 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:14.717977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-df98d4fa-7a46-45b5-be9c-6b3634bfa363 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:14.717977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:14.717977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:14.717977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:14.717977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:14.717977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:14.717977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:14.717977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:14.717977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:14.717977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:14.717977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:14.717977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:14.717977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:54:14.717977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:54:14.717977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:54:14.719529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:54:14.719529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:14.719529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:14.719529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:14.719529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:14.719529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:14.719529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:14.719529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:14.719529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:54:14.719529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:14.719529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:14.719529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:14.719529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:14.719529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:14.719529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:14.719529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:14.719529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:14.721315 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:54:14.721315 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:54:14.721315 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:14.721315 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:14.721315 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 611/1242] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:54:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:54:14.728248 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ceea0-3991-4bda-973a-676e8fe6cb5c None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:14.885176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ceea0-3991-4bda-973a-676e8fe6cb5c None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:14.937798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d63a4-3e07-45d6-baa8-cf9cc7a9f03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:14.938796 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d63a4-3e07-45d6-baa8-cf9cc7a9f03a None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:14.939267 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d63a4-3e07-45d6-baa8-cf9cc7a9f03a None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:14.939730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d63a4-3e07-45d6-baa8-cf9cc7a9f03a None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:14.940650 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d63a4-3e07-45d6-baa8-cf9cc7a9f03a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:14.941123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d63a4-3e07-45d6-baa8-cf9cc7a9f03a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:14.943235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d63a4-3e07-45d6-baa8-cf9cc7a9f03a None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:14.959509 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 632/1243] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:14.967689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98d4fa-7a46-45b5-be9c-6b3634bfa363 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:15.110696 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98d4fa-7a46-45b5-be9c-6b3634bfa363 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:15.157663 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d265aa-5793-4e7b-8b8e-ba90e48de324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:15.158679 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d265aa-5793-4e7b-8b8e-ba90e48de324 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:15.159208 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d265aa-5793-4e7b-8b8e-ba90e48de324 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:15.159711 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d265aa-5793-4e7b-8b8e-ba90e48de324 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:15.168764 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d265aa-5793-4e7b-8b8e-ba90e48de324 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:15.170600 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d265aa-5793-4e7b-8b8e-ba90e48de324 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:15.188575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-32d265aa-5793-4e7b-8b8e-ba90e48de324 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:54:15.188575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:15.188575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:15.188575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:15.188575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:15.188575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:15.188575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:15.188575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:15.188575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:15.188575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:15.188575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:15.188575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:15.188575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:54:15.188575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:54:15.188575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:54:15.190204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:54:15.190204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:15.190204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:15.190204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:15.190204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:15.190204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:15.190204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:15.190204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:15.190204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:54:15.190204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:15.190204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:15.190204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:15.190204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:15.190204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:15.190204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:15.190204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:15.190204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:15.191487 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:54:15.191487 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:54:15.191487 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:54:15.191487 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:54:15.191487 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:54:15.191487 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:54:15.191487 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:54:15.191487 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:15.191487 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 612/1244] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:54:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:15.198744 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d63a4-3e07-45d6-baa8-cf9cc7a9f03a None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:15.356677 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d63a4-3e07-45d6-baa8-cf9cc7a9f03a None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:15.406339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385834b4-81e0-4c20-bdb1-b07d5434499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:15.407285 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385834b4-81e0-4c20-bdb1-b07d5434499f None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:15.407736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385834b4-81e0-4c20-bdb1-b07d5434499f None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:15.408183 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385834b4-81e0-4c20-bdb1-b07d5434499f None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:15.409630 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385834b4-81e0-4c20-bdb1-b07d5434499f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:15.410131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385834b4-81e0-4c20-bdb1-b07d5434499f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:15.412315 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385834b4-81e0-4c20-bdb1-b07d5434499f None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:15.430279 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 633/1245] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:54:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:54:15.438424 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d265aa-5793-4e7b-8b8e-ba90e48de324 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:15.594021 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d265aa-5793-4e7b-8b8e-ba90e48de324 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:15.654062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5af01-fd58-4458-b2dd-bad126a7cc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:15.654929 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5af01-fd58-4458-b2dd-bad126a7cc90 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:15.655346 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5af01-fd58-4458-b2dd-bad126a7cc90 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:15.655799 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5af01-fd58-4458-b2dd-bad126a7cc90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:15.656907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5af01-fd58-4458-b2dd-bad126a7cc90 None admin] RBAC: Adding query filter params (role.id=354a460a8146476989f8a7b4fc1aac93, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=908d23b035f14756b438b3a61a63b2cd) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:15.657347 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5af01-fd58-4458-b2dd-bad126a7cc90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:15.659348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5af01-fd58-4458-b2dd-bad126a7cc90 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:15.670452 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 613/1246] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:54:15 2022] GET /identity/v3/role_assignments?user.id=908d23b035f14756b438b3a61a63b2cd&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=354a460a8146476989f8a7b4fc1aac93 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:18.419533 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edbd0c-7d84-4c60-b124-a24c6e18e589 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:18.420381 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edbd0c-7d84-4c60-b124-a24c6e18e589 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:18.420381 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edbd0c-7d84-4c60-b124-a24c6e18e589 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:18.421466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 634/1247] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:54:18.429286 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136b501-521a-492d-94d7-86cc2762fc53 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:18.429860 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136b501-521a-492d-94d7-86cc2762fc53 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:18.430295 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136b501-521a-492d-94d7-86cc2762fc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:18.461272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-4136b501-521a-492d-94d7-86cc2762fc53 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:18.463419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-4136b501-521a-492d-94d7-86cc2762fc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:18.591098 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 614/1248] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:54:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:54:18.627013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edbd0c-7d84-4c60-b124-a24c6e18e589 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:18.794797 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edbd0c-7d84-4c60-b124-a24c6e18e589 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:18.842385 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e5f3a-bb41-4f63-ab53-86213e628c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:18.843240 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e5f3a-bb41-4f63-ab53-86213e628c1b None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:18.843519 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e5f3a-bb41-4f63-ab53-86213e628c1b None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:18.843791 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e5f3a-bb41-4f63-ab53-86213e628c1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:18.859282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e5f3a-bb41-4f63-ab53-86213e628c1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:54:18.868513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-ba3e5f3a-bb41-4f63-ab53-86213e628c1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:54:18.868513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:18.868513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:18.868513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:18.868513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:18.868513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:18.868513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:18.868513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:18.868513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:18.868513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:18.868513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:18.868513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:18.868513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:54:18.868513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:54:18.868513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:54:18.868513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:54:18.870587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:54:18.870587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:54:18.870587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:54:18.870587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:54:18.870587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:18.870587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:18.870587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:18.870587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:18.870587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:18.870587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:18.870587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:18.870587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:54:18.870587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:18.870587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:18.870587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:18.870587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:18.872600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:18.872600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:18.872600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:18.872600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:18.872600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:54:18.872600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:54:18.872600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:54:18.872600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:54:18.872600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:54:18.872600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:54:18.872600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:54:18.872600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:54:18.872600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 635/1249] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:54:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:18.878298 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136b501-521a-492d-94d7-86cc2762fc53 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:19.025008 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136b501-521a-492d-94d7-86cc2762fc53 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:19.082535 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89676a7-c9e1-441a-bb9d-ee5ea9621d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:19.083788 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89676a7-c9e1-441a-bb9d-ee5ea9621d69 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:19.084373 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89676a7-c9e1-441a-bb9d-ee5ea9621d69 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:19.084958 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89676a7-c9e1-441a-bb9d-ee5ea9621d69 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:19.086447 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89676a7-c9e1-441a-bb9d-ee5ea9621d69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:19.087000 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89676a7-c9e1-441a-bb9d-ee5ea9621d69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:19.090072 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89676a7-c9e1-441a-bb9d-ee5ea9621d69 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:19.107219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 615/1250] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:54:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:54:19.113443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e5f3a-bb41-4f63-ab53-86213e628c1b None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:19.264193 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e5f3a-bb41-4f63-ab53-86213e628c1b None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:19.321119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9563699-f681-49e6-9dbc-3d43b8dc28cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:19.322128 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9563699-f681-49e6-9dbc-3d43b8dc28cc None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:19.322514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9563699-f681-49e6-9dbc-3d43b8dc28cc None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:19.322933 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9563699-f681-49e6-9dbc-3d43b8dc28cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:19.338707 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9563699-f681-49e6-9dbc-3d43b8dc28cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:19.341301 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9563699-f681-49e6-9dbc-3d43b8dc28cc None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:19.366393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-b9563699-f681-49e6-9dbc-3d43b8dc28cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:19.366393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:19.366393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:19.366393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:19.366393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:19.366393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:19.366393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:19.366393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:19.366393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:19.366393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:19.366393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:19.366393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:19.366393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:54:19.366393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:54:19.366393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:54:19.368334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:54:19.368334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:19.368334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:19.368334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:19.368334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:19.368334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:19.368334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:19.368334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:19.368334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:54:19.368334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:19.368334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:19.368334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:19.368334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:19.368334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:19.368334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:19.368334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:19.368334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:19.370985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:54:19.370985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:54:19.370985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:19.370985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:54:19.370985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 636/1251] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:54:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:19.377641 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89676a7-c9e1-441a-bb9d-ee5ea9621d69 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:19.529599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89676a7-c9e1-441a-bb9d-ee5ea9621d69 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:19.593117 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b583ae2-b3ee-41d9-8ba2-711b01e96231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:19.594110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b583ae2-b3ee-41d9-8ba2-711b01e96231 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:19.594562 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b583ae2-b3ee-41d9-8ba2-711b01e96231 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:19.595088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b583ae2-b3ee-41d9-8ba2-711b01e96231 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:19.596480 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b583ae2-b3ee-41d9-8ba2-711b01e96231 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:19.597026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b583ae2-b3ee-41d9-8ba2-711b01e96231 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:19.599709 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b583ae2-b3ee-41d9-8ba2-711b01e96231 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:19.622233 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 616/1252] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:19.629564 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9563699-f681-49e6-9dbc-3d43b8dc28cc None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:19.787342 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9563699-f681-49e6-9dbc-3d43b8dc28cc None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:19.841087 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7686ea5-e105-4d2d-913e-6c4f3b6811b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:19.842117 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7686ea5-e105-4d2d-913e-6c4f3b6811b7 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:19.842614 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7686ea5-e105-4d2d-913e-6c4f3b6811b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:19.842963 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7686ea5-e105-4d2d-913e-6c4f3b6811b7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:19.853063 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7686ea5-e105-4d2d-913e-6c4f3b6811b7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:19.854665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7686ea5-e105-4d2d-913e-6c4f3b6811b7 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:19.875307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-e7686ea5-e105-4d2d-913e-6c4f3b6811b7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 14:54:19.875307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:19.875307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:19.875307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:19.875307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:19.875307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:19.875307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:19.875307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:19.875307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:19.875307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:19.875307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:19.875307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:19.875307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:54:19.875307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:54:19.875307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:54:19.875307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:54:19.876560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:19.876560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:19.876560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:54:19.876560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:54:19.876560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:54:19.876560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:54:19.876560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:19.876560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:19.876560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:19.876560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:19.876560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:19.876560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:54:19.876560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:19.876560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:19.876560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:19.876560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:19.876560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:19.876560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:19.877688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:19.877688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:19.877688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:54:19.877688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:54:19.877688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:54:19.877688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:54:19.877688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:54:19.877688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:54:19.877688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 14:54:19.877688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:54:19.877688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 637/1253] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:54:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:54:19.885438 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b583ae2-b3ee-41d9-8ba2-711b01e96231 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:20.034666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b583ae2-b3ee-41d9-8ba2-711b01e96231 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:20.091308 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca7a39-e0d0-408e-bd18-491731ce9954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:20.092446 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca7a39-e0d0-408e-bd18-491731ce9954 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:20.092939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca7a39-e0d0-408e-bd18-491731ce9954 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:20.093424 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca7a39-e0d0-408e-bd18-491731ce9954 None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:20.095052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca7a39-e0d0-408e-bd18-491731ce9954 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:20.095590 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca7a39-e0d0-408e-bd18-491731ce9954 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:20.098259 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca7a39-e0d0-408e-bd18-491731ce9954 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:20.124308 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 617/1254] 10.222.0.73 () {56 vars in 1143 bytes} [Fri May 13 14:54:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:20.130922 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7686ea5-e105-4d2d-913e-6c4f3b6811b7 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:20.296335 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7686ea5-e105-4d2d-913e-6c4f3b6811b7 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:20.357511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa27ff4-5a16-4660-8373-956c1b7c95f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:20.358572 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa27ff4-5a16-4660-8373-956c1b7c95f5 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:20.359243 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa27ff4-5a16-4660-8373-956c1b7c95f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:20.359762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa27ff4-5a16-4660-8373-956c1b7c95f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:20.456859 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa27ff4-5a16-4660-8373-956c1b7c95f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:20.458964 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa27ff4-5a16-4660-8373-956c1b7c95f5 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:20.611056 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 638/1255] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:54:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:54:20.618805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca7a39-e0d0-408e-bd18-491731ce9954 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:20.737536 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca7a39-e0d0-408e-bd18-491731ce9954 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:20.779948 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b24a6-fc9f-4eab-ac98-6d3fdc2fcb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:20.781047 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b24a6-fc9f-4eab-ac98-6d3fdc2fcb55 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:20.781404 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b24a6-fc9f-4eab-ac98-6d3fdc2fcb55 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:20.781807 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b24a6-fc9f-4eab-ac98-6d3fdc2fcb55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:20.798493 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b24a6-fc9f-4eab-ac98-6d3fdc2fcb55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:20.801188 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b24a6-fc9f-4eab-ac98-6d3fdc2fcb55 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:20.829088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-486b24a6-fc9f-4eab-ac98-6d3fdc2fcb55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:20.829088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:20.829088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:20.829088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:20.829088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:20.829088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:20.829088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:20.829088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:20.829088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:20.829088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:20.829088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:20.829088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:20.829088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:54:20.829088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:54:20.829088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:54:20.831141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:54:20.831141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:20.831141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:20.831141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:20.831141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:20.831141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:20.831141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:20.831141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:20.831141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:54:20.831141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:20.831141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:20.831141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:20.831141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:20.831141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:20.831141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:20.831141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:20.831141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:20.833092 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:54:20.833092 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:54:20.833092 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:20.833092 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:20.833092 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 618/1256] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:54:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:54:20.839490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa27ff4-5a16-4660-8373-956c1b7c95f5 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:20.985921 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa27ff4-5a16-4660-8373-956c1b7c95f5 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:21.028067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2e388-63f3-4fb6-ba12-53b972be059c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:21.028721 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2e388-63f3-4fb6-ba12-53b972be059c None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:21.029060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2e388-63f3-4fb6-ba12-53b972be059c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:21.029391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2e388-63f3-4fb6-ba12-53b972be059c None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:21.030217 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2e388-63f3-4fb6-ba12-53b972be059c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:21.030590 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2e388-63f3-4fb6-ba12-53b972be059c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:21.032153 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2e388-63f3-4fb6-ba12-53b972be059c None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:21.046326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 639/1257] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:21.052730 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b24a6-fc9f-4eab-ac98-6d3fdc2fcb55 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:21.175009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b24a6-fc9f-4eab-ac98-6d3fdc2fcb55 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:21.216569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd951d26-b10c-469c-b2e1-9fab8956ad24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:21.217502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd951d26-b10c-469c-b2e1-9fab8956ad24 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:21.217841 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd951d26-b10c-469c-b2e1-9fab8956ad24 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:21.218174 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd951d26-b10c-469c-b2e1-9fab8956ad24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:21.227294 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd951d26-b10c-469c-b2e1-9fab8956ad24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:21.228891 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd951d26-b10c-469c-b2e1-9fab8956ad24 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:21.245126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-bd951d26-b10c-469c-b2e1-9fab8956ad24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:54:21.245126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:21.245126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:21.245126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:21.245126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:21.245126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:21.245126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:21.245126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:21.245126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:21.245126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:21.245126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:21.245126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:21.245126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:54:21.245126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:54:21.245126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:54:21.247167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:54:21.247167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:21.247167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:21.247167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:21.247167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:21.247167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:21.247167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:21.247167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:21.247167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:54:21.247167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:21.247167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:21.247167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:21.247167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:21.247167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:21.247167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:21.247167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:21.247167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:21.249141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:54:21.249141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:54:21.249141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:54:21.249141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:54:21.249141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:54:21.249141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:54:21.249141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:54:21.249141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:21.249141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 619/1258] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:54:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:54:21.254432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2e388-63f3-4fb6-ba12-53b972be059c None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:21.379336 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2e388-63f3-4fb6-ba12-53b972be059c None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:21.421037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836bafc-0663-4390-922d-865b8aa600b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:21.422052 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836bafc-0663-4390-922d-865b8aa600b8 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:21.422487 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836bafc-0663-4390-922d-865b8aa600b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:21.422984 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836bafc-0663-4390-922d-865b8aa600b8 None admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:21.424343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836bafc-0663-4390-922d-865b8aa600b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:21.424751 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836bafc-0663-4390-922d-865b8aa600b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:21.426525 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836bafc-0663-4390-922d-865b8aa600b8 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:21.440421 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 640/1259] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:54:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:21.447904 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd951d26-b10c-469c-b2e1-9fab8956ad24 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:21.584811 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd951d26-b10c-469c-b2e1-9fab8956ad24 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:21.635119 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47134a3b-715a-43bb-ae43-daa76814a905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:21.636011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47134a3b-715a-43bb-ae43-daa76814a905 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:21.636011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47134a3b-715a-43bb-ae43-daa76814a905 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:21.636399 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47134a3b-715a-43bb-ae43-daa76814a905 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:21.637310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47134a3b-715a-43bb-ae43-daa76814a905 None admin] RBAC: Adding query filter params (role.id=b6fbf976763d4795afbfb53a09ec6f6c, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=908d23b035f14756b438b3a61a63b2cd) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:21.637677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47134a3b-715a-43bb-ae43-daa76814a905 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:21.640053 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47134a3b-715a-43bb-ae43-daa76814a905 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:21.648580 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 620/1260] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:54:21 2022] GET /identity/v3/role_assignments?user.id=908d23b035f14756b438b3a61a63b2cd&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=b6fbf976763d4795afbfb53a09ec6f6c => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:23.977103 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cace3c-dce6-43f6-af84-354458311dad None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:23.978767 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cace3c-dce6-43f6-af84-354458311dad None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:23.979736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cace3c-dce6-43f6-af84-354458311dad None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:23.981782 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 641/1261] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:54:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:54:23.989792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592e4a0-0ed2-4135-8ef0-2944c419e381 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:23.990354 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592e4a0-0ed2-4135-8ef0-2944c419e381 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:23.990452 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592e4a0-0ed2-4135-8ef0-2944c419e381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:24.009761 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-6592e4a0-0ed2-4135-8ef0-2944c419e381 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:24.011049 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6592e4a0-0ed2-4135-8ef0-2944c419e381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:24.087528 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 621/1262] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:54:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:54:24.129486 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cace3c-dce6-43f6-af84-354458311dad None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:24.311211 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cace3c-dce6-43f6-af84-354458311dad None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:24.373298 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc10f82-197b-444d-83e8-c4f261957b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:24.374671 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc10f82-197b-444d-83e8-c4f261957b71 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:24.375181 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc10f82-197b-444d-83e8-c4f261957b71 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:24.375669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc10f82-197b-444d-83e8-c4f261957b71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:24.396370 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc10f82-197b-444d-83e8-c4f261957b71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:54:24.412304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-dcc10f82-197b-444d-83e8-c4f261957b71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:54:24.412304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:24.412304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:24.412304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:24.412304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:24.412304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:24.412304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:24.412304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:24.412304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:24.412304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:24.412304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:24.412304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:24.412304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:54:24.412304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:54:24.412304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:54:24.412304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:54:24.413518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:54:24.413518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:54:24.413518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:54:24.413518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:54:24.413518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:24.413518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:24.413518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:24.413518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:24.413518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:24.413518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:24.413518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:24.413518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:54:24.413518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:24.413518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:24.413518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:24.413518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:24.414566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:24.414566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:24.414566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:24.414566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:24.414566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:54:24.414566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:54:24.414566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:54:24.414566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:54:24.414566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:54:24.414566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:54:24.414566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:54:24.414566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:54:24.415302 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 642/1263] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:54:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:24.421076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592e4a0-0ed2-4135-8ef0-2944c419e381 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:24.529504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592e4a0-0ed2-4135-8ef0-2944c419e381 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:24.571454 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36572f0-57cb-4f7d-a088-912b5a27fb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:24.572180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36572f0-57cb-4f7d-a088-912b5a27fb48 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:24.572474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36572f0-57cb-4f7d-a088-912b5a27fb48 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:24.573004 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36572f0-57cb-4f7d-a088-912b5a27fb48 None admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:24.573802 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36572f0-57cb-4f7d-a088-912b5a27fb48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:24.574122 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36572f0-57cb-4f7d-a088-912b5a27fb48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:24.575714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36572f0-57cb-4f7d-a088-912b5a27fb48 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:24.602249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 622/1264] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:54:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:24.603710 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc10f82-197b-444d-83e8-c4f261957b71 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:24.713717 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc10f82-197b-444d-83e8-c4f261957b71 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:24.749577 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3de27c-624b-42b2-b8a2-786730c929c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:24.750381 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3de27c-624b-42b2-b8a2-786730c929c4 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:24.750662 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3de27c-624b-42b2-b8a2-786730c929c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:24.750971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3de27c-624b-42b2-b8a2-786730c929c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:24.765469 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3de27c-624b-42b2-b8a2-786730c929c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:24.767085 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3de27c-624b-42b2-b8a2-786730c929c4 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:24.792045 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-7e3de27c-624b-42b2-b8a2-786730c929c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:24.792045 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:24.792045 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:24.792045 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:24.792045 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:24.792045 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:24.792045 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:24.792045 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:24.792045 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:24.792045 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:24.792045 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:24.792045 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:24.792045 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:54:24.792045 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:54:24.792045 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:54:24.793699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:54:24.793699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:24.793699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:24.793699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:24.793699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:24.793699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:24.793699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:24.793699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:24.793699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:54:24.793699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:24.793699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:24.793699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:24.793699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:24.793699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:24.793699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:24.793699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:24.793699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:24.795085 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:54:24.795085 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:54:24.795085 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:24.795085 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:54:24.795085 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 643/1265] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:54:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:54:24.799394 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36572f0-57cb-4f7d-a088-912b5a27fb48 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:24.927885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36572f0-57cb-4f7d-a088-912b5a27fb48 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:24.964803 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121b8db-c81c-4ac4-9839-a38632786ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:24.965476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121b8db-c81c-4ac4-9839-a38632786ad2 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:24.965763 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121b8db-c81c-4ac4-9839-a38632786ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:24.966040 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121b8db-c81c-4ac4-9839-a38632786ad2 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:24.966762 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121b8db-c81c-4ac4-9839-a38632786ad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:24.967098 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121b8db-c81c-4ac4-9839-a38632786ad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:24.968484 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121b8db-c81c-4ac4-9839-a38632786ad2 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:24.981136 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 623/1266] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:54:24.989885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3de27c-624b-42b2-b8a2-786730c929c4 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:25.091992 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3de27c-624b-42b2-b8a2-786730c929c4 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:25.127229 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c026d0d-fbcd-4662-b58e-6746e99baf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:25.128038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c026d0d-fbcd-4662-b58e-6746e99baf39 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:25.128314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c026d0d-fbcd-4662-b58e-6746e99baf39 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:25.128581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c026d0d-fbcd-4662-b58e-6746e99baf39 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:25.137855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c026d0d-fbcd-4662-b58e-6746e99baf39 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:25.140122 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c026d0d-fbcd-4662-b58e-6746e99baf39 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:25.156013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-0c026d0d-fbcd-4662-b58e-6746e99baf39 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 14:54:25.156013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:25.156013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:25.156013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:25.156013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:25.156013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:25.156013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:25.156013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:25.156013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:25.156013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:25.156013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:25.156013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:25.156013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:54:25.156013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:54:25.156013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:54:25.156013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:54:25.157905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:25.157905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:25.157905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:54:25.157905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:54:25.157905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:54:25.157905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:54:25.157905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:25.157905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:25.157905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:25.157905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:25.157905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:25.157905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:54:25.157905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:25.157905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:25.157905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:25.157905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:25.157905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:25.157905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:25.159833 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:25.159833 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:25.159833 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:54:25.159833 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:54:25.159833 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:54:25.159833 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:54:25.159833 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:54:25.159833 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:54:25.159833 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 14:54:25.159833 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:54:25.159833 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 644/1267] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:54:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:25.169437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121b8db-c81c-4ac4-9839-a38632786ad2 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:25.286148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121b8db-c81c-4ac4-9839-a38632786ad2 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:25.322685 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467aaad-b02b-4eb5-a619-d8a5535afe43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:25.323457 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467aaad-b02b-4eb5-a619-d8a5535afe43 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:25.323782 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467aaad-b02b-4eb5-a619-d8a5535afe43 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:25.324097 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467aaad-b02b-4eb5-a619-d8a5535afe43 None admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:25.324985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467aaad-b02b-4eb5-a619-d8a5535afe43 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:25.325333 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467aaad-b02b-4eb5-a619-d8a5535afe43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:25.326862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467aaad-b02b-4eb5-a619-d8a5535afe43 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:25.347241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 624/1268] 10.222.0.73 () {56 vars in 1143 bytes} [Fri May 13 14:54:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:25.353219 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c026d0d-fbcd-4662-b58e-6746e99baf39 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:25.467632 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c026d0d-fbcd-4662-b58e-6746e99baf39 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:25.507145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9d588-9617-49a5-b207-e501ecb3705c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:25.508013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9d588-9617-49a5-b207-e501ecb3705c None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:25.508333 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9d588-9617-49a5-b207-e501ecb3705c None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:25.508645 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9d588-9617-49a5-b207-e501ecb3705c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:25.520371 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9d588-9617-49a5-b207-e501ecb3705c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:25.521866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9d588-9617-49a5-b207-e501ecb3705c None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:25.541562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-d7c9d588-9617-49a5-b207-e501ecb3705c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:25.541562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:25.541562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:25.541562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:25.541562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:25.541562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:25.541562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:25.541562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:25.541562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:25.541562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:25.541562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:25.541562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:25.541562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:54:25.541562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:54:25.541562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:54:25.543235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:54:25.543235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:25.543235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:25.543235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:25.543235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:25.543235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:25.543235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:25.543235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:25.543235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:54:25.543235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:25.543235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:25.543235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:25.543235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:25.543235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:25.543235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:25.543235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:25.543235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:25.544989 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:54:25.544989 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:54:25.544989 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:25.544989 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:54:25.544989 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 645/1269] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:25.549840 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467aaad-b02b-4eb5-a619-d8a5535afe43 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:25.664333 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467aaad-b02b-4eb5-a619-d8a5535afe43 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:25.699368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998b843-c045-4f7a-be85-fdd870871ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:25.700100 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998b843-c045-4f7a-be85-fdd870871ec7 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:25.700421 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998b843-c045-4f7a-be85-fdd870871ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:25.700736 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998b843-c045-4f7a-be85-fdd870871ec7 None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:25.701510 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998b843-c045-4f7a-be85-fdd870871ec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:25.701857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998b843-c045-4f7a-be85-fdd870871ec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:25.703334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998b843-c045-4f7a-be85-fdd870871ec7 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:25.715674 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 625/1270] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:25.722026 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9d588-9617-49a5-b207-e501ecb3705c None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:25.828368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9d588-9617-49a5-b207-e501ecb3705c None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:25.864675 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757fbe8-53d1-40df-9593-28edec3b21bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:25.865521 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757fbe8-53d1-40df-9593-28edec3b21bf None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:25.865798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757fbe8-53d1-40df-9593-28edec3b21bf None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:25.866068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757fbe8-53d1-40df-9593-28edec3b21bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:25.874579 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757fbe8-53d1-40df-9593-28edec3b21bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:25.876207 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757fbe8-53d1-40df-9593-28edec3b21bf None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:25.892794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-3757fbe8-53d1-40df-9593-28edec3b21bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:54:25.892794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:25.892794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:25.892794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:25.892794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:25.892794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:25.892794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:25.892794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:25.892794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:25.892794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:25.892794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:25.892794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:25.892794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:54:25.892794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:54:25.892794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:54:25.894542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:54:25.894542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:25.894542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:25.894542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:25.894542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:25.894542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:25.894542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:25.894542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:25.894542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:54:25.894542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:25.894542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:25.894542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:25.894542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:25.894542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:25.894542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:25.894542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:25.894542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:25.896238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:54:25.896238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:54:25.896238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:54:25.896238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:54:25.896238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:54:25.896238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:54:25.896238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:54:25.896238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:54:25.896238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 646/1271] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:54:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:25.901246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998b843-c045-4f7a-be85-fdd870871ec7 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:26.053073 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998b843-c045-4f7a-be85-fdd870871ec7 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:26.088536 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd5db9-ba09-47b8-820b-d9e9513d11b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:26.089120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd5db9-ba09-47b8-820b-d9e9513d11b9 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:26.089402 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd5db9-ba09-47b8-820b-d9e9513d11b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:26.089677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd5db9-ba09-47b8-820b-d9e9513d11b9 None admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:26.090464 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd5db9-ba09-47b8-820b-d9e9513d11b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:26.090772 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd5db9-ba09-47b8-820b-d9e9513d11b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:26.092327 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd5db9-ba09-47b8-820b-d9e9513d11b9 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:26.106125 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 626/1272] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:54:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:26.112494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757fbe8-53d1-40df-9593-28edec3b21bf None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:26.217747 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757fbe8-53d1-40df-9593-28edec3b21bf None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:26.253594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd58fc-836d-4de3-b55d-488dc92f405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:26.254485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd58fc-836d-4de3-b55d-488dc92f405a None admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:26.254765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd58fc-836d-4de3-b55d-488dc92f405a None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:26.255067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd58fc-836d-4de3-b55d-488dc92f405a None admin] PATH_INFO: `/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/908d23b035f14756b438b3a61a63b2cd/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:26.257093 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd58fc-836d-4de3-b55d-488dc92f405a None admin] RBAC: Authorizing `identity:create_grant(project_id=48788e7517a14ca5b5af9f161512ac9c, user_id=908d23b035f14756b438b3a61a63b2cd, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:26.258534 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd58fc-836d-4de3-b55d-488dc92f405a None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:26.272458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 647/1273] 10.222.0.73 () {58 vars in 1439 bytes} [Fri May 13 14:54:26 2022] PUT /identity/v3/projects/48788e7517a14ca5b5af9f161512ac9c/users/908d23b035f14756b438b3a61a63b2cd/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 14:54:28.573828 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2136cb-e874-46d8-a624-bf1730cdc252 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:28.574426 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2136cb-e874-46d8-a624-bf1730cdc252 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:28.574426 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2136cb-e874-46d8-a624-bf1730cdc252 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:28.575843 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 627/1274] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:54:28.586317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ae36f-4a12-41ca-a137-1ae3a0ca8714 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:28.587116 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ae36f-4a12-41ca-a137-1ae3a0ca8714 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:28.588414 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ae36f-4a12-41ca-a137-1ae3a0ca8714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:28.626662 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-0a5ae36f-4a12-41ca-a137-1ae3a0ca8714 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:28.629514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-0a5ae36f-4a12-41ca-a137-1ae3a0ca8714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:28.718198 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 648/1275] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:54:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 14:54:28.743900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2136cb-e874-46d8-a624-bf1730cdc252 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:28.909249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2136cb-e874-46d8-a624-bf1730cdc252 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:28.947109 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3e042-469b-4218-b5d9-54a2bf2b584b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:28.947990 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3e042-469b-4218-b5d9-54a2bf2b584b None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:28.948309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3e042-469b-4218-b5d9-54a2bf2b584b None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:28.948636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3e042-469b-4218-b5d9-54a2bf2b584b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:28.961285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3e042-469b-4218-b5d9-54a2bf2b584b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 14:54:28.969164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-3db3e042-469b-4218-b5d9-54a2bf2b584b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:54:28.969164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:28.969164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:28.969164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:28.969164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:28.969164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:28.969164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:28.969164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:28.969164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:28.969164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:28.969164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:28.969164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:28.969164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 14:54:28.969164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 14:54:28.969164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 14:54:28.969164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 14:54:28.971009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 14:54:28.971009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 14:54:28.971009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 14:54:28.971009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 14:54:28.971009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:28.971009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:28.971009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:28.971009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:28.971009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:28.971009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:28.971009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:28.971009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:54:28.971009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:28.971009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:28.971009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:28.971009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:28.972701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:28.972701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:28.972701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:28.972701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:28.972701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 14:54:28.972701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 14:54:28.972701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 14:54:28.972701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 14:54:28.972701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 14:54:28.972701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 14:54:28.972701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 14:54:28.972701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:28.972701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 628/1276] 10.222.0.73 () {56 vars in 1096 bytes} [Fri May 13 14:54:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:28.977457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ae36f-4a12-41ca-a137-1ae3a0ca8714 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:29.089069 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ae36f-4a12-41ca-a137-1ae3a0ca8714 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:29.125862 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c04203-9f72-4873-9ff8-ac06ce6fb0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:29.126598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c04203-9f72-4873-9ff8-ac06ce6fb0ce None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:29.126908 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c04203-9f72-4873-9ff8-ac06ce6fb0ce None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:29.127199 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c04203-9f72-4873-9ff8-ac06ce6fb0ce None admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:29.127971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c04203-9f72-4873-9ff8-ac06ce6fb0ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:29.128277 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c04203-9f72-4873-9ff8-ac06ce6fb0ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:29.129678 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c04203-9f72-4873-9ff8-ac06ce6fb0ce None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:29.139543 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 649/1277] 10.222.0.73 () {56 vars in 1099 bytes} [Fri May 13 14:54:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:29.149105 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3e042-469b-4218-b5d9-54a2bf2b584b None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:29.253028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3e042-469b-4218-b5d9-54a2bf2b584b None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:29.289610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434aabe-de7d-4091-8c7b-d9f0ab747f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:29.290427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434aabe-de7d-4091-8c7b-d9f0ab747f70 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:29.290709 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434aabe-de7d-4091-8c7b-d9f0ab747f70 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:29.291023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434aabe-de7d-4091-8c7b-d9f0ab747f70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:29.303715 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434aabe-de7d-4091-8c7b-d9f0ab747f70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:29.305233 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434aabe-de7d-4091-8c7b-d9f0ab747f70 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:29.324281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-5434aabe-de7d-4091-8c7b-d9f0ab747f70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:29.324281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:29.324281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:29.324281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:29.324281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:29.324281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:29.324281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:29.324281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:29.324281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:29.324281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:29.324281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:29.324281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:29.324281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:54:29.324281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:54:29.324281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:54:29.326080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:54:29.326080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:29.326080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:29.326080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:29.326080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:29.326080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:29.326080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:29.326080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:29.326080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:54:29.326080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:29.326080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:29.326080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:29.326080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:29.326080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:29.326080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:29.326080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:29.326080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:29.328049 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:54:29.328049 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:54:29.328049 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:29.328049 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:29.328049 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 629/1278] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:54:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:29.332771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c04203-9f72-4873-9ff8-ac06ce6fb0ce None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:29.439520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c04203-9f72-4873-9ff8-ac06ce6fb0ce None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:29.473683 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b91b7-6734-4cc0-896c-2a5f8ce1a01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:29.474909 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b91b7-6734-4cc0-896c-2a5f8ce1a01a None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:29.475197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b91b7-6734-4cc0-896c-2a5f8ce1a01a None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:29.475471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b91b7-6734-4cc0-896c-2a5f8ce1a01a None admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:29.476201 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b91b7-6734-4cc0-896c-2a5f8ce1a01a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:29.476506 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b91b7-6734-4cc0-896c-2a5f8ce1a01a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:29.477915 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b91b7-6734-4cc0-896c-2a5f8ce1a01a None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:29.491675 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 650/1279] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:29.501310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434aabe-de7d-4091-8c7b-d9f0ab747f70 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:29.677323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434aabe-de7d-4091-8c7b-d9f0ab747f70 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:29.733601 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17e151-ed94-4a9e-8acc-74426e76190d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:29.734990 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17e151-ed94-4a9e-8acc-74426e76190d None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:29.735466 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17e151-ed94-4a9e-8acc-74426e76190d None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:29.735902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17e151-ed94-4a9e-8acc-74426e76190d None admin] PATH_INFO: `/v3/users/placement` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:29.744152 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17e151-ed94-4a9e-8acc-74426e76190d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:29.745663 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17e151-ed94-4a9e-8acc-74426e76190d None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:29.760980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-7d17e151-ed94-4a9e-8acc-74426e76190d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 14:54:29.760980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:29.760980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:29.760980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:29.760980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:29.760980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:29.760980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:29.760980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:29.760980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:29.760980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:29.760980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:29.760980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:29.760980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 14:54:29.760980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 14:54:29.760980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 14:54:29.760980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 14:54:29.762806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:29.762806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:29.762806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 14:54:29.762806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:54:29.762806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 14:54:29.762806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 14:54:29.762806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:29.762806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:29.762806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:29.762806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:29.762806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:29.762806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:54:29.762806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:29.762806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:29.762806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:29.762806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:29.762806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:29.762806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:29.764866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:29.764866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:29.764866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 14:54:29.764866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 14:54:29.764866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 14:54:29.764866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 14:54:29.764866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 14:54:29.764866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 14:54:29.764866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 14:54:29.764866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:29.764866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 630/1280] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:54:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:29.769865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b91b7-6734-4cc0-896c-2a5f8ce1a01a None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:29.877958 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b91b7-6734-4cc0-896c-2a5f8ce1a01a None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:29.921602 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee65ff1-536a-48e9-a2fd-13c3848c35ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:29.922299 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee65ff1-536a-48e9-a2fd-13c3848c35ed None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:29.922627 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee65ff1-536a-48e9-a2fd-13c3848c35ed None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:29.923007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee65ff1-536a-48e9-a2fd-13c3848c35ed None admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:29.923932 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee65ff1-536a-48e9-a2fd-13c3848c35ed None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:29.924283 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee65ff1-536a-48e9-a2fd-13c3848c35ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:29.925833 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee65ff1-536a-48e9-a2fd-13c3848c35ed None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:29.946647 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 651/1281] 10.222.0.73 () {56 vars in 1143 bytes} [Fri May 13 14:54:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:29.959375 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17e151-ed94-4a9e-8acc-74426e76190d None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:30.122006 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17e151-ed94-4a9e-8acc-74426e76190d None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:30.157550 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d93f9-87d4-4eda-9edc-0d95d3c330d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:30.158195 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d93f9-87d4-4eda-9edc-0d95d3c330d5 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:30.158480 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d93f9-87d4-4eda-9edc-0d95d3c330d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:30.158748 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d93f9-87d4-4eda-9edc-0d95d3c330d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:30.242855 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d93f9-87d4-4eda-9edc-0d95d3c330d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:30.244334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d93f9-87d4-4eda-9edc-0d95d3c330d5 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:30.348995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 631/1282] 10.222.0.73 () {58 vars in 1282 bytes} [Fri May 13 14:54:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 14:54:30.359107 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee65ff1-536a-48e9-a2fd-13c3848c35ed None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:30.531713 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee65ff1-536a-48e9-a2fd-13c3848c35ed None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:30.601455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36acaf7-60a0-482a-b810-3b475fe3b2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:30.602256 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36acaf7-60a0-482a-b810-3b475fe3b2c2 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:30.602541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36acaf7-60a0-482a-b810-3b475fe3b2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:30.602807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36acaf7-60a0-482a-b810-3b475fe3b2c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:30.613554 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36acaf7-60a0-482a-b810-3b475fe3b2c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:30.615602 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36acaf7-60a0-482a-b810-3b475fe3b2c2 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:30.635918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-e36acaf7-60a0-482a-b810-3b475fe3b2c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:30.635918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:30.635918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:30.635918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:30.635918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:30.635918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:30.635918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:30.635918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:30.635918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:30.635918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:30.635918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:30.635918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:30.635918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 14:54:30.635918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 14:54:30.635918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 14:54:30.637065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 14:54:30.637065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:30.637065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:30.637065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:30.637065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:30.637065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:30.637065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:30.637065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:30.637065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:54:30.637065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:30.637065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:30.637065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:30.637065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:30.637065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:30.637065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:30.637065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:30.637065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:30.638468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 14:54:30.638468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 14:54:30.638468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 14:54:30.638468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:54:30.638468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 652/1283] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:54:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:30.643431 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d93f9-87d4-4eda-9edc-0d95d3c330d5 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:30.750576 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d93f9-87d4-4eda-9edc-0d95d3c330d5 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:30.787859 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f9837-09e4-4886-b7d4-84507b0fe40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:30.788468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f9837-09e4-4886-b7d4-84507b0fe40f None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:30.788746 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f9837-09e4-4886-b7d4-84507b0fe40f None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:30.789025 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f9837-09e4-4886-b7d4-84507b0fe40f None admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:30.789781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f9837-09e4-4886-b7d4-84507b0fe40f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:30.790078 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f9837-09e4-4886-b7d4-84507b0fe40f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:30.791535 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f9837-09e4-4886-b7d4-84507b0fe40f None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:30.804490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 632/1284] 10.222.0.73 () {56 vars in 1109 bytes} [Fri May 13 14:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:30.814004 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36acaf7-60a0-482a-b810-3b475fe3b2c2 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:30.921073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36acaf7-60a0-482a-b810-3b475fe3b2c2 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:30.957707 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40c664-f513-488f-b534-8c7ab713f3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:30.958500 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40c664-f513-488f-b534-8c7ab713f3aa None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:30.958803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40c664-f513-488f-b534-8c7ab713f3aa None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:30.959108 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40c664-f513-488f-b534-8c7ab713f3aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:30.966390 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40c664-f513-488f-b534-8c7ab713f3aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:30.967873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40c664-f513-488f-b534-8c7ab713f3aa None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:30.982720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application [None req-9f40c664-f513-488f-b534-8c7ab713f3aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:54:30.982720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:30.982720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:30.982720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:30.982720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:30.982720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:30.982720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:30.982720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:30.982720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:30.982720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:30.982720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:30.982720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:30.982720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 14:54:30.982720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 14:54:30.982720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 14:54:30.984585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 14:54:30.984585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:30.984585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:30.984585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:30.984585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:30.984585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:30.984585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:30.984585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:30.984585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application with Lock( May 13 14:54:30.984585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:30.984585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:30.984585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:30.984585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:30.984585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:30.984585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:30.984585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:30.984585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:30.986747 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 14:54:30.986747 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 14:54:30.986747 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 14:54:30.986747 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 14:54:30.986747 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 14:54:30.986747 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 14:54:30.986747 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 14:54:30.986747 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: ERROR keystone.server.flask.application May 13 14:54:30.986747 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 653/1285] 10.222.0.73 () {56 vars in 1111 bytes} [Fri May 13 14:54:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 14:54:30.992168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f9837-09e4-4886-b7d4-84507b0fe40f None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:31.093924 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f9837-09e4-4886-b7d4-84507b0fe40f None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:31.129457 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe8466-1adf-4adf-be19-747c13d5049e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:31.131159 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe8466-1adf-4adf-be19-747c13d5049e None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:31.131668 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe8466-1adf-4adf-be19-747c13d5049e None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:31.132170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe8466-1adf-4adf-be19-747c13d5049e None admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:31.133764 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe8466-1adf-4adf-be19-747c13d5049e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:31.134313 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe8466-1adf-4adf-be19-747c13d5049e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:31.137111 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe8466-1adf-4adf-be19-747c13d5049e None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:31.160716 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 633/1286] 10.222.0.73 () {56 vars in 1148 bytes} [Fri May 13 14:54:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:54:31.167171 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40c664-f513-488f-b534-8c7ab713f3aa None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:31.276647 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40c664-f513-488f-b534-8c7ab713f3aa None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:31.312038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502baa22-2371-4276-95e0-dfabed76adf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:31.312700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502baa22-2371-4276-95e0-dfabed76adf9 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:31.312979 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502baa22-2371-4276-95e0-dfabed76adf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:31.313252 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502baa22-2371-4276-95e0-dfabed76adf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:31.314093 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502baa22-2371-4276-95e0-dfabed76adf9 None admin] RBAC: Adding query filter params (role.id=b6fbf976763d4795afbfb53a09ec6f6c, scope.project.id=48788e7517a14ca5b5af9f161512ac9c, user.id=908d23b035f14756b438b3a61a63b2cd) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:31.314401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502baa22-2371-4276-95e0-dfabed76adf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:31.315895 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502baa22-2371-4276-95e0-dfabed76adf9 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:31.322382 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 654/1287] 10.222.0.73 () {56 vars in 1374 bytes} [Fri May 13 14:54:31 2022] GET /identity/v3/role_assignments?user.id=908d23b035f14756b438b3a61a63b2cd&scope.project.id=48788e7517a14ca5b5af9f161512ac9c&role.id=b6fbf976763d4795afbfb53a09ec6f6c => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 14:54:33.828746 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab20fb-9bc1-4d42-a1fa-f5801b86d4a7 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:33.829450 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab20fb-9bc1-4d42-a1fa-f5801b86d4a7 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:33.829450 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab20fb-9bc1-4d42-a1fa-f5801b86d4a7 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:33.831177 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 634/1288] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:54:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:54:33.840667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255196e3-622b-4f08-8301-4c46315df4a2 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:33.841499 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255196e3-622b-4f08-8301-4c46315df4a2 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:33.841499 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255196e3-622b-4f08-8301-4c46315df4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:33.859428 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-255196e3-622b-4f08-8301-4c46315df4a2 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:33.860869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-255196e3-622b-4f08-8301-4c46315df4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:33.932759 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 655/1289] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:54:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:54:33.955522 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab20fb-9bc1-4d42-a1fa-f5801b86d4a7 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:34.062571 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab20fb-9bc1-4d42-a1fa-f5801b86d4a7 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:34.099850 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905478a-dd29-4ee8-8b8c-8cf3d37d6723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:34.100661 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905478a-dd29-4ee8-8b8c-8cf3d37d6723 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:34.100937 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905478a-dd29-4ee8-8b8c-8cf3d37d6723 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:34.101206 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905478a-dd29-4ee8-8b8c-8cf3d37d6723 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:34.101871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905478a-dd29-4ee8-8b8c-8cf3d37d6723 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:34.103314 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905478a-dd29-4ee8-8b8c-8cf3d37d6723 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:34.116593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-f905478a-dd29-4ee8-8b8c-8cf3d37d6723 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 13 14:54:34.116593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:34.116593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:54:34.116593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:54:34.116593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:54:34.116593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:54:34.116593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:54:34.116593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:54:34.116593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 14:54:34.116593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:34.116593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:54:34.116593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:34.116593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:34.116593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:34.116593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:34.116593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:34.116593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:34.118649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:34.118649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:34.118649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:34.118649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:34.118649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:34.118649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:34.118649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:54:34.118649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:54:34.118649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:54:34.118649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:54:34.118649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:34.118649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:34.118649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:34.118649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:34.118649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:34.118649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:34.120395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:34.120395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:54:34.120395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:34.120395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:34.120395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:34.120395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:34.120395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:34.120395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:34.120395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:34.120395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:34.120395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:54:34.120395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:54:34.120395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 14:54:34.120395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:34.120395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 635/1290] 10.222.0.73 () {56 vars in 1117 bytes} [Fri May 13 14:54:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:54:34.125827 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255196e3-622b-4f08-8301-4c46315df4a2 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:34.231244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255196e3-622b-4f08-8301-4c46315df4a2 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:34.265946 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c138bb7-bc59-4c54-9be8-a36ff5d69222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:34.266636 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c138bb7-bc59-4c54-9be8-a36ff5d69222 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:34.266949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c138bb7-bc59-4c54-9be8-a36ff5d69222 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:34.267229 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c138bb7-bc59-4c54-9be8-a36ff5d69222 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:34.267957 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c138bb7-bc59-4c54-9be8-a36ff5d69222 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:34.268265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c138bb7-bc59-4c54-9be8-a36ff5d69222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:34.269659 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c138bb7-bc59-4c54-9be8-a36ff5d69222 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:34.275779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 656/1291] 10.222.0.73 () {56 vars in 1116 bytes} [Fri May 13 14:54:34 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:34.284920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905478a-dd29-4ee8-8b8c-8cf3d37d6723 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:34.446772 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905478a-dd29-4ee8-8b8c-8cf3d37d6723 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:34.506647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bb40b-cbd1-489f-ad7e-0680979adaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:34.507845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bb40b-cbd1-489f-ad7e-0680979adaef None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:34.508356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bb40b-cbd1-489f-ad7e-0680979adaef None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:34.508848 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bb40b-cbd1-489f-ad7e-0680979adaef None admin] PATH_INFO: `/v3/services` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:34.510192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bb40b-cbd1-489f-ad7e-0680979adaef None admin] RBAC: Adding query filter params (type=placement) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:34.510746 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bb40b-cbd1-489f-ad7e-0680979adaef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:34.513431 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bb40b-cbd1-489f-ad7e-0680979adaef None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:34.521903 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 636/1292] 10.222.0.73 () {56 vars in 1116 bytes} [Fri May 13 14:54:34 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:36.831814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac232ddc-5535-488e-acfa-3833e87d21b6 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:36.832393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac232ddc-5535-488e-acfa-3833e87d21b6 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:36.832393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac232ddc-5535-488e-acfa-3833e87d21b6 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:36.833879 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 657/1293] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:54:36.840054 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615111d-6bd3-4bb9-b1fd-d3a071eb4cf3 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:36.840657 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615111d-6bd3-4bb9-b1fd-d3a071eb4cf3 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:36.840657 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615111d-6bd3-4bb9-b1fd-d3a071eb4cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:36.859054 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-3615111d-6bd3-4bb9-b1fd-d3a071eb4cf3 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:36.860310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-3615111d-6bd3-4bb9-b1fd-d3a071eb4cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:36.940590 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 637/1294] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:54:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:54:36.965326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac232ddc-5535-488e-acfa-3833e87d21b6 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:37.139446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac232ddc-5535-488e-acfa-3833e87d21b6 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:37.202092 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6521bae-28a1-4935-8953-0fca17e453d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:37.203295 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6521bae-28a1-4935-8953-0fca17e453d6 None admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:37.203796 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6521bae-28a1-4935-8953-0fca17e453d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:37.204307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6521bae-28a1-4935-8953-0fca17e453d6 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:37.205706 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6521bae-28a1-4935-8953-0fca17e453d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:37.209046 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6521bae-28a1-4935-8953-0fca17e453d6 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:37.231497 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 658/1295] 10.222.0.73 () {60 vars in 1141 bytes} [Fri May 13 14:54:36 2022] POST /identity/v3/services => generated 246 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:54:39.581908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0329f6c-3cfa-43a5-8789-045a8aaa1262 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:39.582789 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0329f6c-3cfa-43a5-8789-045a8aaa1262 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:39.582789 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0329f6c-3cfa-43a5-8789-045a8aaa1262 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:39.583930 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 638/1296] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:54:39.589769 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592632b-ebb6-4dec-803f-817041b9bbe4 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:39.590324 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592632b-ebb6-4dec-803f-817041b9bbe4 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:39.590475 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592632b-ebb6-4dec-803f-817041b9bbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:39.608848 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-1592632b-ebb6-4dec-803f-817041b9bbe4 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:39.610107 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-1592632b-ebb6-4dec-803f-817041b9bbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:39.689065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 659/1297] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:54:39 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:54:39.712728 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0329f6c-3cfa-43a5-8789-045a8aaa1262 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:39.819446 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0329f6c-3cfa-43a5-8789-045a8aaa1262 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:39.856104 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac7cfb-d4f3-4c34-aba2-a091c057dcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:39.856923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac7cfb-d4f3-4c34-aba2-a091c057dcb2 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:39.857203 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac7cfb-d4f3-4c34-aba2-a091c057dcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:39.857472 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac7cfb-d4f3-4c34-aba2-a091c057dcb2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:39.858177 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac7cfb-d4f3-4c34-aba2-a091c057dcb2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:39.859616 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac7cfb-d4f3-4c34-aba2-a091c057dcb2 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:39.872823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-fcac7cfb-d4f3-4c34-aba2-a091c057dcb2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 13 14:54:39.872823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:39.872823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:54:39.872823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:54:39.872823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:54:39.872823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:54:39.872823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:54:39.872823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:54:39.872823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 14:54:39.872823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:39.872823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:54:39.872823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:39.872823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:39.872823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:39.872823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:39.872823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:39.872823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:39.874874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:39.874874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:39.874874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:39.874874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:39.874874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:39.874874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:39.874874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:54:39.874874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:54:39.874874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:54:39.874874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:54:39.874874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:39.874874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:39.874874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:39.874874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:39.874874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:39.874874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:39.876810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:39.876810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:54:39.876810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:39.876810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:39.876810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:39.876810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:39.876810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:39.876810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:39.876810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:39.876810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:39.876810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:54:39.876810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:54:39.876810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 14:54:39.876810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:39.876810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 639/1298] 10.222.0.73 () {56 vars in 1117 bytes} [Fri May 13 14:54:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:54:39.883515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592632b-ebb6-4dec-803f-817041b9bbe4 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:39.992944 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592632b-ebb6-4dec-803f-817041b9bbe4 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:40.030280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30362995-f106-4d48-9b42-2e198db3f5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:40.030996 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30362995-f106-4d48-9b42-2e198db3f5c9 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:40.031274 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30362995-f106-4d48-9b42-2e198db3f5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:40.031544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30362995-f106-4d48-9b42-2e198db3f5c9 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:40.032261 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30362995-f106-4d48-9b42-2e198db3f5c9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:40.032562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30362995-f106-4d48-9b42-2e198db3f5c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:40.033982 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30362995-f106-4d48-9b42-2e198db3f5c9 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:40.040221 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 660/1299] 10.222.0.73 () {56 vars in 1116 bytes} [Fri May 13 14:54:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:40.046625 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac7cfb-d4f3-4c34-aba2-a091c057dcb2 None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:40.210792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac7cfb-d4f3-4c34-aba2-a091c057dcb2 None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:40.269895 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923a125-c253-46cc-a3bc-79df786064b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:40.271108 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923a125-c253-46cc-a3bc-79df786064b9 None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:40.271615 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923a125-c253-46cc-a3bc-79df786064b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:40.272113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923a125-c253-46cc-a3bc-79df786064b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:40.273634 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923a125-c253-46cc-a3bc-79df786064b9 None admin] RBAC: Adding query filter params (interface=public, service_id=2513d3ad93f14b9a91a1201a7a41de42, region_id=RegionOne) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:40.274193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923a125-c253-46cc-a3bc-79df786064b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:40.276871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923a125-c253-46cc-a3bc-79df786064b9 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:40.286791 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 640/1300] 10.222.0.73 () {56 vars in 1251 bytes} [Fri May 13 14:54:40 2022] GET /identity/v3/endpoints?service_id=2513d3ad93f14b9a91a1201a7a41de42&interface=public®ion_id=RegionOne => generated 194 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:40.292837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30362995-f106-4d48-9b42-2e198db3f5c9 None admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:40.397772 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30362995-f106-4d48-9b42-2e198db3f5c9 None admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:40.433664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4334d73-6fcf-4e91-a1ee-db9aa3ebf976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:40.434334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4334d73-6fcf-4e91-a1ee-db9aa3ebf976 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:40.434612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4334d73-6fcf-4e91-a1ee-db9aa3ebf976 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:40.434915 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4334d73-6fcf-4e91-a1ee-db9aa3ebf976 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:40.435603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4334d73-6fcf-4e91-a1ee-db9aa3ebf976 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:40.436978 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4334d73-6fcf-4e91-a1ee-db9aa3ebf976 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:40.445308 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 661/1301] 10.222.0.73 () {56 vars in 1087 bytes} [Fri May 13 14:54:40 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 14:54:42.787651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46162078-4a6d-455f-839e-b15cf7e9166d None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:42.788299 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46162078-4a6d-455f-839e-b15cf7e9166d None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:42.788299 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46162078-4a6d-455f-839e-b15cf7e9166d None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:42.789581 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 641/1302] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:54:42.795559 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e83ce1-1148-4888-b2ad-81dc3893ce12 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:42.796087 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e83ce1-1148-4888-b2ad-81dc3893ce12 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:42.796212 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e83ce1-1148-4888-b2ad-81dc3893ce12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:42.814678 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-61e83ce1-1148-4888-b2ad-81dc3893ce12 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:54:42.815991 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-61e83ce1-1148-4888-b2ad-81dc3893ce12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:54:42.888642 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 662/1303] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:54:42 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 14:54:42.912388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46162078-4a6d-455f-839e-b15cf7e9166d None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:43.026500 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46162078-4a6d-455f-839e-b15cf7e9166d None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:43.063874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7c1ff-1dde-4181-a64c-e9ac67ce74ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:43.065009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7c1ff-1dde-4181-a64c-e9ac67ce74ef None admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:43.065338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7c1ff-1dde-4181-a64c-e9ac67ce74ef None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:43.065655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7c1ff-1dde-4181-a64c-e9ac67ce74ef None admin] PATH_INFO: `/v3/services/placement` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:43.066375 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7c1ff-1dde-4181-a64c-e9ac67ce74ef None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:43.067976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7c1ff-1dde-4181-a64c-e9ac67ce74ef None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:43.080726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application [None req-4bd7c1ff-1dde-4181-a64c-e9ac67ce74ef None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 13 14:54:43.080726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:43.080726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 14:54:43.080726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 14:54:43.080726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 14:54:43.080726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 14:54:43.080726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 14:54:43.080726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:54:43.080726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 14:54:43.080726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:43.080726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 14:54:43.080726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:43.080726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 14:54:43.080726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 14:54:43.080726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 14:54:43.080726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 14:54:43.080726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 14:54:43.082690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 14:54:43.082690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 14:54:43.082690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 14:54:43.082690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 14:54:43.082690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 14:54:43.082690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 14:54:43.082690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 14:54:43.082690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 14:54:43.082690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 14:54:43.082690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 14:54:43.082690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 14:54:43.082690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 14:54:43.082690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 14:54:43.082690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 14:54:43.082690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 14:54:43.082690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.get_or_create( May 13 14:54:43.085135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 14:54:43.085135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application with Lock( May 13 14:54:43.085135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 14:54:43.085135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self._enter() May 13 14:54:43.085135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 14:54:43.085135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 14:54:43.085135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 14:54:43.085135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application return self.creator() May 13 14:54:43.085135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 14:54:43.085135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application created_value = creator( May 13 14:54:43.085135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 14:54:43.085135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 14:54:43.085135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 14:54:43.085135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: ERROR keystone.server.flask.application May 13 14:54:43.085135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 642/1304] 10.222.0.73 () {56 vars in 1117 bytes} [Fri May 13 14:54:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 14:54:43.090813 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e83ce1-1148-4888-b2ad-81dc3893ce12 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:43.194220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e83ce1-1148-4888-b2ad-81dc3893ce12 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:43.231454 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399005cb-59d9-4c82-a229-b64cc2809720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:43.232224 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399005cb-59d9-4c82-a229-b64cc2809720 None admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:43.232544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399005cb-59d9-4c82-a229-b64cc2809720 None admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:43.232880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399005cb-59d9-4c82-a229-b64cc2809720 None admin] PATH_INFO: `/v3/services` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:43.233921 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399005cb-59d9-4c82-a229-b64cc2809720 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 14:54:43.234273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399005cb-59d9-4c82-a229-b64cc2809720 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:43.235761 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399005cb-59d9-4c82-a229-b64cc2809720 None admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:43.242412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 663/1305] 10.222.0.73 () {56 vars in 1116 bytes} [Fri May 13 14:54:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 14:54:43.251833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7c1ff-1dde-4181-a64c-e9ac67ce74ef None admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:54:43.402497 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7c1ff-1dde-4181-a64c-e9ac67ce74ef None admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:54:43.438231 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875cf65-dde8-448a-9a88-294ac7d959a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:54:43.439165 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875cf65-dde8-448a-9a88-294ac7d959a1 None admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:54:43.439430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875cf65-dde8-448a-9a88-294ac7d959a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:54:43.439822 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875cf65-dde8-448a-9a88-294ac7d959a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:54:43.440637 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875cf65-dde8-448a-9a88-294ac7d959a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:54:43.442108 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875cf65-dde8-448a-9a88-294ac7d959a1 None admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:54:43.462356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 643/1306] 10.222.0.73 () {60 vars in 1144 bytes} [Fri May 13 14:54:43 2022] POST /identity/v3/endpoints => generated 331 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 14:55:59.309999 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed7e15-b878-487f-996a-103171df9dc2 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:59.311913 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed7e15-b878-487f-996a-103171df9dc2 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:59.312783 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed7e15-b878-487f-996a-103171df9dc2 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:59.317087 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 664/1307] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:55:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:55:59.323282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb68a7a-cc80-4c43-96ce-0db87cad6b17 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:59.324184 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb68a7a-cc80-4c43-96ce-0db87cad6b17 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:59.324612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb68a7a-cc80-4c43-96ce-0db87cad6b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:59.429499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-adb68a7a-cc80-4c43-96ce-0db87cad6b17 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:59.431720 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-adb68a7a-cc80-4c43-96ce-0db87cad6b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:59.618882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 644/1308] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:55:59.672542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e612b9d-89e4-4c69-a831-af9a7d44172f None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:59.672957 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e612b9d-89e4-4c69-a831-af9a7d44172f None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:59.673436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e612b9d-89e4-4c69-a831-af9a7d44172f None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:59.677366 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 665/1309] 10.222.0.73 () {54 vars in 964 bytes} [Fri May 13 14:55:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:55:59.690519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ec191-15e4-4c54-8cee-61c6d76a01b7 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:55:59.691009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ec191-15e4-4c54-8cee-61c6d76a01b7 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:55:59.691451 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ec191-15e4-4c54-8cee-61c6d76a01b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:55:59.782882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-bc2ec191-15e4-4c54-8cee-61c6d76a01b7 None None] MFA Rules not processed for user `ee97a542470644f89cd665dfdf2f9e92`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:55:59.784285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-bc2ec191-15e4-4c54-8cee-61c6d76a01b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:55:59.880699 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 645/1310] 10.222.0.73 () {58 vars in 1061 bytes} [Fri May 13 14:55:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:55:59.893457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e612b9d-89e4-4c69-a831-af9a7d44172f None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:55:59.896171 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-4e612b9d-89e4-4c69-a831-af9a7d44172f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:00.051740 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e612b9d-89e4-4c69-a831-af9a7d44172f None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:00.163237 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a209bf-cf0f-4fad-9f59-05743a593a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:00.163795 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a209bf-cf0f-4fad-9f59-05743a593a94 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:00.164099 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a209bf-cf0f-4fad-9f59-05743a593a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:00.164541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a209bf-cf0f-4fad-9f59-05743a593a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:00.166385 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-29a209bf-cf0f-4fad-9f59-05743a593a94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:00.346942 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a209bf-cf0f-4fad-9f59-05743a593a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:00.349708 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a209bf-cf0f-4fad-9f59-05743a593a94 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:00.388126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 666/1311] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:55:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:56:04.155419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de72c2-bd07-40e7-bce3-40260a586d01 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:04.156292 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de72c2-bd07-40e7-bce3-40260a586d01 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:04.156292 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de72c2-bd07-40e7-bce3-40260a586d01 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:04.157769 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 646/1312] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:56:04.164688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f59ab1-1e58-48d7-a95a-2c0237d10cd4 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:04.165275 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f59ab1-1e58-48d7-a95a-2c0237d10cd4 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:04.165793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f59ab1-1e58-48d7-a95a-2c0237d10cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:04.292049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-22f59ab1-1e58-48d7-a95a-2c0237d10cd4 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:04.294495 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-22f59ab1-1e58-48d7-a95a-2c0237d10cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:04.492823 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 667/1313] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:56:04.553833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de72c2-bd07-40e7-bce3-40260a586d01 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:04.557374 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-93de72c2-bd07-40e7-bce3-40260a586d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:04.766730 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de72c2-bd07-40e7-bce3-40260a586d01 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:04.901501 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa5f4c-e5a1-47c9-a131-fa5a87d66c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:04.902674 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa5f4c-e5a1-47c9-a131-fa5a87d66c9c service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:04.903231 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa5f4c-e5a1-47c9-a131-fa5a87d66c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:04.903988 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa5f4c-e5a1-47c9-a131-fa5a87d66c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:04.907596 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-83fa5f4c-e5a1-47c9-a131-fa5a87d66c9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:05.051963 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa5f4c-e5a1-47c9-a131-fa5a87d66c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:05.053411 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa5f4c-e5a1-47c9-a131-fa5a87d66c9c service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:05.074199 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 647/1314] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:56:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:56:07.811786 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cec797-9563-4ea1-b741-353f702f3744 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:07.812409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cec797-9563-4ea1-b741-353f702f3744 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:07.812409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cec797-9563-4ea1-b741-353f702f3744 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:07.813833 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 668/1315] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:56:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:56:07.820809 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086a58a-748e-45a3-b69e-e442425f55ce None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:07.821462 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086a58a-748e-45a3-b69e-e442425f55ce None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:07.821462 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086a58a-748e-45a3-b69e-e442425f55ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:07.895702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-8086a58a-748e-45a3-b69e-e442425f55ce None None] MFA Rules not processed for user `f2a0711bb35944ca87b4e4380659c57f`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:07.896932 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-8086a58a-748e-45a3-b69e-e442425f55ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:08.005846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 648/1316] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:56:07 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:56:08.046332 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cec797-9563-4ea1-b741-353f702f3744 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:08.047982 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-76cec797-9563-4ea1-b741-353f702f3744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:08.162535 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cec797-9563-4ea1-b741-353f702f3744 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:08.238479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e567ab-01d9-49f6-be81-55aa6e5ed8cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:08.239297 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e567ab-01d9-49f6-be81-55aa6e5ed8cd service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:08.239660 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e567ab-01d9-49f6-be81-55aa6e5ed8cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:08.240080 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e567ab-01d9-49f6-be81-55aa6e5ed8cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:08.241850 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-69e567ab-01d9-49f6-be81-55aa6e5ed8cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:08.357353 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e567ab-01d9-49f6-be81-55aa6e5ed8cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:08.358809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e567ab-01d9-49f6-be81-55aa6e5ed8cd service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:08.378164 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 669/1317] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:56:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:56:11.506191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433b28e-8a04-4e71-ae2f-75b9cc28c816 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:11.507073 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433b28e-8a04-4e71-ae2f-75b9cc28c816 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:11.507246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433b28e-8a04-4e71-ae2f-75b9cc28c816 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:11.508911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 649/1318] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:56:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:56:11.520209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e80744-a512-451f-ad6b-2a424169a303 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:11.520791 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e80744-a512-451f-ad6b-2a424169a303 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:11.521197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e80744-a512-451f-ad6b-2a424169a303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:11.597309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-52e80744-a512-451f-ad6b-2a424169a303 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:11.598584 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-52e80744-a512-451f-ad6b-2a424169a303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:11.702647 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 670/1319] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:56:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:56:11.773531 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8673f-7642-4a6a-9fc2-9e791392aebf None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:11.773767 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8673f-7642-4a6a-9fc2-9e791392aebf None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:11.774072 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8673f-7642-4a6a-9fc2-9e791392aebf None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:11.775544 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 650/1320] 10.222.0.73 () {54 vars in 964 bytes} [Fri May 13 14:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:56:11.782069 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb6fe9-e2f7-44fd-9ee0-c73f2738ff8a None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:11.782402 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb6fe9-e2f7-44fd-9ee0-c73f2738ff8a None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:11.782769 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb6fe9-e2f7-44fd-9ee0-c73f2738ff8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:11.865273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-fdbb6fe9-e2f7-44fd-9ee0-c73f2738ff8a None None] MFA Rules not processed for user `ee97a542470644f89cd665dfdf2f9e92`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:11.866594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-fdbb6fe9-e2f7-44fd-9ee0-c73f2738ff8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:11.953516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 671/1321] 10.222.0.73 () {58 vars in 1061 bytes} [Fri May 13 14:56:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:56:11.963198 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8673f-7642-4a6a-9fc2-9e791392aebf None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:11.965216 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-5ed8673f-7642-4a6a-9fc2-9e791392aebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:12.134353 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8673f-7642-4a6a-9fc2-9e791392aebf None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:12.276362 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73774f43-9ab2-446b-bc55-a95130c282b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:12.277483 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73774f43-9ab2-446b-bc55-a95130c282b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:12.278056 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73774f43-9ab2-446b-bc55-a95130c282b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:12.278536 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73774f43-9ab2-446b-bc55-a95130c282b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:12.281875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-73774f43-9ab2-446b-bc55-a95130c282b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:12.446997 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73774f43-9ab2-446b-bc55-a95130c282b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:12.448378 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73774f43-9ab2-446b-bc55-a95130c282b8 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:12.468869 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 651/1322] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:56:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:56:16.405530 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b6e9c-b879-4b25-91e8-ec68a0eeacb0 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:16.406453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b6e9c-b879-4b25-91e8-ec68a0eeacb0 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:16.406453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b6e9c-b879-4b25-91e8-ec68a0eeacb0 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:16.408628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 672/1323] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:56:16.416250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff47ffa-f911-4e89-bce9-bc2173ffeda0 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:16.416891 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff47ffa-f911-4e89-bce9-bc2173ffeda0 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:16.417362 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff47ffa-f911-4e89-bce9-bc2173ffeda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:16.512241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-1ff47ffa-f911-4e89-bce9-bc2173ffeda0 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:16.513973 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-1ff47ffa-f911-4e89-bce9-bc2173ffeda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:16.702803 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 652/1324] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:56:16.765555 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b6e9c-b879-4b25-91e8-ec68a0eeacb0 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:16.768497 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a59b6e9c-b879-4b25-91e8-ec68a0eeacb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:16.931910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b6e9c-b879-4b25-91e8-ec68a0eeacb0 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:17.029161 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ce8ce-1cbc-4d9b-9e18-05537b56bdb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:17.029802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ce8ce-1cbc-4d9b-9e18-05537b56bdb7 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:17.030209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ce8ce-1cbc-4d9b-9e18-05537b56bdb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:17.030551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ce8ce-1cbc-4d9b-9e18-05537b56bdb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:17.032716 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-c67ce8ce-1cbc-4d9b-9e18-05537b56bdb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:17.166906 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ce8ce-1cbc-4d9b-9e18-05537b56bdb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:17.168580 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ce8ce-1cbc-4d9b-9e18-05537b56bdb7 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:17.191375 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 673/1325] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:56:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:56:19.601698 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3aee7-ddc1-499f-ad79-25f729bab63a None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:19.602523 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3aee7-ddc1-499f-ad79-25f729bab63a None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:19.602523 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3aee7-ddc1-499f-ad79-25f729bab63a None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:19.603797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 653/1326] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:56:19.612544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77290d21-ce10-40ee-8bf9-28492d52121e None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:19.613458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77290d21-ce10-40ee-8bf9-28492d52121e None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:19.613651 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77290d21-ce10-40ee-8bf9-28492d52121e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:19.704038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-77290d21-ce10-40ee-8bf9-28492d52121e None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:19.705330 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-77290d21-ce10-40ee-8bf9-28492d52121e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:19.837501 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 674/1327] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:56:19.875970 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3aee7-ddc1-499f-ad79-25f729bab63a None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:19.877807 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-52a3aee7-ddc1-499f-ad79-25f729bab63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:20.037251 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3aee7-ddc1-499f-ad79-25f729bab63a None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:20.162058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69da730-a37a-4bea-a21a-e1e5c89f66db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:20.163140 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69da730-a37a-4bea-a21a-e1e5c89f66db service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:20.163643 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69da730-a37a-4bea-a21a-e1e5c89f66db service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:20.164117 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69da730-a37a-4bea-a21a-e1e5c89f66db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:20.167429 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-b69da730-a37a-4bea-a21a-e1e5c89f66db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:20.365715 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69da730-a37a-4bea-a21a-e1e5c89f66db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:20.368631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69da730-a37a-4bea-a21a-e1e5c89f66db service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:20.398490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 654/1328] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:56:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:56:22.940378 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce51ee4-2460-4401-8fed-ff3769966077 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:22.941012 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce51ee4-2460-4401-8fed-ff3769966077 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:22.942006 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce51ee4-2460-4401-8fed-ff3769966077 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:22.944660 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 675/1329] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:56:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:56:22.951191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855e26e-2d8e-4dea-98f8-67ef8eed218b None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:22.952072 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855e26e-2d8e-4dea-98f8-67ef8eed218b None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:22.952072 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855e26e-2d8e-4dea-98f8-67ef8eed218b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:23.049448 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-5855e26e-2d8e-4dea-98f8-67ef8eed218b None None] MFA Rules not processed for user `f2a0711bb35944ca87b4e4380659c57f`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:23.052542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-5855e26e-2d8e-4dea-98f8-67ef8eed218b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:23.222211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 655/1330] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:56:22 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:56:23.263686 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce51ee4-2460-4401-8fed-ff3769966077 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:23.265580 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-6ce51ee4-2460-4401-8fed-ff3769966077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:23.401828 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce51ee4-2460-4401-8fed-ff3769966077 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:23.496815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e7c0d-f924-4c5a-bd6b-e9a70de9dc5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:23.497793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e7c0d-f924-4c5a-bd6b-e9a70de9dc5d service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:23.498269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e7c0d-f924-4c5a-bd6b-e9a70de9dc5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:23.498745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e7c0d-f924-4c5a-bd6b-e9a70de9dc5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:23.501972 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-667e7c0d-f924-4c5a-bd6b-e9a70de9dc5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:23.697683 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e7c0d-f924-4c5a-bd6b-e9a70de9dc5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:23.700540 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e7c0d-f924-4c5a-bd6b-e9a70de9dc5d service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:23.736679 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 676/1331] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:56:23 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:56:26.592809 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a910a-ba1c-4b45-8149-52b11bdd8a0b None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:26.593664 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a910a-ba1c-4b45-8149-52b11bdd8a0b None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:26.593664 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a910a-ba1c-4b45-8149-52b11bdd8a0b None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:26.594787 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 656/1332] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:56:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:56:26.601558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459236ff-e5e9-4922-971f-acbcd7135ed1 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:26.602254 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459236ff-e5e9-4922-971f-acbcd7135ed1 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:26.602254 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459236ff-e5e9-4922-971f-acbcd7135ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:26.694770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-459236ff-e5e9-4922-971f-acbcd7135ed1 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:26.696464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-459236ff-e5e9-4922-971f-acbcd7135ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:26.810443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 677/1333] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:56:26.850699 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a910a-ba1c-4b45-8149-52b11bdd8a0b None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:26.853402 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-551a910a-ba1c-4b45-8149-52b11bdd8a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:27.024924 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a910a-ba1c-4b45-8149-52b11bdd8a0b None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:27.118845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad1480-c03b-4f34-b6e1-687d9953cee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:27.119702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad1480-c03b-4f34-b6e1-687d9953cee1 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:27.120019 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad1480-c03b-4f34-b6e1-687d9953cee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:27.120294 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad1480-c03b-4f34-b6e1-687d9953cee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:27.122055 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-81ad1480-c03b-4f34-b6e1-687d9953cee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:27.309449 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad1480-c03b-4f34-b6e1-687d9953cee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:27.311230 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad1480-c03b-4f34-b6e1-687d9953cee1 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:27.340645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 657/1334] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:56:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:56:29.734032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c410d9-54a1-40a6-9e5e-11fbc48031ed None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:29.734636 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c410d9-54a1-40a6-9e5e-11fbc48031ed None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:29.734636 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c410d9-54a1-40a6-9e5e-11fbc48031ed None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:29.736103 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 678/1335] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:56:29.742211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f2a19-4148-4e29-87b2-1de5456f1e47 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:29.742786 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f2a19-4148-4e29-87b2-1de5456f1e47 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:29.742786 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f2a19-4148-4e29-87b2-1de5456f1e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:29.824474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-813f2a19-4148-4e29-87b2-1de5456f1e47 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:29.825696 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-813f2a19-4148-4e29-87b2-1de5456f1e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:29.957433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 658/1336] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:56:30.006149 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c410d9-54a1-40a6-9e5e-11fbc48031ed None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:30.008520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a9c410d9-54a1-40a6-9e5e-11fbc48031ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:30.138413 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c410d9-54a1-40a6-9e5e-11fbc48031ed None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:30.144390 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47bc0f-f856-459d-bb43-9a1464320ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:30.146023 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47bc0f-f856-459d-bb43-9a1464320ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:30.146500 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47bc0f-f856-459d-bb43-9a1464320ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:30.147008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47bc0f-f856-459d-bb43-9a1464320ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:30.163426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47bc0f-f856-459d-bb43-9a1464320ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:30.166247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47bc0f-f856-459d-bb43-9a1464320ea7 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:30.184557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 679/1337] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:56:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:56:33.007049 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea839223-6bc3-41ec-9d51-5849858188e9 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:33.007678 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea839223-6bc3-41ec-9d51-5849858188e9 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:33.008016 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea839223-6bc3-41ec-9d51-5849858188e9 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:33.010709 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 659/1338] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:56:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:56:33.016851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b02a09-e5dc-425c-8db7-59b959352f84 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:33.017408 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b02a09-e5dc-425c-8db7-59b959352f84 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:33.017408 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b02a09-e5dc-425c-8db7-59b959352f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:33.046898 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-d4b02a09-e5dc-425c-8db7-59b959352f84 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:33.048142 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-d4b02a09-e5dc-425c-8db7-59b959352f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:33.132213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 680/1339] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:56:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:56:33.168706 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea839223-6bc3-41ec-9d51-5849858188e9 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:33.180734 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea839223-6bc3-41ec-9d51-5849858188e9 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:33.184465 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11067ffb-ba5c-4624-a6e1-486ea0ab700f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:33.185130 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11067ffb-ba5c-4624-a6e1-486ea0ab700f service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:33.185413 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11067ffb-ba5c-4624-a6e1-486ea0ab700f service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:33.185954 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11067ffb-ba5c-4624-a6e1-486ea0ab700f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:33.195998 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11067ffb-ba5c-4624-a6e1-486ea0ab700f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:33.197459 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11067ffb-ba5c-4624-a6e1-486ea0ab700f service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:33.208200 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 660/1340] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:56:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:56:38.032790 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69f430-9a2c-485a-ac0f-1c82e313b715 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:38.033836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69f430-9a2c-485a-ac0f-1c82e313b715 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:38.034112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69f430-9a2c-485a-ac0f-1c82e313b715 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:38.039203 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 681/1341] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:56:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:56:38.043564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc408f19-a50e-4505-8ead-2ed76d8e2f61 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:38.044134 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc408f19-a50e-4505-8ead-2ed76d8e2f61 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:38.044571 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc408f19-a50e-4505-8ead-2ed76d8e2f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:38.068761 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-bc408f19-a50e-4505-8ead-2ed76d8e2f61 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:38.070444 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-bc408f19-a50e-4505-8ead-2ed76d8e2f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:38.082686 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 661/1342] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:56:38.133343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69f430-9a2c-485a-ac0f-1c82e313b715 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:38.146053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69f430-9a2c-485a-ac0f-1c82e313b715 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:38.151699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960defe2-c0a8-421f-8770-d15dbbc889f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:38.153999 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960defe2-c0a8-421f-8770-d15dbbc889f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:38.154455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960defe2-c0a8-421f-8770-d15dbbc889f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:38.155385 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960defe2-c0a8-421f-8770-d15dbbc889f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:38.173678 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960defe2-c0a8-421f-8770-d15dbbc889f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:38.176489 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960defe2-c0a8-421f-8770-d15dbbc889f0 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:38.197345 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 682/1343] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:56:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:56:41.565757 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32190531-fd49-436a-a5fa-bdeaae746107 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:41.567464 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32190531-fd49-436a-a5fa-bdeaae746107 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:41.567464 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32190531-fd49-436a-a5fa-bdeaae746107 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:41.569419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 662/1344] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:56:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:56:41.578243 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96f21e-3cbd-4a4e-accd-bde5dfaf5dc2 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:41.579041 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96f21e-3cbd-4a4e-accd-bde5dfaf5dc2 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:41.579197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96f21e-3cbd-4a4e-accd-bde5dfaf5dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:41.605503 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-ed96f21e-3cbd-4a4e-accd-bde5dfaf5dc2 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:41.607340 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ed96f21e-3cbd-4a4e-accd-bde5dfaf5dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:41.619425 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 683/1345] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:56:41.660287 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32190531-fd49-436a-a5fa-bdeaae746107 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:41.662208 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-32190531-fd49-436a-a5fa-bdeaae746107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:41.675765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32190531-fd49-436a-a5fa-bdeaae746107 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:41.679842 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c12b3-368d-4e65-82f1-c5c45cbf9110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:41.680506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c12b3-368d-4e65-82f1-c5c45cbf9110 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:41.680791 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c12b3-368d-4e65-82f1-c5c45cbf9110 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:41.681073 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c12b3-368d-4e65-82f1-c5c45cbf9110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:41.692008 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c12b3-368d-4e65-82f1-c5c45cbf9110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:41.693476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c12b3-368d-4e65-82f1-c5c45cbf9110 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:41.704107 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 663/1346] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:56:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:56:47.923827 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe2469-f5ff-44c6-990b-843542020c9f None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:47.924564 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe2469-f5ff-44c6-990b-843542020c9f None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:47.924564 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe2469-f5ff-44c6-990b-843542020c9f None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:47.926297 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 684/1347] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:56:47.932159 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed8269-3da4-40a9-b119-812231803e10 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:47.932895 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed8269-3da4-40a9-b119-812231803e10 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:47.932895 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed8269-3da4-40a9-b119-812231803e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:47.951738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-3bed8269-3da4-40a9-b119-812231803e10 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:47.952979 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-3bed8269-3da4-40a9-b119-812231803e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:47.962012 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 664/1348] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:56:48.004551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe2469-f5ff-44c6-990b-843542020c9f None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:56:48.022697 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe2469-f5ff-44c6-990b-843542020c9f None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:56:48.035501 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722b8c3-621c-471c-92db-d41b20111af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:56:48.036364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722b8c3-621c-471c-92db-d41b20111af3 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:48.036702 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722b8c3-621c-471c-92db-d41b20111af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:48.037012 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722b8c3-621c-471c-92db-d41b20111af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:48.047523 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722b8c3-621c-471c-92db-d41b20111af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:56:48.049041 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722b8c3-621c-471c-92db-d41b20111af3 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:56:48.061388 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 685/1349] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:56:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:56:54.970538 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cd5e3-f255-4d48-ba94-7b5cbc3f11f2 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:54.972533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cd5e3-f255-4d48-ba94-7b5cbc3f11f2 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:54.973071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cd5e3-f255-4d48-ba94-7b5cbc3f11f2 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:54.975128 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 665/1350] 10.222.0.73 () {54 vars in 921 bytes} [Fri May 13 14:56:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:56:54.985469 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686038fb-9286-4879-887d-bc48ce788c41 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:56:54.986438 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686038fb-9286-4879-887d-bc48ce788c41 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:56:54.996205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686038fb-9286-4879-887d-bc48ce788c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:56:55.203335 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-686038fb-9286-4879-887d-bc48ce788c41 None None] MFA Rules not processed for user `908d23b035f14756b438b3a61a63b2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:56:55.204937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-686038fb-9286-4879-887d-bc48ce788c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:56:55.320963 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 686/1351] 10.222.0.73 () {58 vars in 1018 bytes} [Fri May 13 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:01.485012 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202af3d-459f-4b6d-a364-ce9dc897fac3 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:01.486639 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202af3d-459f-4b6d-a364-ce9dc897fac3 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:01.486990 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202af3d-459f-4b6d-a364-ce9dc897fac3 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:01.489688 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 666/1352] 10.222.0.73 () {54 vars in 921 bytes} [Fri May 13 14:57:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:57:01.496894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bd690-1afe-4c68-b35c-575385a01a80 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:01.497666 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bd690-1afe-4c68-b35c-575385a01a80 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:01.497666 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bd690-1afe-4c68-b35c-575385a01a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:01.519530 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-746bd690-1afe-4c68-b35c-575385a01a80 None None] MFA Rules not processed for user `908d23b035f14756b438b3a61a63b2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:01.522007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-746bd690-1afe-4c68-b35c-575385a01a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:01.532004 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 687/1353] 10.222.0.73 () {58 vars in 1018 bytes} [Fri May 13 14:57:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:03.663980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff43f70-3748-42b6-8fe0-1bbf4d36d4c4 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:03.664878 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff43f70-3748-42b6-8fe0-1bbf4d36d4c4 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:03.664878 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff43f70-3748-42b6-8fe0-1bbf4d36d4c4 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:03.665927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 667/1354] 10.222.0.73 () {54 vars in 921 bytes} [Fri May 13 14:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:57:03.672687 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a4d2d-6025-498e-8e84-cb4194877c34 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:03.673251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a4d2d-6025-498e-8e84-cb4194877c34 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:03.673682 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a4d2d-6025-498e-8e84-cb4194877c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:03.708244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-fa1a4d2d-6025-498e-8e84-cb4194877c34 None None] MFA Rules not processed for user `908d23b035f14756b438b3a61a63b2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:03.710428 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-fa1a4d2d-6025-498e-8e84-cb4194877c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:03.729377 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 688/1355] 10.222.0.73 () {58 vars in 1018 bytes} [Fri May 13 14:57:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:07.282293 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb029697-2f45-4d71-baa6-e7af41da784e None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:07.283237 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb029697-2f45-4d71-baa6-e7af41da784e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:07.283237 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb029697-2f45-4d71-baa6-e7af41da784e None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:07.289283 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 668/1356] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:57:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:57:07.291980 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb139e8-ede1-47b1-99c8-acb52bfb8bd6 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:07.293395 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb139e8-ede1-47b1-99c8-acb52bfb8bd6 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:07.293850 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb139e8-ede1-47b1-99c8-acb52bfb8bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:07.317531 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-abb139e8-ede1-47b1-99c8-acb52bfb8bd6 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:07.319208 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-abb139e8-ede1-47b1-99c8-acb52bfb8bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:07.337914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 689/1357] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:07.388690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea9075-dc49-4c27-a69a-2bf053c84dcf None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:07.389492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea9075-dc49-4c27-a69a-2bf053c84dcf None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:07.390588 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea9075-dc49-4c27-a69a-2bf053c84dcf None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:07.395473 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 669/1358] 10.222.0.73 () {54 vars in 961 bytes} [Fri May 13 14:57:07 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:57:07.418153 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f060906-3378-4608-a28e-76b3e80b9482 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:07.419114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f060906-3378-4608-a28e-76b3e80b9482 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:07.419774 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f060906-3378-4608-a28e-76b3e80b9482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:07.497394 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-2f060906-3378-4608-a28e-76b3e80b9482 None None] MFA Rules not processed for user `52d539202cfb40a48b231713e16a599a`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:07.499075 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-2f060906-3378-4608-a28e-76b3e80b9482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:07.625756 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 690/1359] 10.222.0.73 () {58 vars in 1058 bytes} [Fri May 13 14:57:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:07.633790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea9075-dc49-4c27-a69a-2bf053c84dcf None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:07.648479 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea9075-dc49-4c27-a69a-2bf053c84dcf None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:07.654067 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e5f39-9a77-4bb9-907b-347ae14e0196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:07.654720 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e5f39-9a77-4bb9-907b-347ae14e0196 service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:07.655037 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e5f39-9a77-4bb9-907b-347ae14e0196 service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:07.655311 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e5f39-9a77-4bb9-907b-347ae14e0196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:07.664956 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e5f39-9a77-4bb9-907b-347ae14e0196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:07.666581 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e5f39-9a77-4bb9-907b-347ae14e0196 service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:07.680061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 670/1360] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:57:10.341422 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934a85d-19b5-4806-bdd2-bbbd8c176172 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:10.342176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934a85d-19b5-4806-bdd2-bbbd8c176172 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:10.342395 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934a85d-19b5-4806-bdd2-bbbd8c176172 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:10.345143 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 691/1361] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:57:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:57:10.355321 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7becb49-1395-48fa-8060-24cf6898eb9e None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:10.356149 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7becb49-1395-48fa-8060-24cf6898eb9e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:10.356302 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7becb49-1395-48fa-8060-24cf6898eb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:10.389560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-b7becb49-1395-48fa-8060-24cf6898eb9e None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:10.392385 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-b7becb49-1395-48fa-8060-24cf6898eb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:10.413670 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 671/1362] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:10.510491 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934a85d-19b5-4806-bdd2-bbbd8c176172 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:10.540077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934a85d-19b5-4806-bdd2-bbbd8c176172 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:10.548345 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff983298-14bb-4f29-8223-46f2b13b857c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:10.549433 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff983298-14bb-4f29-8223-46f2b13b857c service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:10.550004 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff983298-14bb-4f29-8223-46f2b13b857c service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:10.550941 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff983298-14bb-4f29-8223-46f2b13b857c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:10.563666 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff983298-14bb-4f29-8223-46f2b13b857c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:10.565579 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff983298-14bb-4f29-8223-46f2b13b857c service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:10.587015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 692/1363] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:57:13.732158 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e99cc5-d107-4f35-b9d6-3f0c158f2d94 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:13.732641 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e99cc5-d107-4f35-b9d6-3f0c158f2d94 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:13.733136 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e99cc5-d107-4f35-b9d6-3f0c158f2d94 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:13.735824 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 672/1364] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:57:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:57:13.742010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d1d54-1867-438e-8ad9-75c4086eb6fe None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:13.742571 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d1d54-1867-438e-8ad9-75c4086eb6fe None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:13.742669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d1d54-1867-438e-8ad9-75c4086eb6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:13.763757 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-033d1d54-1867-438e-8ad9-75c4086eb6fe None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:13.765479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-033d1d54-1867-438e-8ad9-75c4086eb6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:13.774886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 693/1365] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:13.841406 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d5115-064f-4e81-a888-aab2d0532b63 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:13.841787 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d5115-064f-4e81-a888-aab2d0532b63 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:13.842201 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d5115-064f-4e81-a888-aab2d0532b63 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:13.844440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 673/1366] 10.222.0.73 () {54 vars in 961 bytes} [Fri May 13 14:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:57:13.851120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06e9e5-8640-4189-9201-63154f7da965 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:13.851584 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06e9e5-8640-4189-9201-63154f7da965 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:13.851977 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06e9e5-8640-4189-9201-63154f7da965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:13.879490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-3e06e9e5-8640-4189-9201-63154f7da965 None None] MFA Rules not processed for user `52d539202cfb40a48b231713e16a599a`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:13.881510 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-3e06e9e5-8640-4189-9201-63154f7da965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:13.898224 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 694/1367] 10.222.0.73 () {58 vars in 1058 bytes} [Fri May 13 14:57:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:13.907491 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d5115-064f-4e81-a888-aab2d0532b63 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:13.931589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d5115-064f-4e81-a888-aab2d0532b63 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:13.940214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27354505-4352-4169-9d7f-cd601b4dc0ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:13.941810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27354505-4352-4169-9d7f-cd601b4dc0ee service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:13.942273 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27354505-4352-4169-9d7f-cd601b4dc0ee service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:13.942743 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27354505-4352-4169-9d7f-cd601b4dc0ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:13.954222 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27354505-4352-4169-9d7f-cd601b4dc0ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:13.956300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27354505-4352-4169-9d7f-cd601b4dc0ee service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:13.973182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 674/1368] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:57:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:57:16.984985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e042a-fa54-44d0-8b8a-7c2ae46492f1 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:16.985806 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e042a-fa54-44d0-8b8a-7c2ae46492f1 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:16.985806 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e042a-fa54-44d0-8b8a-7c2ae46492f1 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:16.986962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 695/1369] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:57:16.994306 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df053448-0cb2-46f4-913a-9150517a5a93 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:16.995162 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df053448-0cb2-46f4-913a-9150517a5a93 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:16.995162 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df053448-0cb2-46f4-913a-9150517a5a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:17.015285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-df053448-0cb2-46f4-913a-9150517a5a93 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:17.016555 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-df053448-0cb2-46f4-913a-9150517a5a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:17.025472 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 675/1370] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:57:17.072763 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e042a-fa54-44d0-8b8a-7c2ae46492f1 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:17.088038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e042a-fa54-44d0-8b8a-7c2ae46492f1 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:17.094028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652c366-fc3e-4b63-bc4d-19df298a9384 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:17.094699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652c366-fc3e-4b63-bc4d-19df298a9384 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:17.095021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652c366-fc3e-4b63-bc4d-19df298a9384 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:17.095516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652c366-fc3e-4b63-bc4d-19df298a9384 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:17.108335 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652c366-fc3e-4b63-bc4d-19df298a9384 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:17.110791 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652c366-fc3e-4b63-bc4d-19df298a9384 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:17.131607 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 696/1371] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:57:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:57:18.226266 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff175c3-f5c7-4e00-980a-e9a0cd91f7b7 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:18.227238 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff175c3-f5c7-4e00-980a-e9a0cd91f7b7 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:18.227238 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff175c3-f5c7-4e00-980a-e9a0cd91f7b7 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:18.228408 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 676/1372] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:57:18.234333 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acfbc5-82ad-4a20-bc16-4be6fc2d6931 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:18.235207 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acfbc5-82ad-4a20-bc16-4be6fc2d6931 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:18.235207 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acfbc5-82ad-4a20-bc16-4be6fc2d6931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:18.256177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-60acfbc5-82ad-4a20-bc16-4be6fc2d6931 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:18.257398 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-60acfbc5-82ad-4a20-bc16-4be6fc2d6931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:18.266163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 697/1373] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:57:18.560202 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384ad46-8146-413e-be9b-2c30e9fd3721 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:18.560771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384ad46-8146-413e-be9b-2c30e9fd3721 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:18.561222 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384ad46-8146-413e-be9b-2c30e9fd3721 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:18.562925 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 677/1374] 10.222.0.73 () {54 vars in 963 bytes} [Fri May 13 14:57:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:57:18.569177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed42223-91f9-4488-ad18-5b3e970467b9 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:18.569751 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed42223-91f9-4488-ad18-5b3e970467b9 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:18.570025 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed42223-91f9-4488-ad18-5b3e970467b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:18.630844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-aed42223-91f9-4488-ad18-5b3e970467b9 None None] MFA Rules not processed for user `343a23610db84b028ccc05e4f876a0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:18.632362 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-aed42223-91f9-4488-ad18-5b3e970467b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:18.734866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 698/1375] 10.222.0.73 () {58 vars in 1060 bytes} [Fri May 13 14:57:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:18.744481 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384ad46-8146-413e-be9b-2c30e9fd3721 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:18.763783 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384ad46-8146-413e-be9b-2c30e9fd3721 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:18.770070 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6492d0-5a0c-4bfb-a901-059881322fb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:18.771392 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6492d0-5a0c-4bfb-a901-059881322fb7 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:18.772031 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6492d0-5a0c-4bfb-a901-059881322fb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:18.772658 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6492d0-5a0c-4bfb-a901-059881322fb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:18.789824 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6492d0-5a0c-4bfb-a901-059881322fb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:18.792882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6492d0-5a0c-4bfb-a901-059881322fb7 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:18.812398 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 678/1376] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:57:19.719540 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d143839-ccd7-48dc-bdb0-f9060593012d None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:19.720205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d143839-ccd7-48dc-bdb0-f9060593012d None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:19.720205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d143839-ccd7-48dc-bdb0-f9060593012d None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:19.721544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 699/1377] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:57:19.728497 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a2663-7e5b-45fb-8fd0-89edef11f80a None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:19.729073 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a2663-7e5b-45fb-8fd0-89edef11f80a None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:19.729155 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a2663-7e5b-45fb-8fd0-89edef11f80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:19.750670 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-c10a2663-7e5b-45fb-8fd0-89edef11f80a None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:19.752805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c10a2663-7e5b-45fb-8fd0-89edef11f80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:19.766415 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 679/1378] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:19.841790 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d143839-ccd7-48dc-bdb0-f9060593012d None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:19.867438 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d143839-ccd7-48dc-bdb0-f9060593012d None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:19.876707 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57454117-e358-4b6c-83b7-a59c4cfe2137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:19.877919 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57454117-e358-4b6c-83b7-a59c4cfe2137 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:19.878386 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57454117-e358-4b6c-83b7-a59c4cfe2137 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:19.878927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57454117-e358-4b6c-83b7-a59c4cfe2137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:19.899163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57454117-e358-4b6c-83b7-a59c4cfe2137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:19.902202 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57454117-e358-4b6c-83b7-a59c4cfe2137 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:19.921590 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 700/1379] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:57:22.403732 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f9132-643e-4662-8efd-d6f9dc86ab68 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:22.404598 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f9132-643e-4662-8efd-d6f9dc86ab68 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:22.404598 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f9132-643e-4662-8efd-d6f9dc86ab68 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:22.405660 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 680/1380] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:57:22.413728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7331d7-4ac5-4d36-8510-c07b44c39c0f None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:22.414539 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7331d7-4ac5-4d36-8510-c07b44c39c0f None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:22.414803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7331d7-4ac5-4d36-8510-c07b44c39c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:22.437360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-4c7331d7-4ac5-4d36-8510-c07b44c39c0f None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:22.438798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-4c7331d7-4ac5-4d36-8510-c07b44c39c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:22.452147 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 701/1381] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:57:22.516159 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f9132-643e-4662-8efd-d6f9dc86ab68 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:22.532674 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f9132-643e-4662-8efd-d6f9dc86ab68 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:22.538563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8c553-c2c7-4d2b-870d-c6e15264d171 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:22.539251 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8c553-c2c7-4d2b-870d-c6e15264d171 service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:22.539531 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8c553-c2c7-4d2b-870d-c6e15264d171 service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:22.539807 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8c553-c2c7-4d2b-870d-c6e15264d171 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:22.556356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8c553-c2c7-4d2b-870d-c6e15264d171 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:22.558014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8c553-c2c7-4d2b-870d-c6e15264d171 service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:22.575222 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 681/1382] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:57:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:57:25.815566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989c2fc-7873-441c-b29c-2f3a408a26cb None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:25.816537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989c2fc-7873-441c-b29c-2f3a408a26cb None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:25.817019 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989c2fc-7873-441c-b29c-2f3a408a26cb None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:25.818540 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 702/1383] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:57:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:57:25.825170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f2eec-b37c-40c0-8412-80c62fbf55ca None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:25.825802 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f2eec-b37c-40c0-8412-80c62fbf55ca None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:25.825982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f2eec-b37c-40c0-8412-80c62fbf55ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:25.850680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-c09f2eec-b37c-40c0-8412-80c62fbf55ca None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:25.852019 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c09f2eec-b37c-40c0-8412-80c62fbf55ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:25.864622 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 682/1384] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:25.924140 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989c2fc-7873-441c-b29c-2f3a408a26cb None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:25.943750 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989c2fc-7873-441c-b29c-2f3a408a26cb None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:25.950245 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c997b97-aeae-44b2-adfa-302b00697874 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:25.951083 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c997b97-aeae-44b2-adfa-302b00697874 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:25.951469 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c997b97-aeae-44b2-adfa-302b00697874 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:25.951932 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c997b97-aeae-44b2-adfa-302b00697874 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:25.963544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c997b97-aeae-44b2-adfa-302b00697874 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:25.965395 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c997b97-aeae-44b2-adfa-302b00697874 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:25.977954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 703/1385] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:57:28.638491 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac80d33-7a9a-41ef-b8ee-dd6535c3da25 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:28.639116 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac80d33-7a9a-41ef-b8ee-dd6535c3da25 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:28.639116 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac80d33-7a9a-41ef-b8ee-dd6535c3da25 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:28.640544 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 683/1386] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:57:28.647665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28b1b0-a857-46b5-a176-33c83dc55c0d None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:28.648221 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28b1b0-a857-46b5-a176-33c83dc55c0d None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:28.648368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28b1b0-a857-46b5-a176-33c83dc55c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:28.667993 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-ea28b1b0-a857-46b5-a176-33c83dc55c0d None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:28.669261 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ea28b1b0-a857-46b5-a176-33c83dc55c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:28.678483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 704/1387] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:28.747607 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac80d33-7a9a-41ef-b8ee-dd6535c3da25 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:28.774426 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac80d33-7a9a-41ef-b8ee-dd6535c3da25 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:28.783046 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf0e59-6f23-42e6-8acd-14ee3284e824 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:28.784508 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf0e59-6f23-42e6-8acd-14ee3284e824 service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:28.784995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf0e59-6f23-42e6-8acd-14ee3284e824 service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:28.785363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf0e59-6f23-42e6-8acd-14ee3284e824 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:28.800751 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf0e59-6f23-42e6-8acd-14ee3284e824 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:28.803475 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf0e59-6f23-42e6-8acd-14ee3284e824 service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:28.818719 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 684/1388] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:57:31.683549 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f08ed5-b2aa-4bbf-b9d7-9e2c2b9b2570 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:31.684605 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f08ed5-b2aa-4bbf-b9d7-9e2c2b9b2570 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:31.684605 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f08ed5-b2aa-4bbf-b9d7-9e2c2b9b2570 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:31.685505 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 705/1389] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:57:31.693226 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c8dfe-98a2-42c3-b090-233aabf73edc None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:31.693814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c8dfe-98a2-42c3-b090-233aabf73edc None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:31.694025 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c8dfe-98a2-42c3-b090-233aabf73edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:31.714357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-d26c8dfe-98a2-42c3-b090-233aabf73edc None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:31.715628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-d26c8dfe-98a2-42c3-b090-233aabf73edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:31.724583 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 685/1390] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:31.773768 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f08ed5-b2aa-4bbf-b9d7-9e2c2b9b2570 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:31.790542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f08ed5-b2aa-4bbf-b9d7-9e2c2b9b2570 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:31.797851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dba67b-8ef8-460c-9f9c-987adfcbfa48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:31.798726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dba67b-8ef8-460c-9f9c-987adfcbfa48 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:31.799102 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dba67b-8ef8-460c-9f9c-987adfcbfa48 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:31.799445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dba67b-8ef8-460c-9f9c-987adfcbfa48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:31.812654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dba67b-8ef8-460c-9f9c-987adfcbfa48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:31.815231 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dba67b-8ef8-460c-9f9c-987adfcbfa48 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:31.829297 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 706/1391] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:57:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:57:34.911296 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ca599-e580-4846-9595-d497f30613b8 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:34.912083 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ca599-e580-4846-9595-d497f30613b8 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:34.912648 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ca599-e580-4846-9595-d497f30613b8 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:34.915378 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 686/1392] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:57:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:57:34.924156 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db460dcd-7ce9-4dda-a4e9-0979b53a53cb None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:34.925591 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db460dcd-7ce9-4dda-a4e9-0979b53a53cb None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:34.925817 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db460dcd-7ce9-4dda-a4e9-0979b53a53cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:34.947179 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-db460dcd-7ce9-4dda-a4e9-0979b53a53cb None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:34.948564 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-db460dcd-7ce9-4dda-a4e9-0979b53a53cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:34.958322 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 707/1393] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:35.012761 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ca599-e580-4846-9595-d497f30613b8 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:35.037734 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ca599-e580-4846-9595-d497f30613b8 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:35.046793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b2430-3f51-4b9f-b8fb-7a2c1ac6ffd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:35.047933 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b2430-3f51-4b9f-b8fb-7a2c1ac6ffd6 service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:35.048411 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b2430-3f51-4b9f-b8fb-7a2c1ac6ffd6 service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:35.048882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b2430-3f51-4b9f-b8fb-7a2c1ac6ffd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:35.064459 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b2430-3f51-4b9f-b8fb-7a2c1ac6ffd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:35.067484 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b2430-3f51-4b9f-b8fb-7a2c1ac6ffd6 service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:35.085745 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 687/1394] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:57:36.357750 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c60c2-5ccc-4794-a970-cef4f302d3d9 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:36.358570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c60c2-5ccc-4794-a970-cef4f302d3d9 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:36.358570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c60c2-5ccc-4794-a970-cef4f302d3d9 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:36.359737 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 708/1395] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:57:36.368754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9882270-0282-4f0f-a22f-88b8042d2a46 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:36.369373 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9882270-0282-4f0f-a22f-88b8042d2a46 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:36.369704 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9882270-0282-4f0f-a22f-88b8042d2a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:36.400795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-b9882270-0282-4f0f-a22f-88b8042d2a46 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:36.402958 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-b9882270-0282-4f0f-a22f-88b8042d2a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:36.414179 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 688/1396] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:36.483959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92893ec5-566b-414a-9cff-0e75e96dd7a0 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:36.484439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92893ec5-566b-414a-9cff-0e75e96dd7a0 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:36.484876 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92893ec5-566b-414a-9cff-0e75e96dd7a0 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:36.486471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 709/1397] 10.222.0.73 () {54 vars in 962 bytes} [Fri May 13 14:57:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:57:36.492710 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b383e74-cdbd-4b9e-9095-93e2aec18f41 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:36.493084 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b383e74-cdbd-4b9e-9095-93e2aec18f41 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:36.493621 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b383e74-cdbd-4b9e-9095-93e2aec18f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:36.549340 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-9b383e74-cdbd-4b9e-9095-93e2aec18f41 None None] MFA Rules not processed for user `6cdd8008619d4ee3b8fe45e0e5241878`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:36.551133 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-9b383e74-cdbd-4b9e-9095-93e2aec18f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:36.627687 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 689/1398] 10.222.0.73 () {58 vars in 1059 bytes} [Fri May 13 14:57:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:36.637008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92893ec5-566b-414a-9cff-0e75e96dd7a0 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:36.650101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92893ec5-566b-414a-9cff-0e75e96dd7a0 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:36.654549 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988550e-4922-437d-9d3f-591761c4fb24 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdd8008619d4ee3b8fe45e0e5241878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:36.655461 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988550e-4922-437d-9d3f-591761c4fb24 service glance] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:36.655984 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988550e-4922-437d-9d3f-591761c4fb24 service glance] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:36.656440 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988550e-4922-437d-9d3f-591761c4fb24 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:36.667816 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988550e-4922-437d-9d3f-591761c4fb24 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:36.669537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988550e-4922-437d-9d3f-591761c4fb24 service glance] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:36.681768 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 710/1399] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:57:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:57:37.343872 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa9a97-1746-4329-abb7-b7a8925db947 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:37.344210 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa9a97-1746-4329-abb7-b7a8925db947 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:37.344388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa9a97-1746-4329-abb7-b7a8925db947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:37.409024 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-b5fa9a97-1746-4329-abb7-b7a8925db947 None None] MFA Rules not processed for user `0c04f5fb770d49c0a50f2cfbd77e17e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:37.410736 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-b5fa9a97-1746-4329-abb7-b7a8925db947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:37.504742 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 690/1400] 10.222.0.73 () {58 vars in 1009 bytes} [Fri May 13 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:57:37.557865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8e301-0048-4648-9cfc-8bfff237f98c None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:37.558503 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8e301-0048-4648-9cfc-8bfff237f98c None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:37.558852 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8e301-0048-4648-9cfc-8bfff237f98c None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:37.561465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 711/1401] 10.222.0.73 () {54 vars in 942 bytes} [Fri May 13 14:57:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:57:37.571422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e6ca4-0535-4179-af8f-4bac9e52f448 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:37.572013 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e6ca4-0535-4179-af8f-4bac9e52f448 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:37.572594 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e6ca4-0535-4179-af8f-4bac9e52f448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:37.655003 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-996e6ca4-0535-4179-af8f-4bac9e52f448 None None] MFA Rules not processed for user `27265a0c2e6b47c09f28b9cd3ac47d28`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:37.657161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-996e6ca4-0535-4179-af8f-4bac9e52f448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:37.732652 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad20c9-fe2c-4994-b97b-07e01cd202c6 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:37.732948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad20c9-fe2c-4994-b97b-07e01cd202c6 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:37.733222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad20c9-fe2c-4994-b97b-07e01cd202c6 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:37.734602 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 712/1402] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:57:37.741206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb9c2d-6274-4788-b3ea-0dc7edb1a4c9 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:37.741484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb9c2d-6274-4788-b3ea-0dc7edb1a4c9 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:37.741754 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb9c2d-6274-4788-b3ea-0dc7edb1a4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:37.760483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-a1bb9c2d-6274-4788-b3ea-0dc7edb1a4c9 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:37.761581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a1bb9c2d-6274-4788-b3ea-0dc7edb1a4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:37.766309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 691/1403] 10.222.0.73 () {58 vars in 1039 bytes} [Fri May 13 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:37.769578 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 713/1404] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:57:37.776348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e6ca4-0535-4179-af8f-4bac9e52f448 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:37.787167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e6ca4-0535-4179-af8f-4bac9e52f448 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:37.795204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335b0f5-2ff0-459f-b166-acfabc0ff825 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27265a0c2e6b47c09f28b9cd3ac47d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:37.796337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335b0f5-2ff0-459f-b166-acfabc0ff825 service swift] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:37.796808 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335b0f5-2ff0-459f-b166-acfabc0ff825 service swift] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:37.797268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335b0f5-2ff0-459f-b166-acfabc0ff825 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:37.812862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335b0f5-2ff0-459f-b166-acfabc0ff825 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:37.814958 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335b0f5-2ff0-459f-b166-acfabc0ff825 service swift] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:37.825805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 692/1405] 10.222.0.73 () {60 vars in 1384 bytes} [Fri May 13 14:57:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 14:57:37.830771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb9c2d-6274-4788-b3ea-0dc7edb1a4c9 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:37.845632 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb9c2d-6274-4788-b3ea-0dc7edb1a4c9 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:37.852749 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278002b-9b75-4915-a9ff-a5be4e89b994 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:37.853544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278002b-9b75-4915-a9ff-a5be4e89b994 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:37.853745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278002b-9b75-4915-a9ff-a5be4e89b994 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:37.853949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278002b-9b75-4915-a9ff-a5be4e89b994 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:37.866926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278002b-9b75-4915-a9ff-a5be4e89b994 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:37.868614 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278002b-9b75-4915-a9ff-a5be4e89b994 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:37.879434 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 714/1406] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:57:40.520046 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b87ef-6b80-492c-947b-c8d9f8b38b9a None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:40.520816 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b87ef-6b80-492c-947b-c8d9f8b38b9a None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:40.520816 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b87ef-6b80-492c-947b-c8d9f8b38b9a None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:40.522150 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 693/1407] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:57:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:57:40.528274 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebde84-131c-4b4d-86a5-f28418efdd57 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:40.529358 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebde84-131c-4b4d-86a5-f28418efdd57 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:40.529785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebde84-131c-4b4d-86a5-f28418efdd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:40.549994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-2bebde84-131c-4b4d-86a5-f28418efdd57 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:57:40.551911 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-2bebde84-131c-4b4d-86a5-f28418efdd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:57:40.574850 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 715/1408] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:57:40.609265 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b87ef-6b80-492c-947b-c8d9f8b38b9a None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:57:40.632875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b87ef-6b80-492c-947b-c8d9f8b38b9a None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:57:40.640612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df532b-69b1-474d-90af-0dba5a3de365 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:57:40.641380 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df532b-69b1-474d-90af-0dba5a3de365 service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:57:40.641634 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df532b-69b1-474d-90af-0dba5a3de365 service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:57:40.641909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df532b-69b1-474d-90af-0dba5a3de365 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:57:40.652466 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df532b-69b1-474d-90af-0dba5a3de365 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:57:40.654085 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df532b-69b1-474d-90af-0dba5a3de365 service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:57:40.666907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 694/1409] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:58:06.577174 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea808df-a9d9-4ea3-b37a-6a75deb69327 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:06.578302 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea808df-a9d9-4ea3-b37a-6a75deb69327 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:06.578302 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea808df-a9d9-4ea3-b37a-6a75deb69327 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:06.580453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 716/1410] 10.222.0.73 () {54 vars in 918 bytes} [Fri May 13 14:58:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:58:06.589410 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1b3b1-8f3b-4a7c-bfd9-c0bebb292940 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:06.590252 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1b3b1-8f3b-4a7c-bfd9-c0bebb292940 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:06.590592 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1b3b1-8f3b-4a7c-bfd9-c0bebb292940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:06.612084 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-56b1b3b1-8f3b-4a7c-bfd9-c0bebb292940 None None] MFA Rules not processed for user `908d23b035f14756b438b3a61a63b2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:06.613319 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-56b1b3b1-8f3b-4a7c-bfd9-c0bebb292940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:06.622244 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 695/1411] 10.222.0.73 () {58 vars in 1015 bytes} [Fri May 13 14:58:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:58:06.640169 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ee8f8-da1f-43af-8e13-889c998ae3f9 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:06.640501 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ee8f8-da1f-43af-8e13-889c998ae3f9 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:06.640697 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ee8f8-da1f-43af-8e13-889c998ae3f9 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:06.642084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 717/1412] 10.222.0.73 () {54 vars in 918 bytes} [Fri May 13 14:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:58:06.647636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce73cf-0422-4b6b-96e6-a3f6b09af67c None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:06.647926 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce73cf-0422-4b6b-96e6-a3f6b09af67c None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:06.648211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce73cf-0422-4b6b-96e6-a3f6b09af67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:06.668560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-dfce73cf-0422-4b6b-96e6-a3f6b09af67c None None] MFA Rules not processed for user `52d539202cfb40a48b231713e16a599a`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:06.669787 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-dfce73cf-0422-4b6b-96e6-a3f6b09af67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:06.680215 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 696/1413] 10.222.0.73 () {58 vars in 1015 bytes} [Fri May 13 14:58:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:58:09.668023 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442c7c6-1c3f-4953-8182-c958808a9e20 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:09.668653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442c7c6-1c3f-4953-8182-c958808a9e20 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:09.668653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442c7c6-1c3f-4953-8182-c958808a9e20 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:09.670207 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 718/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:58:09.677251 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59616f0-5af2-49e8-b8fb-32dd2535fb21 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:09.677822 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59616f0-5af2-49e8-b8fb-32dd2535fb21 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:09.677822 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59616f0-5af2-49e8-b8fb-32dd2535fb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:09.698152 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-c59616f0-5af2-49e8-b8fb-32dd2535fb21 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:09.699442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c59616f0-5af2-49e8-b8fb-32dd2535fb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:09.708531 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 697/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:58:09.781326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442c7c6-1c3f-4953-8182-c958808a9e20 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:09.798340 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442c7c6-1c3f-4953-8182-c958808a9e20 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:09.804962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253b389-38cb-4cfe-b668-9f6bac5cdba3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:09.805632 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253b389-38cb-4cfe-b668-9f6bac5cdba3 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:09.805911 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253b389-38cb-4cfe-b668-9f6bac5cdba3 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:09.806188 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253b389-38cb-4cfe-b668-9f6bac5cdba3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:09.816578 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253b389-38cb-4cfe-b668-9f6bac5cdba3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:09.818199 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253b389-38cb-4cfe-b668-9f6bac5cdba3 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:09.828758 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 719/1416] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:58:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:58:10.929520 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57575f9-9aa5-42b2-a2e6-0dccf7d00141 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:10.930296 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57575f9-9aa5-42b2-a2e6-0dccf7d00141 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:10.930296 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57575f9-9aa5-42b2-a2e6-0dccf7d00141 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:10.931751 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 698/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 14:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:58:10.937682 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421d0fd-2a8b-46ab-8f35-96c930cdfa3e None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:10.938389 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421d0fd-2a8b-46ab-8f35-96c930cdfa3e None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:10.938389 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421d0fd-2a8b-46ab-8f35-96c930cdfa3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:10.958389 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-d421d0fd-2a8b-46ab-8f35-96c930cdfa3e None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:10.959669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-d421d0fd-2a8b-46ab-8f35-96c930cdfa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:10.968404 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 720/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 14:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:58:11.180561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57575f9-9aa5-42b2-a2e6-0dccf7d00141 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:11.207296 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57575f9-9aa5-42b2-a2e6-0dccf7d00141 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:11.218259 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f49e7-faa6-4cb0-94ea-196fad56f053 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:11.219416 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f49e7-faa6-4cb0-94ea-196fad56f053 service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:11.219961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f49e7-faa6-4cb0-94ea-196fad56f053 service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:11.220408 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f49e7-faa6-4cb0-94ea-196fad56f053 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:11.235544 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f49e7-faa6-4cb0-94ea-196fad56f053 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:11.242440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f49e7-faa6-4cb0-94ea-196fad56f053 service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:11.254231 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 699/1419] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:58:12.329263 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a204e-1a2c-4a41-8049-6f0dbacce0ff None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:12.329263 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a204e-1a2c-4a41-8049-6f0dbacce0ff None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:12.329983 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a204e-1a2c-4a41-8049-6f0dbacce0ff None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:12.331408 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 721/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 14:58:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:58:12.338513 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43faef8-81d0-4b0e-8991-6ff827473bdd None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:12.339174 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43faef8-81d0-4b0e-8991-6ff827473bdd None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:12.339490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43faef8-81d0-4b0e-8991-6ff827473bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:12.369645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-c43faef8-81d0-4b0e-8991-6ff827473bdd None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:12.371838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c43faef8-81d0-4b0e-8991-6ff827473bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:12.385651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 700/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 14:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:58:12.545931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a204e-1a2c-4a41-8049-6f0dbacce0ff None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:12.565334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a204e-1a2c-4a41-8049-6f0dbacce0ff None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:12.570849 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7b2e7-8f7b-4421-bba8-f1d393c928c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:12.571491 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7b2e7-8f7b-4421-bba8-f1d393c928c0 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:12.571778 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7b2e7-8f7b-4421-bba8-f1d393c928c0 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:12.572040 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7b2e7-8f7b-4421-bba8-f1d393c928c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:12.581564 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7b2e7-8f7b-4421-bba8-f1d393c928c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:12.583396 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7b2e7-8f7b-4421-bba8-f1d393c928c0 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:12.594589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 722/1422] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:58:13.591700 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48232a42-a114-4913-9d22-1a2c56037a88 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:13.592310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48232a42-a114-4913-9d22-1a2c56037a88 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:13.592310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48232a42-a114-4913-9d22-1a2c56037a88 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:13.593749 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 701/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 14:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:58:13.600638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eee750-cf12-4080-bcc3-f88a17b21103 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:13.601220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eee750-cf12-4080-bcc3-f88a17b21103 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:13.601639 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eee750-cf12-4080-bcc3-f88a17b21103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:13.634303 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-49eee750-cf12-4080-bcc3-f88a17b21103 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:13.636498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-49eee750-cf12-4080-bcc3-f88a17b21103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:13.652190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 723/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 14:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:58:13.807274 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48232a42-a114-4913-9d22-1a2c56037a88 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:13.824134 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48232a42-a114-4913-9d22-1a2c56037a88 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:13.830047 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ef217-eb65-43ed-a4aa-0516b3863a12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:13.831286 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ef217-eb65-43ed-a4aa-0516b3863a12 service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:13.831566 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ef217-eb65-43ed-a4aa-0516b3863a12 service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:13.831843 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ef217-eb65-43ed-a4aa-0516b3863a12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:13.841006 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ef217-eb65-43ed-a4aa-0516b3863a12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:13.842670 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ef217-eb65-43ed-a4aa-0516b3863a12 service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:13.853780 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 702/1425] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:58:14.855096 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495b56d-a3fd-4c40-b0fa-d11655b71b5e None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:14.855777 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495b56d-a3fd-4c40-b0fa-d11655b71b5e None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:14.856095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495b56d-a3fd-4c40-b0fa-d11655b71b5e None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:14.858703 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 724/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 14:58:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:58:14.866215 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3b5b5-243d-47cf-81a6-cfd1198244c2 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:14.866854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3b5b5-243d-47cf-81a6-cfd1198244c2 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:14.866854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3b5b5-243d-47cf-81a6-cfd1198244c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:14.886738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-b1e3b5b5-243d-47cf-81a6-cfd1198244c2 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:14.888161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-b1e3b5b5-243d-47cf-81a6-cfd1198244c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:14.897575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 703/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 14:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:58:15.052189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495b56d-a3fd-4c40-b0fa-d11655b71b5e None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:15.068615 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495b56d-a3fd-4c40-b0fa-d11655b71b5e None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:15.074202 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687534b-75b0-4df6-9b99-42c18b8f7665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:15.074987 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687534b-75b0-4df6-9b99-42c18b8f7665 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:15.075268 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687534b-75b0-4df6-9b99-42c18b8f7665 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:15.075547 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687534b-75b0-4df6-9b99-42c18b8f7665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:15.085632 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687534b-75b0-4df6-9b99-42c18b8f7665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:15.087546 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687534b-75b0-4df6-9b99-42c18b8f7665 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:15.099612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 725/1428] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:58:16.050719 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2333f3-a520-4890-8c13-693f76051627 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:16.051668 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2333f3-a520-4890-8c13-693f76051627 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:16.051668 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2333f3-a520-4890-8c13-693f76051627 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:16.053355 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 704/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 14:58:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:58:16.059578 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5bb53-7b9c-41f2-a13d-ca1067e76266 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:16.060434 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5bb53-7b9c-41f2-a13d-ca1067e76266 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:16.060434 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5bb53-7b9c-41f2-a13d-ca1067e76266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:16.081361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-a3d5bb53-7b9c-41f2-a13d-ca1067e76266 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:16.082617 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a3d5bb53-7b9c-41f2-a13d-ca1067e76266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:16.090731 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 726/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 14:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:58:16.248239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2333f3-a520-4890-8c13-693f76051627 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:16.266192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2333f3-a520-4890-8c13-693f76051627 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:16.273427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932f998-5913-49c6-b7ba-bb0193f881b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:16.274335 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932f998-5913-49c6-b7ba-bb0193f881b4 service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:16.274682 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932f998-5913-49c6-b7ba-bb0193f881b4 service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:16.275039 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932f998-5913-49c6-b7ba-bb0193f881b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:16.285118 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932f998-5913-49c6-b7ba-bb0193f881b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:16.287020 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932f998-5913-49c6-b7ba-bb0193f881b4 service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:16.297768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 705/1431] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:58:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:58:17.216542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab51ea-1275-4376-b692-3951b3c41762 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:17.217364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab51ea-1275-4376-b692-3951b3c41762 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:17.217364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab51ea-1275-4376-b692-3951b3c41762 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:17.218944 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 727/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 14:58:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:58:17.224903 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c937389-e1be-441f-9e4f-b6d5564211e9 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:17.225482 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c937389-e1be-441f-9e4f-b6d5564211e9 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:17.225482 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c937389-e1be-441f-9e4f-b6d5564211e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:17.246252 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-5c937389-e1be-441f-9e4f-b6d5564211e9 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:17.247573 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-5c937389-e1be-441f-9e4f-b6d5564211e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:17.256218 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 706/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 14:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:58:17.409267 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab51ea-1275-4376-b692-3951b3c41762 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:17.425080 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab51ea-1275-4376-b692-3951b3c41762 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:17.431958 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae6111-796f-4b56-b634-215e6bcdb0f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:17.432788 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae6111-796f-4b56-b634-215e6bcdb0f9 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:17.433168 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae6111-796f-4b56-b634-215e6bcdb0f9 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:17.433559 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae6111-796f-4b56-b634-215e6bcdb0f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:17.444421 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae6111-796f-4b56-b634-215e6bcdb0f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:17.446037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae6111-796f-4b56-b634-215e6bcdb0f9 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:17.456941 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 728/1434] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:58:18.598508 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626aec9-8976-409a-be65-147b0df748c1 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:18.599245 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626aec9-8976-409a-be65-147b0df748c1 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:18.599245 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626aec9-8976-409a-be65-147b0df748c1 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:18.600631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 707/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 14:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:58:18.606650 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bef3d-fe76-4d30-87de-bac4501478f4 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:18.607303 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bef3d-fe76-4d30-87de-bac4501478f4 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:18.607303 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bef3d-fe76-4d30-87de-bac4501478f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:18.633753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-3d0bef3d-fe76-4d30-87de-bac4501478f4 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:18.636003 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-3d0bef3d-fe76-4d30-87de-bac4501478f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:18.650744 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 729/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 14:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:58:18.804937 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626aec9-8976-409a-be65-147b0df748c1 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:18.821429 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626aec9-8976-409a-be65-147b0df748c1 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:18.827898 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee89bb-9d8f-46dc-85f7-c7bfeb64cdbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:18.828575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee89bb-9d8f-46dc-85f7-c7bfeb64cdbf service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:18.828859 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee89bb-9d8f-46dc-85f7-c7bfeb64cdbf service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:18.829135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee89bb-9d8f-46dc-85f7-c7bfeb64cdbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:18.839569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee89bb-9d8f-46dc-85f7-c7bfeb64cdbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:18.841185 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee89bb-9d8f-46dc-85f7-c7bfeb64cdbf service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:18.851876 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 708/1437] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:58:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:58:19.775518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80c5c6-c61c-48bd-86f0-285d81313e81 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:19.776300 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80c5c6-c61c-48bd-86f0-285d81313e81 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:19.776300 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80c5c6-c61c-48bd-86f0-285d81313e81 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:19.777539 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 730/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 14:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:58:19.783823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d074a-4999-4db4-b2b6-98f45e941ae3 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:19.784381 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d074a-4999-4db4-b2b6-98f45e941ae3 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:19.784381 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d074a-4999-4db4-b2b6-98f45e941ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:19.804392 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-ef7d074a-4999-4db4-b2b6-98f45e941ae3 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:19.805625 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ef7d074a-4999-4db4-b2b6-98f45e941ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:19.814626 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 709/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 14:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:58:19.967333 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80c5c6-c61c-48bd-86f0-285d81313e81 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:19.982754 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80c5c6-c61c-48bd-86f0-285d81313e81 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:19.988972 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41107b-d2b5-41be-895e-b85116a0e8ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:19.989721 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41107b-d2b5-41be-895e-b85116a0e8ec service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:19.990111 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41107b-d2b5-41be-895e-b85116a0e8ec service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:19.990484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41107b-d2b5-41be-895e-b85116a0e8ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:19.999893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41107b-d2b5-41be-895e-b85116a0e8ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:20.001674 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41107b-d2b5-41be-895e-b85116a0e8ec service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:20.012061 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 731/1440] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:58:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:58:22.270046 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97aafd-d68d-42c0-abe1-3a744fa2c3c0 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:22.270672 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97aafd-d68d-42c0-abe1-3a744fa2c3c0 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:22.270672 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97aafd-d68d-42c0-abe1-3a744fa2c3c0 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:22.271975 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 710/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:58:22.278257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59653b5-76aa-4a0a-bfd6-1b22111c7e8b None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:22.280652 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59653b5-76aa-4a0a-bfd6-1b22111c7e8b None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:22.280652 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59653b5-76aa-4a0a-bfd6-1b22111c7e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:22.298763 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-f59653b5-76aa-4a0a-bfd6-1b22111c7e8b None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:22.300055 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-f59653b5-76aa-4a0a-bfd6-1b22111c7e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:22.308685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 732/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:58:22.354608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97aafd-d68d-42c0-abe1-3a744fa2c3c0 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:22.366200 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97aafd-d68d-42c0-abe1-3a744fa2c3c0 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:22.369813 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89025d-9b41-4f4d-988e-2f737d523d11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:22.370468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89025d-9b41-4f4d-988e-2f737d523d11 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:22.370745 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89025d-9b41-4f4d-988e-2f737d523d11 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:22.371067 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89025d-9b41-4f4d-988e-2f737d523d11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:22.380951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89025d-9b41-4f4d-988e-2f737d523d11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:22.382407 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89025d-9b41-4f4d-988e-2f737d523d11 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:22.393536 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 711/1443] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:58:24.908629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27267a31-3958-471a-996f-2af1219e154d None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:24.909280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27267a31-3958-471a-996f-2af1219e154d None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:24.909280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27267a31-3958-471a-996f-2af1219e154d None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:24.911005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 733/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:58:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:58:24.917251 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf461ee5-e8aa-4669-90fe-bef418d65fce None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:24.917876 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf461ee5-e8aa-4669-90fe-bef418d65fce None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:24.917876 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf461ee5-e8aa-4669-90fe-bef418d65fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:24.938031 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-bf461ee5-e8aa-4669-90fe-bef418d65fce None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:24.939928 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-bf461ee5-e8aa-4669-90fe-bef418d65fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:24.948965 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 712/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:58:24.990312 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27267a31-3958-471a-996f-2af1219e154d None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:25.002949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27267a31-3958-471a-996f-2af1219e154d None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:25.007278 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba43fad-f464-4c50-9a99-e86c449cd94c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:25.008090 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba43fad-f464-4c50-9a99-e86c449cd94c service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:25.008469 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba43fad-f464-4c50-9a99-e86c449cd94c service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:25.008853 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba43fad-f464-4c50-9a99-e86c449cd94c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:25.020217 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba43fad-f464-4c50-9a99-e86c449cd94c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:25.021736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba43fad-f464-4c50-9a99-e86c449cd94c service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:25.032713 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 734/1446] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:58:27.847244 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a5f22-dbb6-489d-88d0-ae8f730c3f6e None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:27.848151 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a5f22-dbb6-489d-88d0-ae8f730c3f6e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:27.848151 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a5f22-dbb6-489d-88d0-ae8f730c3f6e None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:27.849470 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 713/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:58:27.855472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c4de1-43a1-4214-906f-26c9d5c83efd None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:27.856044 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c4de1-43a1-4214-906f-26c9d5c83efd None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:27.856149 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c4de1-43a1-4214-906f-26c9d5c83efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:27.875379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-aa4c4de1-43a1-4214-906f-26c9d5c83efd None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:27.877108 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-aa4c4de1-43a1-4214-906f-26c9d5c83efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:27.885071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 735/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:58:27.926494 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a5f22-dbb6-489d-88d0-ae8f730c3f6e None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:27.942633 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a5f22-dbb6-489d-88d0-ae8f730c3f6e None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:27.946566 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94538c57-53ae-4cff-9d68-02f58aee5dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:27.949097 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94538c57-53ae-4cff-9d68-02f58aee5dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:27.949097 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94538c57-53ae-4cff-9d68-02f58aee5dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:27.949097 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94538c57-53ae-4cff-9d68-02f58aee5dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:27.958058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94538c57-53ae-4cff-9d68-02f58aee5dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:27.959560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94538c57-53ae-4cff-9d68-02f58aee5dc7 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:27.970121 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 714/1449] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:58:30.571439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64401a7d-0e63-4d1b-a532-0dca4add3cc9 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:30.572084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64401a7d-0e63-4d1b-a532-0dca4add3cc9 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:30.572084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64401a7d-0e63-4d1b-a532-0dca4add3cc9 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:30.574475 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 736/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:58:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:58:30.580814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b407d20-97fa-4486-a958-82b002d49ada None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:30.581457 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b407d20-97fa-4486-a958-82b002d49ada None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:30.581457 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b407d20-97fa-4486-a958-82b002d49ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:30.601936 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-1b407d20-97fa-4486-a958-82b002d49ada None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:30.603205 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-1b407d20-97fa-4486-a958-82b002d49ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:30.611907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 715/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:58:30.652467 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64401a7d-0e63-4d1b-a532-0dca4add3cc9 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:30.663456 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64401a7d-0e63-4d1b-a532-0dca4add3cc9 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:30.667189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb26788-a45f-472b-ba41-e0388e921260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:30.667889 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb26788-a45f-472b-ba41-e0388e921260 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:30.668208 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb26788-a45f-472b-ba41-e0388e921260 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:30.668521 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb26788-a45f-472b-ba41-e0388e921260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:30.679229 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb26788-a45f-472b-ba41-e0388e921260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:30.680816 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb26788-a45f-472b-ba41-e0388e921260 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:30.692838 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 737/1452] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:58:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:58:33.192755 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cc168-c86a-42ed-b453-42739ad29ac1 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:33.193364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cc168-c86a-42ed-b453-42739ad29ac1 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:33.193536 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cc168-c86a-42ed-b453-42739ad29ac1 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:33.195132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 716/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:58:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:58:33.201535 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86be495-f946-4550-b8d6-210df211ffb1 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:33.202362 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86be495-f946-4550-b8d6-210df211ffb1 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:33.202527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86be495-f946-4550-b8d6-210df211ffb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:33.224102 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-a86be495-f946-4550-b8d6-210df211ffb1 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:33.225408 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a86be495-f946-4550-b8d6-210df211ffb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:33.234041 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 738/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:58:33.273981 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7cc168-c86a-42ed-b453-42739ad29ac1 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:33.286232 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7cc168-c86a-42ed-b453-42739ad29ac1 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:33.290221 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3c6a6-13de-4a0b-8741-4782e1efea65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:33.290922 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3c6a6-13de-4a0b-8741-4782e1efea65 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:33.291206 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3c6a6-13de-4a0b-8741-4782e1efea65 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:33.291483 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3c6a6-13de-4a0b-8741-4782e1efea65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:33.302868 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3c6a6-13de-4a0b-8741-4782e1efea65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:33.304342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3c6a6-13de-4a0b-8741-4782e1efea65 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:33.315601 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 717/1455] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:58:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:58:35.799706 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e510e0-374f-44b6-963a-f483ad9fb472 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:35.800598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e510e0-374f-44b6-963a-f483ad9fb472 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:35.800765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e510e0-374f-44b6-963a-f483ad9fb472 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:35.802240 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 739/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:58:35.808735 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa46cf-39c3-40be-82aa-10a74f074a40 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:35.809394 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa46cf-39c3-40be-82aa-10a74f074a40 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:35.809394 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa46cf-39c3-40be-82aa-10a74f074a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:35.828029 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-70fa46cf-39c3-40be-82aa-10a74f074a40 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:35.829258 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-70fa46cf-39c3-40be-82aa-10a74f074a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:35.837984 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 718/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:58:35.877206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e510e0-374f-44b6-963a-f483ad9fb472 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:35.888553 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e510e0-374f-44b6-963a-f483ad9fb472 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:35.892775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365ba56-b6fe-4712-a350-f5b07e7d62ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:35.893428 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365ba56-b6fe-4712-a350-f5b07e7d62ff service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:35.893703 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365ba56-b6fe-4712-a350-f5b07e7d62ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:35.893970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365ba56-b6fe-4712-a350-f5b07e7d62ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:35.908635 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365ba56-b6fe-4712-a350-f5b07e7d62ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:35.910238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365ba56-b6fe-4712-a350-f5b07e7d62ff service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:35.921301 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 740/1458] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:58:38.386192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e68798-9a71-4bfa-b64a-3f4a04cd8a32 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:38.386802 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e68798-9a71-4bfa-b64a-3f4a04cd8a32 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:38.386802 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e68798-9a71-4bfa-b64a-3f4a04cd8a32 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:38.388457 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 719/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:58:38.395260 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffab0e7-2141-4820-8041-5a52483118fb None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:38.395911 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffab0e7-2141-4820-8041-5a52483118fb None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:38.395911 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffab0e7-2141-4820-8041-5a52483118fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:38.414013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-bffab0e7-2141-4820-8041-5a52483118fb None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:38.415361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-bffab0e7-2141-4820-8041-5a52483118fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:38.424198 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 741/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:58:38.464777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e68798-9a71-4bfa-b64a-3f4a04cd8a32 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:38.475778 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e68798-9a71-4bfa-b64a-3f4a04cd8a32 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:38.479389 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d95062-427a-480b-9378-eabd2b48b97b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:38.480044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d95062-427a-480b-9378-eabd2b48b97b service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:38.480323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d95062-427a-480b-9378-eabd2b48b97b service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:38.480599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d95062-427a-480b-9378-eabd2b48b97b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:38.490731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d95062-427a-480b-9378-eabd2b48b97b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:38.492220 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d95062-427a-480b-9378-eabd2b48b97b service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:38.503825 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 720/1461] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:58:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:58:40.999252 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d5ff7-dac0-43ff-86c2-4bbf4a2316ed None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:40.999866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d5ff7-dac0-43ff-86c2-4bbf4a2316ed None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:40.999866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d5ff7-dac0-43ff-86c2-4bbf4a2316ed None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:41.001420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 742/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:58:41.007634 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d19af-dc52-477c-9da5-e2232f227cdd None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:41.008286 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d19af-dc52-477c-9da5-e2232f227cdd None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:41.008286 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d19af-dc52-477c-9da5-e2232f227cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:41.028191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-090d19af-dc52-477c-9da5-e2232f227cdd None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:41.029550 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-090d19af-dc52-477c-9da5-e2232f227cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:41.039651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 721/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:58:41.080269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d5ff7-dac0-43ff-86c2-4bbf4a2316ed None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:41.093386 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d5ff7-dac0-43ff-86c2-4bbf4a2316ed None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:41.099990 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c970b-7368-4136-a46d-e64afbfbea1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:41.100656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c970b-7368-4136-a46d-e64afbfbea1a service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:41.100936 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c970b-7368-4136-a46d-e64afbfbea1a service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:41.101210 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c970b-7368-4136-a46d-e64afbfbea1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:41.111930 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c970b-7368-4136-a46d-e64afbfbea1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:41.113557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c970b-7368-4136-a46d-e64afbfbea1a service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:41.123956 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 743/1464] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:58:43.538107 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1b850-50bf-47e0-9e01-8d5ab394938e None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:43.538732 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1b850-50bf-47e0-9e01-8d5ab394938e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:43.538901 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1b850-50bf-47e0-9e01-8d5ab394938e None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:43.540394 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 722/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:58:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:58:43.546605 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88a3c1-bae8-4a8e-b248-95d17d17007f None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:43.547339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88a3c1-bae8-4a8e-b248-95d17d17007f None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:43.547513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88a3c1-bae8-4a8e-b248-95d17d17007f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:43.569495 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-9a88a3c1-bae8-4a8e-b248-95d17d17007f None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:43.570953 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-9a88a3c1-bae8-4a8e-b248-95d17d17007f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:43.579552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 744/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:58:43.645479 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1b850-50bf-47e0-9e01-8d5ab394938e None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:43.664163 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1b850-50bf-47e0-9e01-8d5ab394938e None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:43.670462 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd0e2b-f0f2-44fe-bcc5-6c5088e66e86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:43.671634 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd0e2b-f0f2-44fe-bcc5-6c5088e66e86 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:43.672125 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd0e2b-f0f2-44fe-bcc5-6c5088e66e86 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:43.672593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd0e2b-f0f2-44fe-bcc5-6c5088e66e86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:43.690227 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd0e2b-f0f2-44fe-bcc5-6c5088e66e86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:43.693031 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd0e2b-f0f2-44fe-bcc5-6c5088e66e86 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:43.710473 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 723/1467] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:58:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:58:46.107542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07a1db-feee-40b2-a415-5afdc5f3e22a None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:46.108402 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07a1db-feee-40b2-a415-5afdc5f3e22a None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:46.108592 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07a1db-feee-40b2-a415-5afdc5f3e22a None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:46.110115 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 745/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 14:58:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:58:46.116642 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef21397-8503-4246-b097-da6c59dad05a None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:46.117471 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef21397-8503-4246-b097-da6c59dad05a None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:46.117651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef21397-8503-4246-b097-da6c59dad05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:46.137007 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-4ef21397-8503-4246-b097-da6c59dad05a None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:58:46.138239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-4ef21397-8503-4246-b097-da6c59dad05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:58:46.146909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 724/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:58:46.185442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07a1db-feee-40b2-a415-5afdc5f3e22a None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:58:46.203800 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07a1db-feee-40b2-a415-5afdc5f3e22a None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:58:46.210327 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323bfb9-1d49-418c-96b4-b7b39d293660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:58:46.211515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323bfb9-1d49-418c-96b4-b7b39d293660 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:58:46.212020 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323bfb9-1d49-418c-96b4-b7b39d293660 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:58:46.212523 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323bfb9-1d49-418c-96b4-b7b39d293660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:58:46.229770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323bfb9-1d49-418c-96b4-b7b39d293660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:58:46.232639 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323bfb9-1d49-418c-96b4-b7b39d293660 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:58:46.247322 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 746/1470] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:58:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:59:21.030379 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0de08-b116-46ee-9b46-902353f45925 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:21.031120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0de08-b116-46ee-9b46-902353f45925 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:21.031120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0de08-b116-46ee-9b46-902353f45925 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:21.032975 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 725/1471] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:59:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:59:21.038953 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fb391-b757-4fc9-b8be-89dfb86076ab None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:21.039821 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fb391-b757-4fc9-b8be-89dfb86076ab None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:21.039821 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fb391-b757-4fc9-b8be-89dfb86076ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:21.059697 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-1b8fb391-b757-4fc9-b8be-89dfb86076ab None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:59:21.060925 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-1b8fb391-b757-4fc9-b8be-89dfb86076ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:59:21.069893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 747/1472] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:59:21.122490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3996dd-d998-48fb-bcc5-b8110cc92ecf None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:21.122783 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3996dd-d998-48fb-bcc5-b8110cc92ecf None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:21.123080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3996dd-d998-48fb-bcc5-b8110cc92ecf None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:21.124510 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 726/1473] 10.222.0.73 () {54 vars in 962 bytes} [Fri May 13 14:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:59:21.129987 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c4de6-5cff-4567-bfdf-4926bef6ff87 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:21.130362 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c4de6-5cff-4567-bfdf-4926bef6ff87 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:21.130709 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c4de6-5cff-4567-bfdf-4926bef6ff87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:21.150353 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-b20c4de6-5cff-4567-bfdf-4926bef6ff87 None None] MFA Rules not processed for user `6cdd8008619d4ee3b8fe45e0e5241878`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:59:21.151891 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-b20c4de6-5cff-4567-bfdf-4926bef6ff87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:59:21.159714 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 748/1474] 10.222.0.73 () {58 vars in 1059 bytes} [Fri May 13 14:59:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:59:21.167807 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3996dd-d998-48fb-bcc5-b8110cc92ecf None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:59:21.181874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3996dd-d998-48fb-bcc5-b8110cc92ecf None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:59:21.185955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9360a14-1508-4d94-999a-8b5a53a0d406 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdd8008619d4ee3b8fe45e0e5241878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:59:21.186617 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9360a14-1508-4d94-999a-8b5a53a0d406 service glance] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:21.186932 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9360a14-1508-4d94-999a-8b5a53a0d406 service glance] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:21.187500 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9360a14-1508-4d94-999a-8b5a53a0d406 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:21.197621 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9360a14-1508-4d94-999a-8b5a53a0d406 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:59:21.199114 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9360a14-1508-4d94-999a-8b5a53a0d406 service glance] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:59:21.209975 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 727/1475] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:59:23.672717 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9b033-f440-4dc5-8e67-203719f30d07 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:23.673634 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9b033-f440-4dc5-8e67-203719f30d07 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:23.673634 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9b033-f440-4dc5-8e67-203719f30d07 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:23.674696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 749/1476] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:59:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:59:23.680839 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c416285-520f-41a9-99b7-ca70dfd46916 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:23.681677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c416285-520f-41a9-99b7-ca70dfd46916 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:23.681890 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c416285-520f-41a9-99b7-ca70dfd46916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:23.704681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-4c416285-520f-41a9-99b7-ca70dfd46916 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:59:23.705920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-4c416285-520f-41a9-99b7-ca70dfd46916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:59:23.714430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 728/1477] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:59:23.738482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9b033-f440-4dc5-8e67-203719f30d07 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:59:23.753366 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9b033-f440-4dc5-8e67-203719f30d07 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:59:23.758133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97591f2b-87d8-4eed-8edb-d1acc55f135b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:59:23.758805 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97591f2b-87d8-4eed-8edb-d1acc55f135b admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:23.759116 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97591f2b-87d8-4eed-8edb-d1acc55f135b admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:23.759391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97591f2b-87d8-4eed-8edb-d1acc55f135b admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:23.760133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97591f2b-87d8-4eed-8edb-d1acc55f135b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:59:23.761998 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: WARNING py.warnings [None req-97591f2b-87d8-4eed-8edb-d1acc55f135b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 14:59:23.761998 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: warnings.warn(msg) May 13 14:59:23.761998 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: May 13 14:59:23.763201 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97591f2b-87d8-4eed-8edb-d1acc55f135b admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:59:23.784637 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 750/1478] 10.222.0.73 () {56 vars in 1108 bytes} [Fri May 13 14:59:23 2022] GET /identity/v3/projects => generated 2553 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 14:59:26.166607 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb299c-2ff6-4cb4-8b37-997f47269a68 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:26.167396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb299c-2ff6-4cb4-8b37-997f47269a68 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:26.167396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb299c-2ff6-4cb4-8b37-997f47269a68 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:26.168621 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 729/1479] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:59:26.175175 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ce09a-30de-4b99-bc3d-6cecaa442e24 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:26.175744 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ce09a-30de-4b99-bc3d-6cecaa442e24 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:26.175744 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ce09a-30de-4b99-bc3d-6cecaa442e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:26.195291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-227ce09a-30de-4b99-bc3d-6cecaa442e24 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:59:26.196529 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-227ce09a-30de-4b99-bc3d-6cecaa442e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:59:26.204887 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 751/1480] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:59:26.253041 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb299c-2ff6-4cb4-8b37-997f47269a68 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:59:26.268197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb299c-2ff6-4cb4-8b37-997f47269a68 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:59:26.274459 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a109e9c-ba87-4631-8e42-9fa39fff3777 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:59:26.275159 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a109e9c-ba87-4631-8e42-9fa39fff3777 service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:26.275453 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a109e9c-ba87-4631-8e42-9fa39fff3777 service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:26.275726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a109e9c-ba87-4631-8e42-9fa39fff3777 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:26.285790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a109e9c-ba87-4631-8e42-9fa39fff3777 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:59:26.287809 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a109e9c-ba87-4631-8e42-9fa39fff3777 service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:59:26.299520 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 730/1481] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:59:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:59:29.008806 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69159dd6-36e6-4c22-b78f-0a3ac258e3c5 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:29.009670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69159dd6-36e6-4c22-b78f-0a3ac258e3c5 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:29.009670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69159dd6-36e6-4c22-b78f-0a3ac258e3c5 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:29.010808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 752/1482] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 14:59:29.017475 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a050de-2da8-4146-bfea-fd8e00bd7159 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:29.018090 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a050de-2da8-4146-bfea-fd8e00bd7159 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:29.018090 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a050de-2da8-4146-bfea-fd8e00bd7159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:29.037168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-b7a050de-2da8-4146-bfea-fd8e00bd7159 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:59:29.038416 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-b7a050de-2da8-4146-bfea-fd8e00bd7159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:59:29.048512 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 731/1483] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:59:29.087211 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69159dd6-36e6-4c22-b78f-0a3ac258e3c5 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:59:29.099146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69159dd6-36e6-4c22-b78f-0a3ac258e3c5 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:59:29.103467 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e30aab-958d-4315-8f0a-9e7fdaf1f54d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:59:29.104239 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e30aab-958d-4315-8f0a-9e7fdaf1f54d service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:29.104549 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e30aab-958d-4315-8f0a-9e7fdaf1f54d service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:29.104837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e30aab-958d-4315-8f0a-9e7fdaf1f54d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:29.114658 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e30aab-958d-4315-8f0a-9e7fdaf1f54d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:59:29.116162 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e30aab-958d-4315-8f0a-9e7fdaf1f54d service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:59:29.129822 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 753/1484] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:59:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 14:59:31.554119 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5a1f0-e00f-458c-a32c-660592b61a50 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:31.555327 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5a1f0-e00f-458c-a32c-660592b61a50 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:31.555869 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5a1f0-e00f-458c-a32c-660592b61a50 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:31.558675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 732/1485] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:59:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:59:31.565744 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2a763-48aa-4462-9b09-b02cf6c4ef51 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:31.566610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2a763-48aa-4462-9b09-b02cf6c4ef51 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:31.566610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2a763-48aa-4462-9b09-b02cf6c4ef51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:31.584298 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-a6a2a763-48aa-4462-9b09-b02cf6c4ef51 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:59:31.585526 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a6a2a763-48aa-4462-9b09-b02cf6c4ef51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:59:31.594235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 754/1486] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:59:31.633437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5a1f0-e00f-458c-a32c-660592b61a50 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:59:31.646624 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5a1f0-e00f-458c-a32c-660592b61a50 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:59:31.651709 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0398620-266b-4be2-980a-06faafc0d8d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:59:31.652336 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0398620-266b-4be2-980a-06faafc0d8d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:31.652622 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0398620-266b-4be2-980a-06faafc0d8d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:31.652901 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0398620-266b-4be2-980a-06faafc0d8d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:31.664913 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0398620-266b-4be2-980a-06faafc0d8d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:59:31.666361 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0398620-266b-4be2-980a-06faafc0d8d6 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:59:31.677274 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 733/1487] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:59:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:59:34.343939 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60641557-5217-44a5-b898-13ef8ce6cc6b None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:34.344826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60641557-5217-44a5-b898-13ef8ce6cc6b None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:34.344826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60641557-5217-44a5-b898-13ef8ce6cc6b None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:34.346420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 755/1488] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:59:34.352602 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097f25b-27a1-45e2-9ce6-275f983508d3 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:34.353201 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097f25b-27a1-45e2-9ce6-275f983508d3 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:34.353201 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097f25b-27a1-45e2-9ce6-275f983508d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:34.371673 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-7097f25b-27a1-45e2-9ce6-275f983508d3 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:59:34.372909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-7097f25b-27a1-45e2-9ce6-275f983508d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:59:34.381436 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 734/1489] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 14:59:34.424573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60641557-5217-44a5-b898-13ef8ce6cc6b None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:59:34.436692 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60641557-5217-44a5-b898-13ef8ce6cc6b None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:59:34.441805 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4b87a-b239-49a3-8e39-2a5bf682eab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:59:34.442653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4b87a-b239-49a3-8e39-2a5bf682eab4 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:34.443106 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4b87a-b239-49a3-8e39-2a5bf682eab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:34.443507 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4b87a-b239-49a3-8e39-2a5bf682eab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:34.454494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4b87a-b239-49a3-8e39-2a5bf682eab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:59:34.456060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4b87a-b239-49a3-8e39-2a5bf682eab4 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:59:34.466893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 756/1490] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:59:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 14:59:37.118482 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7df6e-2a01-4929-962f-73f4a369f7dc None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:37.119141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7df6e-2a01-4929-962f-73f4a369f7dc None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:37.119141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7df6e-2a01-4929-962f-73f4a369f7dc None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:37.120644 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 735/1491] 10.222.0.73 () {54 vars in 926 bytes} [Fri May 13 14:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 14:59:37.127542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff5a8f-d7da-49cb-a3cc-520bf8f32a3f None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:37.128164 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff5a8f-d7da-49cb-a3cc-520bf8f32a3f None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:37.128164 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff5a8f-d7da-49cb-a3cc-520bf8f32a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:37.148542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-5fff5a8f-d7da-49cb-a3cc-520bf8f32a3f None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 14:59:37.149770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-5fff5a8f-d7da-49cb-a3cc-520bf8f32a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 14:59:37.158347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 757/1492] 10.222.0.73 () {58 vars in 1023 bytes} [Fri May 13 14:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 14:59:37.198446 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7df6e-2a01-4929-962f-73f4a369f7dc None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 14:59:37.210065 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7df6e-2a01-4929-962f-73f4a369f7dc None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 14:59:37.213770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e8b2f-db3d-44d2-9d98-c6b8285302a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 14:59:37.214422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e8b2f-db3d-44d2-9d98-c6b8285302a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 14:59:37.214696 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e8b2f-db3d-44d2-9d98-c6b8285302a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 14:59:37.214997 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e8b2f-db3d-44d2-9d98-c6b8285302a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 14:59:37.225795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e8b2f-db3d-44d2-9d98-c6b8285302a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 14:59:37.227352 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e8b2f-db3d-44d2-9d98-c6b8285302a8 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 14:59:37.239431 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 736/1493] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 14:59:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:01:35.233977 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6bf41-16f6-4840-9cd8-9f973a981543 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:35.234715 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6bf41-16f6-4840-9cd8-9f973a981543 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:35.234715 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6bf41-16f6-4840-9cd8-9f973a981543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:35.253984 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-99e6bf41-16f6-4840-9cd8-9f973a981543 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:01:35.255258 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-99e6bf41-16f6-4840-9cd8-9f973a981543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:35.263501 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 758/1494] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:01:35.273279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e57390-9b04-4958-9afa-f5dcbb70b6ac None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:35.273922 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e57390-9b04-4958-9afa-f5dcbb70b6ac None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:35.273922 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e57390-9b04-4958-9afa-f5dcbb70b6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:35.293361 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-31e57390-9b04-4958-9afa-f5dcbb70b6ac None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:01:35.294624 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-31e57390-9b04-4958-9afa-f5dcbb70b6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:35.302686 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 737/1495] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:01:35.308412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6bf41-16f6-4840-9cd8-9f973a981543 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:35.323576 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6bf41-16f6-4840-9cd8-9f973a981543 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:35.328623 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b16b2-d0f4-4990-af0c-1d1190dae261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:35.329350 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b16b2-d0f4-4990-af0c-1d1190dae261 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:35.329638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b16b2-d0f4-4990-af0c-1d1190dae261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:35.329922 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b16b2-d0f4-4990-af0c-1d1190dae261 admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:35.330685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b16b2-d0f4-4990-af0c-1d1190dae261 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:01:35.331028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b16b2-d0f4-4990-af0c-1d1190dae261 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:35.332074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: WARNING py.warnings [None req-b06b16b2-d0f4-4990-af0c-1d1190dae261 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 15:01:35.332074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: warnings.warn(msg) May 13 15:01:35.332074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: May 13 15:01:35.332987 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b16b2-d0f4-4990-af0c-1d1190dae261 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:35.349652 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 759/1496] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 15:01:35.363800 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e57390-9b04-4958-9afa-f5dcbb70b6ac None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:35.373442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e57390-9b04-4958-9afa-f5dcbb70b6ac None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:35.378341 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225d49f-d132-4303-bbfe-f6171b324bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:35.379047 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225d49f-d132-4303-bbfe-f6171b324bcb admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:35.379335 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225d49f-d132-4303-bbfe-f6171b324bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:35.379612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225d49f-d132-4303-bbfe-f6171b324bcb admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:35.380317 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225d49f-d132-4303-bbfe-f6171b324bcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:35.382152 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: WARNING py.warnings [None req-3225d49f-d132-4303-bbfe-f6171b324bcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 15:01:35.382152 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: warnings.warn(msg) May 13 15:01:35.382152 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: May 13 15:01:35.383594 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225d49f-d132-4303-bbfe-f6171b324bcb admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:35.437990 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 738/1497] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:01:35 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:01:35.442609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b16b2-d0f4-4990-af0c-1d1190dae261 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:35.453199 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b16b2-d0f4-4990-af0c-1d1190dae261 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:35.513298 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8d31c-263d-4bdd-bb38-799ff2d9eaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:35.513944 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8d31c-263d-4bdd-bb38-799ff2d9eaa3 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:35.514276 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8d31c-263d-4bdd-bb38-799ff2d9eaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:35.514607 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8d31c-263d-4bdd-bb38-799ff2d9eaa3 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:35.515427 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8d31c-263d-4bdd-bb38-799ff2d9eaa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:35.516506 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: WARNING py.warnings [None req-0ee8d31c-263d-4bdd-bb38-799ff2d9eaa3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 15:01:35.516506 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: warnings.warn(msg) May 13 15:01:35.516506 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: May 13 15:01:35.517876 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8d31c-263d-4bdd-bb38-799ff2d9eaa3 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:35.540437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 760/1498] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:01:35 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:01:35.547028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225d49f-d132-4303-bbfe-f6171b324bcb admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:35.558543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225d49f-d132-4303-bbfe-f6171b324bcb admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:35.564503 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4e1a4-8ecb-4398-b3ad-3058aeb6b96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:35.565200 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4e1a4-8ecb-4398-b3ad-3058aeb6b96a admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:35.565487 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4e1a4-8ecb-4398-b3ad-3058aeb6b96a admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:35.565768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4e1a4-8ecb-4398-b3ad-3058aeb6b96a admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:35.566524 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4e1a4-8ecb-4398-b3ad-3058aeb6b96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:35.567685 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: WARNING py.warnings [None req-d2b4e1a4-8ecb-4398-b3ad-3058aeb6b96a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 15:01:35.567685 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: warnings.warn(msg) May 13 15:01:35.567685 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: May 13 15:01:35.568588 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4e1a4-8ecb-4398-b3ad-3058aeb6b96a admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:35.583687 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 739/1499] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:01:35.588754 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8d31c-263d-4bdd-bb38-799ff2d9eaa3 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:35.599370 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8d31c-263d-4bdd-bb38-799ff2d9eaa3 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:35.605436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbba89-56e0-4dda-8987-35a47badb3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:35.606162 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbba89-56e0-4dda-8987-35a47badb3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:35.606460 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbba89-56e0-4dda-8987-35a47badb3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:35.606752 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbba89-56e0-4dda-8987-35a47badb3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:35.607598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbba89-56e0-4dda-8987-35a47badb3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:35.608735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: WARNING py.warnings [None req-8fdbba89-56e0-4dda-8987-35a47badb3a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 15:01:35.608735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: warnings.warn(msg) May 13 15:01:35.608735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: May 13 15:01:35.609649 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbba89-56e0-4dda-8987-35a47badb3a1 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:35.624795 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 761/1500] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:01:35.629233 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4e1a4-8ecb-4398-b3ad-3058aeb6b96a admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:35.639897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4e1a4-8ecb-4398-b3ad-3058aeb6b96a admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:35.644654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a59a30-f869-494d-aa45-63be28ff5a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:35.645573 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a59a30-f869-494d-aa45-63be28ff5a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:35.645854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a59a30-f869-494d-aa45-63be28ff5a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:35.646126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a59a30-f869-494d-aa45-63be28ff5a4f admin admin] PATH_INFO: `/v3/projects/2a3b42368c3f4e1f9a87b62c30b90e7b/users/a095846a0d944299b437c38b0a763536/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:35.665485 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a59a30-f869-494d-aa45-63be28ff5a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a3b42368c3f4e1f9a87b62c30b90e7b, user_id=a095846a0d944299b437c38b0a763536, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:35.667195 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: WARNING py.warnings [None req-52a59a30-f869-494d-aa45-63be28ff5a4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 15:01:35.667195 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: warnings.warn(msg) May 13 15:01:35.667195 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: May 13 15:01:35.669299 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a59a30-f869-494d-aa45-63be28ff5a4f admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:35.685424 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 740/1501] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:01:35 2022] PUT /identity/v3/projects/2a3b42368c3f4e1f9a87b62c30b90e7b/users/a095846a0d944299b437c38b0a763536/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:01:35.699124 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d06a7-03bd-47f1-a77a-dafc077e7255 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:35.699558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d06a7-03bd-47f1-a77a-dafc077e7255 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:35.699932 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d06a7-03bd-47f1-a77a-dafc077e7255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:35.729931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-276d06a7-03bd-47f1-a77a-dafc077e7255 None None] MFA Rules not processed for user `a095846a0d944299b437c38b0a763536`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:01:35.731199 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-276d06a7-03bd-47f1-a77a-dafc077e7255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:35.801364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 762/1502] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:01:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:01:35.816008 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bba098-51e0-4ae9-b268-cbddfd1f45d1 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:35.816458 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bba098-51e0-4ae9-b268-cbddfd1f45d1 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:35.816783 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bba098-51e0-4ae9-b268-cbddfd1f45d1 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:35.818580 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 741/1503] 10.222.0.73 () {54 vars in 963 bytes} [Fri May 13 15:01:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 15:01:35.824721 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fffc14-1331-47c5-a7eb-625145bd6fed None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:35.825010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fffc14-1331-47c5-a7eb-625145bd6fed None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:35.825291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fffc14-1331-47c5-a7eb-625145bd6fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:35.847646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-65fffc14-1331-47c5-a7eb-625145bd6fed None None] MFA Rules not processed for user `343a23610db84b028ccc05e4f876a0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:01:35.849745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-65fffc14-1331-47c5-a7eb-625145bd6fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:35.943589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 763/1504] 10.222.0.73 () {58 vars in 1060 bytes} [Fri May 13 15:01:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:01:35.952403 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bba098-51e0-4ae9-b268-cbddfd1f45d1 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:35.964598 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bba098-51e0-4ae9-b268-cbddfd1f45d1 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:35.968272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503877f-0234-4c97-987d-53888a2cb8aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:35.968940 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503877f-0234-4c97-987d-53888a2cb8aa service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:35.969221 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503877f-0234-4c97-987d-53888a2cb8aa service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:35.969498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503877f-0234-4c97-987d-53888a2cb8aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:35.978765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503877f-0234-4c97-987d-53888a2cb8aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:35.980263 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503877f-0234-4c97-987d-53888a2cb8aa service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:35.990419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 742/1505] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:01:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:01:36.043454 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5c304-5d12-472f-b9e0-22d72f667677 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:36.043790 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5c304-5d12-472f-b9e0-22d72f667677 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:36.044106 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5c304-5d12-472f-b9e0-22d72f667677 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:36.045513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 764/1506] 10.222.0.73 () {52 vars in 829 bytes} [Fri May 13 15:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 15:01:36.049909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503877f-0234-4c97-987d-53888a2cb8aa service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:36.150726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503877f-0234-4c97-987d-53888a2cb8aa service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:36.155632 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe2181-8694-421e-83ad-fe0bd924e8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:36.156683 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe2181-8694-421e-83ad-fe0bd924e8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:36.157006 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe2181-8694-421e-83ad-fe0bd924e8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:36.157319 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe2181-8694-421e-83ad-fe0bd924e8f2 admin admin] PATH_INFO: `/v3/users/a095846a0d944299b437c38b0a763536` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:36.158612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe2181-8694-421e-83ad-fe0bd924e8f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a095846a0d944299b437c38b0a763536)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:36.160255 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: WARNING py.warnings [None req-6afe2181-8694-421e-83ad-fe0bd924e8f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 15:01:36.160255 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: warnings.warn(msg) May 13 15:01:36.160255 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: May 13 15:01:36.161635 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe2181-8694-421e-83ad-fe0bd924e8f2 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:36.240570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6afe2181-8694-421e-83ad-fe0bd924e8f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a095846a0d944299b437c38b0a763536'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:36.253798 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6afe2181-8694-421e-83ad-fe0bd924e8f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a095846a0d944299b437c38b0a763536'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:36.273403 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6afe2181-8694-421e-83ad-fe0bd924e8f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a095846a0d944299b437c38b0a763536'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:36.274219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6afe2181-8694-421e-83ad-fe0bd924e8f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a095846a0d944299b437c38b0a763536'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:36.288175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6afe2181-8694-421e-83ad-fe0bd924e8f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a095846a0d944299b437c38b0a763536'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:36.294709 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 743/1507] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:01:36 2022] DELETE /identity/v3/users/a095846a0d944299b437c38b0a763536 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:01:36.299291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3380105-34cf-45e9-b9b3-dda62d96bc91 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:36.299861 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3380105-34cf-45e9-b9b3-dda62d96bc91 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:36.299861 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3380105-34cf-45e9-b9b3-dda62d96bc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:36.318297 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-e3380105-34cf-45e9-b9b3-dda62d96bc91 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:01:36.319673 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e3380105-34cf-45e9-b9b3-dda62d96bc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:36.390571 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 765/1508] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:01:36.403756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe2181-8694-421e-83ad-fe0bd924e8f2 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:36.405463 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6afe2181-8694-421e-83ad-fe0bd924e8f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:36.475062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe2181-8694-421e-83ad-fe0bd924e8f2 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:36.479199 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34965f3-f094-4ea3-9dfd-4ff4325b968e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:36.479865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34965f3-f094-4ea3-9dfd-4ff4325b968e service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:36.480146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34965f3-f094-4ea3-9dfd-4ff4325b968e service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:36.480420 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34965f3-f094-4ea3-9dfd-4ff4325b968e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:36.491062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34965f3-f094-4ea3-9dfd-4ff4325b968e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:36.492517 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34965f3-f094-4ea3-9dfd-4ff4325b968e service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:36.503256 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 744/1509] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:01:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:01:36.924406 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3380105-34cf-45e9-b9b3-dda62d96bc91 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:01:36.926701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e3380105-34cf-45e9-b9b3-dda62d96bc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:01:36.946217 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3380105-34cf-45e9-b9b3-dda62d96bc91 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:01:36.952762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559cba1-9302-4abb-bcf0-feef238f1f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:01:36.953939 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559cba1-9302-4abb-bcf0-feef238f1f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:01:36.954340 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559cba1-9302-4abb-bcf0-feef238f1f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:01:36.954748 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559cba1-9302-4abb-bcf0-feef238f1f59 admin admin] PATH_INFO: `/v3/projects/2a3b42368c3f4e1f9a87b62c30b90e7b` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:01:36.956395 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559cba1-9302-4abb-bcf0-feef238f1f59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a3b42368c3f4e1f9a87b62c30b90e7b)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:01:36.957577 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: WARNING py.warnings [None req-1559cba1-9302-4abb-bcf0-feef238f1f59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 15:01:36.957577 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: warnings.warn(msg) May 13 15:01:36.957577 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: May 13 15:01:36.959164 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559cba1-9302-4abb-bcf0-feef238f1f59 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:01:37.042307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1559cba1-9302-4abb-bcf0-feef238f1f59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a3b42368c3f4e1f9a87b62c30b90e7b', 'request_id': 'req-1559cba1-9302-4abb-bcf0-feef238f1f59'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:37.058544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1559cba1-9302-4abb-bcf0-feef238f1f59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a3b42368c3f4e1f9a87b62c30b90e7b', 'request_id': 'req-1559cba1-9302-4abb-bcf0-feef238f1f59'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:37.069866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1559cba1-9302-4abb-bcf0-feef238f1f59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a3b42368c3f4e1f9a87b62c30b90e7b', 'request_id': 'req-1559cba1-9302-4abb-bcf0-feef238f1f59'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:37.088788 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1559cba1-9302-4abb-bcf0-feef238f1f59 admin admin] The token cache is being invalidate because project 2a3b42368c3f4e1f9a87b62c30b90e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:01:37.089153 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1559cba1-9302-4abb-bcf0-feef238f1f59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:37.090138 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1559cba1-9302-4abb-bcf0-feef238f1f59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:01:37.092500 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 766/1510] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:01:36 2022] DELETE /identity/v3/projects/2a3b42368c3f4e1f9a87b62c30b90e7b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:03:27.438001 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d0113-1946-4f98-b15c-0d314254df0e None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:27.438633 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d0113-1946-4f98-b15c-0d314254df0e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:27.438633 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d0113-1946-4f98-b15c-0d314254df0e None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:27.439967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 745/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 15:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 15:03:27.447286 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dec20-2de8-4f85-8c58-ab9d73c333d0 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:27.447939 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dec20-2de8-4f85-8c58-ab9d73c333d0 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:27.448286 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dec20-2de8-4f85-8c58-ab9d73c333d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:27.469697 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-db8dec20-2de8-4f85-8c58-ab9d73c333d0 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:03:27.470992 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-db8dec20-2de8-4f85-8c58-ab9d73c333d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:27.532666 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 767/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 15:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:03:27.704850 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d0113-1946-4f98-b15c-0d314254df0e None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:03:27.706565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ac9d0113-1946-4f98-b15c-0d314254df0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:27.787882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d0113-1946-4f98-b15c-0d314254df0e None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:03:27.793682 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fe935-4222-4ae3-8936-d303270c9d0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:03:27.794343 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fe935-4222-4ae3-8936-d303270c9d0a service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:27.794625 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fe935-4222-4ae3-8936-d303270c9d0a service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:27.794936 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fe935-4222-4ae3-8936-d303270c9d0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:27.804721 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24fe935-4222-4ae3-8936-d303270c9d0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:03:27.806597 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24fe935-4222-4ae3-8936-d303270c9d0a service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:03:27.819189 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 746/1513] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:03:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:03:28.589520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0179989-5549-42e7-b35d-b3e3a33cd15b None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:28.590114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0179989-5549-42e7-b35d-b3e3a33cd15b None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:28.590114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0179989-5549-42e7-b35d-b3e3a33cd15b None None] PATH_INFO: `/v3` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:28.591430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 768/1514] 10.222.0.109 () {54 vars in 926 bytes} [Fri May 13 15:03:28 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:03:28.599750 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb41d0-37dc-4859-a081-df741908178e None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:28.600528 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb41d0-37dc-4859-a081-df741908178e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:28.600842 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb41d0-37dc-4859-a081-df741908178e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:28.623160 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-e3bb41d0-37dc-4859-a081-df741908178e None None] MFA Rules not processed for user `908d23b035f14756b438b3a61a63b2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:03:28.624428 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-e3bb41d0-37dc-4859-a081-df741908178e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:28.699084 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 747/1515] 10.222.0.109 () {58 vars in 1016 bytes} [Fri May 13 15:03:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:03:28.791854 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529106a0-8f64-4575-b00c-07d2a8aad238 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:28.792284 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529106a0-8f64-4575-b00c-07d2a8aad238 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:28.792662 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529106a0-8f64-4575-b00c-07d2a8aad238 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:28.794361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 769/1516] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 15:03:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 15:03:28.800452 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c4594-8239-4a8a-89f8-bfc6fa0126cc None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:28.800846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c4594-8239-4a8a-89f8-bfc6fa0126cc None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:28.801798 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c4594-8239-4a8a-89f8-bfc6fa0126cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:28.822470 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-1c3c4594-8239-4a8a-89f8-bfc6fa0126cc None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:03:28.823884 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-1c3c4594-8239-4a8a-89f8-bfc6fa0126cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:28.834389 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 748/1517] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 15:03:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:03:28.991671 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529106a0-8f64-4575-b00c-07d2a8aad238 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:03:29.006577 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529106a0-8f64-4575-b00c-07d2a8aad238 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:03:29.012327 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618550a-1962-4d8a-adcb-c30a614304a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:03:29.012992 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618550a-1962-4d8a-adcb-c30a614304a0 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:29.013267 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618550a-1962-4d8a-adcb-c30a614304a0 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:29.013535 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618550a-1962-4d8a-adcb-c30a614304a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:29.022734 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618550a-1962-4d8a-adcb-c30a614304a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:03:29.024377 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618550a-1962-4d8a-adcb-c30a614304a0 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:03:29.034996 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 770/1518] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:03:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:03:38.707719 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba4332-5404-4993-a889-15f5c38d8cb3 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:38.708303 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba4332-5404-4993-a889-15f5c38d8cb3 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:38.708303 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba4332-5404-4993-a889-15f5c38d8cb3 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:38.709544 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 749/1519] 10.222.0.73 () {54 vars in 960 bytes} [Fri May 13 15:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 15:03:38.716809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efe411-f11e-44b6-8dfd-cd709ea83273 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:38.717345 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efe411-f11e-44b6-8dfd-cd709ea83273 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:38.717345 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efe411-f11e-44b6-8dfd-cd709ea83273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:38.735549 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-27efe411-f11e-44b6-8dfd-cd709ea83273 None None] MFA Rules not processed for user `908d23b035f14756b438b3a61a63b2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:03:38.736767 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-27efe411-f11e-44b6-8dfd-cd709ea83273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:38.745236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 771/1520] 10.222.0.73 () {58 vars in 1057 bytes} [Fri May 13 15:03:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:03:38.755008 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba4332-5404-4993-a889-15f5c38d8cb3 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:03:38.770124 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba4332-5404-4993-a889-15f5c38d8cb3 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:03:38.775172 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9cc409-8506-4ed4-a402-18e0a48ccfaa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908d23b035f14756b438b3a61a63b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:03:38.775818 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cc409-8506-4ed4-a402-18e0a48ccfaa service placement] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:38.776102 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cc409-8506-4ed4-a402-18e0a48ccfaa service placement] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:38.776381 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cc409-8506-4ed4-a402-18e0a48ccfaa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:38.785147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9cc409-8506-4ed4-a402-18e0a48ccfaa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:03:38.786882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9cc409-8506-4ed4-a402-18e0a48ccfaa service placement] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:03:38.797892 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 750/1521] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:03:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:03:40.398270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af31209-7f52-4bcc-b352-6f5327445a00 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:40.398870 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af31209-7f52-4bcc-b352-6f5327445a00 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:40.398870 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af31209-7f52-4bcc-b352-6f5327445a00 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:40.400204 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 772/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 15:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 15:03:40.405117 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3efb0-ab6b-4fa7-b756-3b5f221343d3 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:40.405522 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3efb0-ab6b-4fa7-b756-3b5f221343d3 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:40.405675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3efb0-ab6b-4fa7-b756-3b5f221343d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:40.424173 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-45a3efb0-ab6b-4fa7-b756-3b5f221343d3 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:03:40.425353 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-45a3efb0-ab6b-4fa7-b756-3b5f221343d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:40.434217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 751/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 15:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:03:40.585427 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af31209-7f52-4bcc-b352-6f5327445a00 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:03:40.600272 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af31209-7f52-4bcc-b352-6f5327445a00 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:03:40.605589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90200c0b-c3dd-4613-ac31-1ad75d5837b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:03:40.606249 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90200c0b-c3dd-4613-ac31-1ad75d5837b9 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:40.606530 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90200c0b-c3dd-4613-ac31-1ad75d5837b9 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:40.606804 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90200c0b-c3dd-4613-ac31-1ad75d5837b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:40.615117 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90200c0b-c3dd-4613-ac31-1ad75d5837b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:03:40.616764 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90200c0b-c3dd-4613-ac31-1ad75d5837b9 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:03:40.626484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 773/1524] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:03:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:03:41.543608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aded852-4744-46cf-b7bb-75292409a0f9 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:41.544160 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aded852-4744-46cf-b7bb-75292409a0f9 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:41.544160 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aded852-4744-46cf-b7bb-75292409a0f9 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:41.545557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 15:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 15:03:41.552568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76f622-6b97-404e-b49f-8813b77da3b1 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:41.553149 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76f622-6b97-404e-b49f-8813b77da3b1 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:41.553149 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76f622-6b97-404e-b49f-8813b77da3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:41.571170 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-7a76f622-6b97-404e-b49f-8813b77da3b1 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:03:41.572368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-7a76f622-6b97-404e-b49f-8813b77da3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:41.580157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 15:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:03:41.735640 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aded852-4744-46cf-b7bb-75292409a0f9 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:03:41.750259 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aded852-4744-46cf-b7bb-75292409a0f9 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:03:41.756663 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34957cdc-3eed-4f8d-9149-6cf98ff34b75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:03:41.757314 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34957cdc-3eed-4f8d-9149-6cf98ff34b75 service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:41.757597 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34957cdc-3eed-4f8d-9149-6cf98ff34b75 service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:41.757870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34957cdc-3eed-4f8d-9149-6cf98ff34b75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:41.766732 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34957cdc-3eed-4f8d-9149-6cf98ff34b75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:03:41.768348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34957cdc-3eed-4f8d-9149-6cf98ff34b75 service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:03:41.778938 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 753/1527] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:03:46.207578 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d9ed7-17a2-4287-b405-1c74f12a448e None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:46.208133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d9ed7-17a2-4287-b405-1c74f12a448e None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:46.208133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d9ed7-17a2-4287-b405-1c74f12a448e None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:46.209399 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 15:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 15:03:46.215456 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64019c-2071-4463-87ba-1c5517f8684c None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:46.216250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64019c-2071-4463-87ba-1c5517f8684c None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:46.216465 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64019c-2071-4463-87ba-1c5517f8684c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:46.236767 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-5d64019c-2071-4463-87ba-1c5517f8684c None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:03:46.238596 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-5d64019c-2071-4463-87ba-1c5517f8684c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:46.247101 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 15:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:03:46.307722 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d9ed7-17a2-4287-b405-1c74f12a448e None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:03:46.309733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-f32d9ed7-17a2-4287-b405-1c74f12a448e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:46.376305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d9ed7-17a2-4287-b405-1c74f12a448e None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:03:46.381971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62424e-0ea0-4cc4-b995-52daee0aa25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:03:46.383120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62424e-0ea0-4cc4-b995-52daee0aa25d service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:46.383590 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62424e-0ea0-4cc4-b995-52daee0aa25d service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:46.384091 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62424e-0ea0-4cc4-b995-52daee0aa25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:46.399712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62424e-0ea0-4cc4-b995-52daee0aa25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:03:46.402510 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62424e-0ea0-4cc4-b995-52daee0aa25d service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:03:46.416101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 776/1530] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:03:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:03:48.745748 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7add2e5-5ade-4b2c-98b4-de9bf97fbc5c None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:48.746317 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7add2e5-5ade-4b2c-98b4-de9bf97fbc5c None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:48.746317 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7add2e5-5ade-4b2c-98b4-de9bf97fbc5c None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:48.747690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 15:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 15:03:48.754122 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadef95-01bf-4852-ba53-b3c5e94f9561 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:48.754642 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadef95-01bf-4852-ba53-b3c5e94f9561 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:48.754642 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadef95-01bf-4852-ba53-b3c5e94f9561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:48.774516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-4dadef95-01bf-4852-ba53-b3c5e94f9561 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:03:48.775877 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-4dadef95-01bf-4852-ba53-b3c5e94f9561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:48.784166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 15:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:03:48.823625 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7add2e5-5ade-4b2c-98b4-de9bf97fbc5c None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:03:48.825322 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-b7add2e5-5ade-4b2c-98b4-de9bf97fbc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:48.838276 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7add2e5-5ade-4b2c-98b4-de9bf97fbc5c None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:03:48.841834 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5072c-fdf8-4743-a0c6-38c178217104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:03:48.842500 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5072c-fdf8-4743-a0c6-38c178217104 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:48.842779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5072c-fdf8-4743-a0c6-38c178217104 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:48.843088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5072c-fdf8-4743-a0c6-38c178217104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:48.852223 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5072c-fdf8-4743-a0c6-38c178217104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:03:48.853652 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5072c-fdf8-4743-a0c6-38c178217104 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:03:48.863564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 756/1533] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:03:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:03:52.626839 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e59f00-9856-463b-acc7-88e2d0f649a8 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:52.627450 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e59f00-9856-463b-acc7-88e2d0f649a8 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:52.627450 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e59f00-9856-463b-acc7-88e2d0f649a8 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:52.628827 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 15:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 15:03:52.634523 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21891d27-6858-4a37-a5aa-9a390a487cf5 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:52.635133 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21891d27-6858-4a37-a5aa-9a390a487cf5 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:52.635133 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21891d27-6858-4a37-a5aa-9a390a487cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:52.653268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-21891d27-6858-4a37-a5aa-9a390a487cf5 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:03:52.654461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-21891d27-6858-4a37-a5aa-9a390a487cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:52.662733 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 15:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:03:52.934683 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e59f00-9856-463b-acc7-88e2d0f649a8 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:03:52.936395 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-f1e59f00-9856-463b-acc7-88e2d0f649a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:52.993692 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e59f00-9856-463b-acc7-88e2d0f649a8 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:03:52.997310 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2725a9-714e-48cb-81f1-22cbf9a9b88f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:03:52.997963 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2725a9-714e-48cb-81f1-22cbf9a9b88f service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:52.998246 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2725a9-714e-48cb-81f1-22cbf9a9b88f service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:52.998522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2725a9-714e-48cb-81f1-22cbf9a9b88f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:53.007702 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2725a9-714e-48cb-81f1-22cbf9a9b88f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:03:53.009123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2725a9-714e-48cb-81f1-22cbf9a9b88f service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:03:53.018510 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 779/1536] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:03:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:03:55.503468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc0536-823b-481f-9dd5-77f426857cf8 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:55.504058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc0536-823b-481f-9dd5-77f426857cf8 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:55.504058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc0536-823b-481f-9dd5-77f426857cf8 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:55.505587 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 15:03:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 15:03:55.511568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb43246-3e7a-4533-b3fd-2b0082c36745 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:55.512123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb43246-3e7a-4533-b3fd-2b0082c36745 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:55.512123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb43246-3e7a-4533-b3fd-2b0082c36745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:55.532559 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-feb43246-3e7a-4533-b3fd-2b0082c36745 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:03:55.533822 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-feb43246-3e7a-4533-b3fd-2b0082c36745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:55.542155 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 15:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:03:55.823280 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc0536-823b-481f-9dd5-77f426857cf8 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:03:55.825313 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-81cc0536-823b-481f-9dd5-77f426857cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:03:55.839816 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc0536-823b-481f-9dd5-77f426857cf8 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:03:55.843461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ae60c-85c9-4bb2-9925-657b1eaf1a2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:03:55.844160 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ae60c-85c9-4bb2-9925-657b1eaf1a2a service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:03:55.844492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ae60c-85c9-4bb2-9925-657b1eaf1a2a service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:03:55.844806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ae60c-85c9-4bb2-9925-657b1eaf1a2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:03:55.854734 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ae60c-85c9-4bb2-9925-657b1eaf1a2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:03:55.856222 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ae60c-85c9-4bb2-9925-657b1eaf1a2a service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:03:55.867369 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 759/1539] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:03:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:31.473035 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d321645-35b8-4222-8d76-7468c978f423 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:31.474200 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d321645-35b8-4222-8d76-7468c978f423 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:31.474749 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d321645-35b8-4222-8d76-7468c978f423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:31.511699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-0d321645-35b8-4222-8d76-7468c978f423 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:31.513441 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-0d321645-35b8-4222-8d76-7468c978f423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:31.532200 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 781/1540] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:05:31.542488 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376260cb-7a61-4f18-8a68-7c3691c5c8fd None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:31.543752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376260cb-7a61-4f18-8a68-7c3691c5c8fd None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:31.544271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376260cb-7a61-4f18-8a68-7c3691c5c8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:31.573411 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-376260cb-7a61-4f18-8a68-7c3691c5c8fd None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:31.575132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-376260cb-7a61-4f18-8a68-7c3691c5c8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:31.591022 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 760/1541] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:05:31.597051 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d321645-35b8-4222-8d76-7468c978f423 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:31.609093 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d321645-35b8-4222-8d76-7468c978f423 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:31.618199 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b00cc-0970-4701-bb6d-822cffd97712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:31.619330 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b00cc-0970-4701-bb6d-822cffd97712 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:31.619850 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b00cc-0970-4701-bb6d-822cffd97712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:31.620345 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b00cc-0970-4701-bb6d-822cffd97712 admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:31.621388 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b00cc-0970-4701-bb6d-822cffd97712 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:05:31.621946 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b00cc-0970-4701-bb6d-822cffd97712 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:31.624126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b00cc-0970-4701-bb6d-822cffd97712 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:31.645718 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 782/1542] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:05:31.654645 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b00cc-0970-4701-bb6d-822cffd97712 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:31.655733 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fe417-7d71-4158-b061-2d1e59ed6944 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:31.656272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fe417-7d71-4158-b061-2d1e59ed6944 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:31.656776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fe417-7d71-4158-b061-2d1e59ed6944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:31.673704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b00cc-0970-4701-bb6d-822cffd97712 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:31.689159 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a961e-76dc-437b-a5a4-08fb544dc32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:31.689919 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a961e-76dc-437b-a5a4-08fb544dc32e admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:31.690146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-216fe417-7d71-4158-b061-2d1e59ed6944 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:31.690277 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a961e-76dc-437b-a5a4-08fb544dc32e admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:31.690589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a961e-76dc-437b-a5a4-08fb544dc32e admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:31.691426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a961e-76dc-437b-a5a4-08fb544dc32e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:31.692294 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-216fe417-7d71-4158-b061-2d1e59ed6944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:31.692505 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: WARNING py.warnings [None req-0c8a961e-76dc-437b-a5a4-08fb544dc32e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 15:05:31.692505 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: warnings.warn(msg) May 13 15:05:31.692505 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: May 13 15:05:31.693724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a961e-76dc-437b-a5a4-08fb544dc32e admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:31.707924 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 761/1543] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:31.726550 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1706f76-63f9-48d7-9b9c-e0bdc9f8a257 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:31.727407 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1706f76-63f9-48d7-9b9c-e0bdc9f8a257 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:31.727922 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1706f76-63f9-48d7-9b9c-e0bdc9f8a257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:31.753719 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 783/1544] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:05:31 2022] POST /identity/v3/projects => generated 363 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:31.760806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-e1706f76-63f9-48d7-9b9c-e0bdc9f8a257 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:31.761170 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a961e-76dc-437b-a5a4-08fb544dc32e admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:31.762632 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-e1706f76-63f9-48d7-9b9c-e0bdc9f8a257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:31.897164 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a961e-76dc-437b-a5a4-08fb544dc32e admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:31.911002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43dbdb-b2fa-4b87-bcfc-b69500ac4ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:31.912090 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43dbdb-b2fa-4b87-bcfc-b69500ac4ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:31.912246 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43dbdb-b2fa-4b87-bcfc-b69500ac4ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:31.912431 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43dbdb-b2fa-4b87-bcfc-b69500ac4ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:31.913316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43dbdb-b2fa-4b87-bcfc-b69500ac4ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:31.915620 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43dbdb-b2fa-4b87-bcfc-b69500ac4ef7 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:31.922005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 762/1545] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:05:31.926639 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1706f76-63f9-48d7-9b9c-e0bdc9f8a257 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:31.943544 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1706f76-63f9-48d7-9b9c-e0bdc9f8a257 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:31.958258 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b653c07-6a90-432b-851e-33540ee1e9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:31.958973 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b653c07-6a90-432b-851e-33540ee1e9cf admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:31.959262 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b653c07-6a90-432b-851e-33540ee1e9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:31.959535 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b653c07-6a90-432b-851e-33540ee1e9cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:31.960276 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b653c07-6a90-432b-851e-33540ee1e9cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:05:31.960581 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b653c07-6a90-432b-851e-33540ee1e9cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:31.961618 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: WARNING py.warnings [None req-9b653c07-6a90-432b-851e-33540ee1e9cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 15:05:31.961618 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: warnings.warn(msg) May 13 15:05:31.961618 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: May 13 15:05:31.962546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b653c07-6a90-432b-851e-33540ee1e9cf admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:31.968188 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 784/1546] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:05:31 2022] POST /identity/v3/users => generated 282 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:05:31.969619 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f4e8b-de18-4ad7-8371-1c95a96602e8 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:31.969906 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f4e8b-de18-4ad7-8371-1c95a96602e8 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:31.970211 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f4e8b-de18-4ad7-8371-1c95a96602e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.004249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 763/1547] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 15:05:32.005860 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b653c07-6a90-432b-851e-33540ee1e9cf admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:32.020646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-828f4e8b-de18-4ad7-8371-1c95a96602e8 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:32.022059 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-828f4e8b-de18-4ad7-8371-1c95a96602e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:32.038760 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b653c07-6a90-432b-851e-33540ee1e9cf admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:32.048330 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 785/1548] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:32.049196 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f4e8b-de18-4ad7-8371-1c95a96602e8 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:32.054721 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e974a3-ebe7-40e7-84d8-f8353388700b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:32.056299 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e974a3-ebe7-40e7-84d8-f8353388700b admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.056872 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e974a3-ebe7-40e7-84d8-f8353388700b admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.057420 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e974a3-ebe7-40e7-84d8-f8353388700b admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.059233 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e974a3-ebe7-40e7-84d8-f8353388700b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:32.063840 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e974a3-ebe7-40e7-84d8-f8353388700b admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:32.069545 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f4e8b-de18-4ad7-8371-1c95a96602e8 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:32.092920 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee9d95-dc45-4668-b282-7cd29e51de2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:32.093636 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee9d95-dc45-4668-b282-7cd29e51de2d admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.093921 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee9d95-dc45-4668-b282-7cd29e51de2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.094197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee9d95-dc45-4668-b282-7cd29e51de2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.103580 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee9d95-dc45-4668-b282-7cd29e51de2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:32.105663 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee9d95-dc45-4668-b282-7cd29e51de2d admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:32.108749 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 764/1549] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:32.110762 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa6fa4-c994-4a25-be30-b378bb00b282 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.115712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa6fa4-c994-4a25-be30-b378bb00b282 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.116320 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa6fa4-c994-4a25-be30-b378bb00b282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.156957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-51fa6fa4-c994-4a25-be30-b378bb00b282 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:32.160332 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-51fa6fa4-c994-4a25-be30-b378bb00b282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:32.168820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 786/1550] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:05:32 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:32.169827 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee9d95-dc45-4668-b282-7cd29e51de2d admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:32.310319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee9d95-dc45-4668-b282-7cd29e51de2d admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:32.315528 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 765/1551] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:32.318422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa6fa4-c994-4a25-be30-b378bb00b282 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:32.333471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7b8f0-a3c2-45b5-bc6c-5f31af240092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:32.334631 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7b8f0-a3c2-45b5-bc6c-5f31af240092 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.336650 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7b8f0-a3c2-45b5-bc6c-5f31af240092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.337117 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7b8f0-a3c2-45b5-bc6c-5f31af240092 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.339246 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7b8f0-a3c2-45b5-bc6c-5f31af240092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:32.342528 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7b8f0-a3c2-45b5-bc6c-5f31af240092 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:32.355571 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa6fa4-c994-4a25-be30-b378bb00b282 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:32.369587 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd4315-73f3-4515-8ee4-08dcdae5f45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:32.370704 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd4315-73f3-4515-8ee4-08dcdae5f45b admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.371211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd4315-73f3-4515-8ee4-08dcdae5f45b admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.371490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 787/1552] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:32.371779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd4315-73f3-4515-8ee4-08dcdae5f45b admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.372897 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32703149-4356-49ba-948d-6c99057f937e None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.373176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd4315-73f3-4515-8ee4-08dcdae5f45b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:32.375343 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: WARNING py.warnings [None req-f8cd4315-73f3-4515-8ee4-08dcdae5f45b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 15:05:32.375343 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: warnings.warn(msg) May 13 15:05:32.375343 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: May 13 15:05:32.378096 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd4315-73f3-4515-8ee4-08dcdae5f45b admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:32.378442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32703149-4356-49ba-948d-6c99057f937e None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.379461 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32703149-4356-49ba-948d-6c99057f937e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.411564 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-32703149-4356-49ba-948d-6c99057f937e None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:32.412944 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-32703149-4356-49ba-948d-6c99057f937e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:32.425452 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 788/1554] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:32.426000 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 766/1554] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:05:32 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:32.427437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fac41-0f0b-4593-adf4-7ddf498ab9a3 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.427782 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fac41-0f0b-4593-adf4-7ddf498ab9a3 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.428332 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fac41-0f0b-4593-adf4-7ddf498ab9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.436704 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd4315-73f3-4515-8ee4-08dcdae5f45b admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:32.462443 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd4315-73f3-4515-8ee4-08dcdae5f45b admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:32.462948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-228fac41-0f0b-4593-adf4-7ddf498ab9a3 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:32.465313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-228fac41-0f0b-4593-adf4-7ddf498ab9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:32.469733 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40536336-f754-4f84-8232-b282338b78ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:32.470598 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40536336-f754-4f84-8232-b282338b78ea admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.470936 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40536336-f754-4f84-8232-b282338b78ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.471203 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40536336-f754-4f84-8232-b282338b78ea admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.471862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40536336-f754-4f84-8232-b282338b78ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:05:32.472178 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40536336-f754-4f84-8232-b282338b78ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:32.474529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40536336-f754-4f84-8232-b282338b78ea admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:32.482004 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 789/1555] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:32.484558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e37bbd-e319-41f3-8f0e-eca60cc877e7 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.485408 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e37bbd-e319-41f3-8f0e-eca60cc877e7 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.485868 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e37bbd-e319-41f3-8f0e-eca60cc877e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.503646 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 767/1556] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:05:32.504828 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40536336-f754-4f84-8232-b282338b78ea admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:32.518398 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40536336-f754-4f84-8232-b282338b78ea admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:32.522931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-95e37bbd-e319-41f3-8f0e-eca60cc877e7 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:32.524683 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5f9ae-b317-4477-9995-adc598b105db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:32.525172 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-95e37bbd-e319-41f3-8f0e-eca60cc877e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:32.525835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5f9ae-b317-4477-9995-adc598b105db admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.526180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5f9ae-b317-4477-9995-adc598b105db admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.526541 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5f9ae-b317-4477-9995-adc598b105db admin admin] PATH_INFO: `/v3/projects/222187af9c754881b4b2fcf972877379/users/bc8670d683f545788ce67b98931e8389/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.545195 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 790/1557] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:32.552886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e37bbd-e319-41f3-8f0e-eca60cc877e7 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:32.555566 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5f9ae-b317-4477-9995-adc598b105db admin admin] RBAC: Authorizing `identity:create_grant(project_id=222187af9c754881b4b2fcf972877379, user_id=bc8670d683f545788ce67b98931e8389, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:32.561653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5f9ae-b317-4477-9995-adc598b105db admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:32.569129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e37bbd-e319-41f3-8f0e-eca60cc877e7 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:32.577981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e9af9-c4bf-4b6b-91bc-579de2a483d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:32.578683 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e9af9-c4bf-4b6b-91bc-579de2a483d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.580683 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e9af9-c4bf-4b6b-91bc-579de2a483d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.581036 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e9af9-c4bf-4b6b-91bc-579de2a483d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.581767 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e9af9-c4bf-4b6b-91bc-579de2a483d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:32.583846 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e9af9-c4bf-4b6b-91bc-579de2a483d4 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:32.598169 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 768/1558] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:05:32 2022] PUT /identity/v3/projects/222187af9c754881b4b2fcf972877379/users/bc8670d683f545788ce67b98931e8389/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:32.600681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0930b1-e9f7-4be2-93be-6cdc03d2a4c9 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.601128 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0930b1-e9f7-4be2-93be-6cdc03d2a4c9 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.601448 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0930b1-e9f7-4be2-93be-6cdc03d2a4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.604372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 791/1559] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:32.606081 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4ff95-a4bd-475f-8da7-45b7a4a73ba1 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.606443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4ff95-a4bd-475f-8da7-45b7a4a73ba1 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.606702 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4ff95-a4bd-475f-8da7-45b7a4a73ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.640085 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-6b0930b1-e9f7-4be2-93be-6cdc03d2a4c9 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:32.641179 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-c8e4ff95-a4bd-475f-8da7-45b7a4a73ba1 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:32.641490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6b0930b1-e9f7-4be2-93be-6cdc03d2a4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:32.644288 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-c8e4ff95-a4bd-475f-8da7-45b7a4a73ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:32.748444 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 792/1560] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:32.749716 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4ff95-a4bd-475f-8da7-45b7a4a73ba1 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:32.752904 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 769/1561] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:32.755317 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e082d83-0009-489d-84e5-d66096593eb5 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.755849 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e082d83-0009-489d-84e5-d66096593eb5 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.756340 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e082d83-0009-489d-84e5-d66096593eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.762362 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4ff95-a4bd-475f-8da7-45b7a4a73ba1 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:32.768160 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fb120-acc1-4593-9b39-5ecacdbe7bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:32.768848 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fb120-acc1-4593-9b39-5ecacdbe7bdd admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.769129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fb120-acc1-4593-9b39-5ecacdbe7bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.769403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fb120-acc1-4593-9b39-5ecacdbe7bdd admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.770114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516fb120-acc1-4593-9b39-5ecacdbe7bdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:32.772093 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516fb120-acc1-4593-9b39-5ecacdbe7bdd admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:32.787230 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-5e082d83-0009-489d-84e5-d66096593eb5 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:32.789382 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-5e082d83-0009-489d-84e5-d66096593eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:32.804488 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 770/1562] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:32.806359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e082d83-0009-489d-84e5-d66096593eb5 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:32.807246 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 793/1563] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:05:32 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:32.809834 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a1641-77b7-41a0-a34d-11ba0b3d311d None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.811212 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a1641-77b7-41a0-a34d-11ba0b3d311d None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.812024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a1641-77b7-41a0-a34d-11ba0b3d311d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.829263 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e082d83-0009-489d-84e5-d66096593eb5 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:32.855024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-186a1641-77b7-41a0-a34d-11ba0b3d311d None None] MFA Rules not processed for user `bc8670d683f545788ce67b98931e8389`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:32.856493 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-186a1641-77b7-41a0-a34d-11ba0b3d311d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:32.926453 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b2a6f-088d-43c9-a56f-d0ad5b602e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:32.927627 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b2a6f-088d-43c9-a56f-d0ad5b602e99 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.928098 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b2a6f-088d-43c9-a56f-d0ad5b602e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.928541 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b2a6f-088d-43c9-a56f-d0ad5b602e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.929807 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b2a6f-088d-43c9-a56f-d0ad5b602e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:32.932072 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b2a6f-088d-43c9-a56f-d0ad5b602e99 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:32.943917 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 794/1564] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:32 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:32.949770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 771/1565] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:32.951865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d180eff-a31f-40fc-9c41-d06b19ee516e None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.952084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073e868-44a4-4f29-9d5e-13d87e10407c None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:32.952379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073e868-44a4-4f29-9d5e-13d87e10407c None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.953022 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d180eff-a31f-40fc-9c41-d06b19ee516e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:32.953227 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073e868-44a4-4f29-9d5e-13d87e10407c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.953439 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d180eff-a31f-40fc-9c41-d06b19ee516e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:32.981707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-7d180eff-a31f-40fc-9c41-d06b19ee516e None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:32.982722 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-c073e868-44a4-4f29-9d5e-13d87e10407c None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:32.984254 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-7d180eff-a31f-40fc-9c41-d06b19ee516e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:32.984604 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-c073e868-44a4-4f29-9d5e-13d87e10407c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:33.000063 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 772/1566] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:33.000063 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d180eff-a31f-40fc-9c41-d06b19ee516e None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:33.000496 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 795/1567] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:33.000923 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073e868-44a4-4f29-9d5e-13d87e10407c None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:33.018778 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d180eff-a31f-40fc-9c41-d06b19ee516e None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:33.019109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073e868-44a4-4f29-9d5e-13d87e10407c None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:33.025815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327fd87-3df0-4a8c-9396-e4c63770ab40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:33.026104 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568402d-c836-4dfe-bbce-31cf62e0beb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:33.026773 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327fd87-3df0-4a8c-9396-e4c63770ab40 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.026991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568402d-c836-4dfe-bbce-31cf62e0beb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.027401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327fd87-3df0-4a8c-9396-e4c63770ab40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.027594 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568402d-c836-4dfe-bbce-31cf62e0beb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.027757 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327fd87-3df0-4a8c-9396-e4c63770ab40 admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.027934 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568402d-c836-4dfe-bbce-31cf62e0beb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.029308 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568402d-c836-4dfe-bbce-31cf62e0beb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:05:33.029488 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327fd87-3df0-4a8c-9396-e4c63770ab40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:05:33.029847 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568402d-c836-4dfe-bbce-31cf62e0beb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:33.030036 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327fd87-3df0-4a8c-9396-e4c63770ab40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:33.031924 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568402d-c836-4dfe-bbce-31cf62e0beb8 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:33.032227 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327fd87-3df0-4a8c-9396-e4c63770ab40 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:33.047547 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 773/1568] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:05:33.048917 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568402d-c836-4dfe-bbce-31cf62e0beb8 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:33.050958 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 796/1569] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:05:33.053031 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327fd87-3df0-4a8c-9396-e4c63770ab40 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:33.064277 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568402d-c836-4dfe-bbce-31cf62e0beb8 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:33.068977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47607bfb-7bc9-4e54-823a-e1f360743d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:33.069622 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47607bfb-7bc9-4e54-823a-e1f360743d7c admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.069901 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47607bfb-7bc9-4e54-823a-e1f360743d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.070178 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47607bfb-7bc9-4e54-823a-e1f360743d7c admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.070956 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47607bfb-7bc9-4e54-823a-e1f360743d7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:05:33.071305 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47607bfb-7bc9-4e54-823a-e1f360743d7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:33.072924 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47607bfb-7bc9-4e54-823a-e1f360743d7c admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:33.076341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327fd87-3df0-4a8c-9396-e4c63770ab40 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:33.084790 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b71d20-5818-4b5a-9b8a-a0afb9bd378a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:33.085903 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b71d20-5818-4b5a-9b8a-a0afb9bd378a admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.086382 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b71d20-5818-4b5a-9b8a-a0afb9bd378a admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.086865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b71d20-5818-4b5a-9b8a-a0afb9bd378a admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.087556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 774/1570] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:05:33.088389 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47607bfb-7bc9-4e54-823a-e1f360743d7c admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:33.091305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b71d20-5818-4b5a-9b8a-a0afb9bd378a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:33.094174 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b71d20-5818-4b5a-9b8a-a0afb9bd378a admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:33.099744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47607bfb-7bc9-4e54-823a-e1f360743d7c admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:33.105743 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93207077-d7ba-412f-995c-d234f49eeb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:33.106441 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93207077-d7ba-412f-995c-d234f49eeb25 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.106757 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93207077-d7ba-412f-995c-d234f49eeb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.107637 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93207077-d7ba-412f-995c-d234f49eeb25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.108359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93207077-d7ba-412f-995c-d234f49eeb25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:33.110506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93207077-d7ba-412f-995c-d234f49eeb25 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:33.126095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 797/1571] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:05:33 2022] POST /identity/v3/users => generated 288 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:33.128055 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b71d20-5818-4b5a-9b8a-a0afb9bd378a admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:33.146930 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b71d20-5818-4b5a-9b8a-a0afb9bd378a admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:33.149596 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 775/1572] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:05:33 2022] POST /identity/v3/projects => generated 363 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:33.151119 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e8a4e-b978-43b3-b2dc-5b3412b1bc0f None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.151563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e8a4e-b978-43b3-b2dc-5b3412b1bc0f None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.151852 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e8a4e-b978-43b3-b2dc-5b3412b1bc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.172769 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-588e8a4e-b978-43b3-b2dc-5b3412b1bc0f None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:33.174017 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-588e8a4e-b978-43b3-b2dc-5b3412b1bc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:33.241002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfab1af-4ee1-4dba-8c45-9dc636ce6e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:33.241992 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfab1af-4ee1-4dba-8c45-9dc636ce6e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.242276 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfab1af-4ee1-4dba-8c45-9dc636ce6e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.242549 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfab1af-4ee1-4dba-8c45-9dc636ce6e8e admin admin] PATH_INFO: `/v3/projects/bff8925b6c874ee0aa397a21e93d22f4/users/36f22701b4514d32a15c66e5e4d63bf1/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.260108 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfab1af-4ee1-4dba-8c45-9dc636ce6e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bff8925b6c874ee0aa397a21e93d22f4, user_id=36f22701b4514d32a15c66e5e4d63bf1, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:33.261166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: WARNING py.warnings [None req-0dfab1af-4ee1-4dba-8c45-9dc636ce6e8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 15:05:33.261166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: warnings.warn(msg) May 13 15:05:33.261166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: May 13 15:05:33.263664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfab1af-4ee1-4dba-8c45-9dc636ce6e8e admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:33.268329 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 776/1573] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:33.270010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147aa58c-1513-4919-bb0f-9bd56e46ac2b None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.270371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147aa58c-1513-4919-bb0f-9bd56e46ac2b None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.270715 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147aa58c-1513-4919-bb0f-9bd56e46ac2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.287250 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 798/1574] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:05:33 2022] PUT /identity/v3/projects/bff8925b6c874ee0aa397a21e93d22f4/users/36f22701b4514d32a15c66e5e4d63bf1/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:33.288101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfab1af-4ee1-4dba-8c45-9dc636ce6e8e admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:33.296863 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-147aa58c-1513-4919-bb0f-9bd56e46ac2b None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:33.298413 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-147aa58c-1513-4919-bb0f-9bd56e46ac2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:33.375040 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 777/1575] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:33.378297 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfab1af-4ee1-4dba-8c45-9dc636ce6e8e admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:33.380322 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147aa58c-1513-4919-bb0f-9bd56e46ac2b None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:33.385194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8526d-701b-4543-8bdf-325ce14eb013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:33.385967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8526d-701b-4543-8bdf-325ce14eb013 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.386666 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8526d-701b-4543-8bdf-325ce14eb013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.386914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8526d-701b-4543-8bdf-325ce14eb013 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.387780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8526d-701b-4543-8bdf-325ce14eb013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:33.391170 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8526d-701b-4543-8bdf-325ce14eb013 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:33.393455 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147aa58c-1513-4919-bb0f-9bd56e46ac2b None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:33.403532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f5813-986a-4643-af97-6f5b41512d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:33.405306 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f5813-986a-4643-af97-6f5b41512d94 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.405790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f5813-986a-4643-af97-6f5b41512d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.406248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f5813-986a-4643-af97-6f5b41512d94 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.409598 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f5813-986a-4643-af97-6f5b41512d94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:33.415577 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f5813-986a-4643-af97-6f5b41512d94 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:33.438040 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 799/1576] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:05:33 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:33.439503 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8526d-701b-4543-8bdf-325ce14eb013 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:33.463270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 778/1577] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:05:33 2022] POST /identity/v3/projects => generated 393 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:33.464388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f5813-986a-4643-af97-6f5b41512d94 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:33.529278 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8526d-701b-4543-8bdf-325ce14eb013 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:33.563186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f5813-986a-4643-af97-6f5b41512d94 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:33.569256 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1dd59-8492-4ab9-a332-a688480632eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:33.570113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1dd59-8492-4ab9-a332-a688480632eb admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.570498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1dd59-8492-4ab9-a332-a688480632eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.570923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1dd59-8492-4ab9-a332-a688480632eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.571789 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1dd59-8492-4ab9-a332-a688480632eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:33.573713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1dd59-8492-4ab9-a332-a688480632eb admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:33.589000 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 779/1578] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:33.589000 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1dd59-8492-4ab9-a332-a688480632eb admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:33.597495 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1dd59-8492-4ab9-a332-a688480632eb admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:33.603124 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdfd0f-fc80-4d70-b875-6a2311a626c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:33.603805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdfd0f-fc80-4d70-b875-6a2311a626c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.604088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdfd0f-fc80-4d70-b875-6a2311a626c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.604563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdfd0f-fc80-4d70-b875-6a2311a626c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.605338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdfd0f-fc80-4d70-b875-6a2311a626c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:33.608061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdfd0f-fc80-4d70-b875-6a2311a626c8 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:33.628257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf093c4-1bb0-44e7-90cd-dec721cf5555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:33.629462 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf093c4-1bb0-44e7-90cd-dec721cf5555 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.629727 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf093c4-1bb0-44e7-90cd-dec721cf5555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.630183 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf093c4-1bb0-44e7-90cd-dec721cf5555 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.631430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf093c4-1bb0-44e7-90cd-dec721cf5555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:33.634856 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf093c4-1bb0-44e7-90cd-dec721cf5555 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:33.637670 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 780/1579] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:05:33 2022] POST /identity/v3/users => generated 288 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:33.639109 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdfd0f-fc80-4d70-b875-6a2311a626c8 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:33.656569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdfd0f-fc80-4d70-b875-6a2311a626c8 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:33.664494 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e83b5b-443d-4473-bd6e-57a822da3212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:33.665444 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e83b5b-443d-4473-bd6e-57a822da3212 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.665910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e83b5b-443d-4473-bd6e-57a822da3212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.666482 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e83b5b-443d-4473-bd6e-57a822da3212 admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.667720 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e83b5b-443d-4473-bd6e-57a822da3212 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:05:33.668081 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e83b5b-443d-4473-bd6e-57a822da3212 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:33.670692 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e83b5b-443d-4473-bd6e-57a822da3212 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:33.678984 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 800/1580] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:05:33 2022] POST /identity/v3/projects => generated 367 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:33.678984 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e50b3d-1310-4ae2-961c-b33be881869f None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.682123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e50b3d-1310-4ae2-961c-b33be881869f None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.682513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e50b3d-1310-4ae2-961c-b33be881869f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.696153 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 781/1581] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:05:33.697978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e83b5b-443d-4473-bd6e-57a822da3212 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:33.710698 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-53e50b3d-1310-4ae2-961c-b33be881869f None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:33.712792 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-53e50b3d-1310-4ae2-961c-b33be881869f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:33.715706 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e83b5b-443d-4473-bd6e-57a822da3212 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:33.806785 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87151d2-07e1-4dbf-8efd-735f51200fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:33.807636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87151d2-07e1-4dbf-8efd-735f51200fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.807930 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87151d2-07e1-4dbf-8efd-735f51200fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.808207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87151d2-07e1-4dbf-8efd-735f51200fc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.808960 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87151d2-07e1-4dbf-8efd-735f51200fc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:05:33.809301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87151d2-07e1-4dbf-8efd-735f51200fc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:33.810809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 801/1582] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:33.811182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87151d2-07e1-4dbf-8efd-735f51200fc4 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:33.812452 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e50b3d-1310-4ae2-961c-b33be881869f None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:33.830407 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 782/1583] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:05:33.831959 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87151d2-07e1-4dbf-8efd-735f51200fc4 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:33.832195 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e50b3d-1310-4ae2-961c-b33be881869f None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:33.838536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524bb5e-bfee-49ec-9dfc-e8a2e3ca3858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:33.842185 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524bb5e-bfee-49ec-9dfc-e8a2e3ca3858 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.842185 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524bb5e-bfee-49ec-9dfc-e8a2e3ca3858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.842185 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524bb5e-bfee-49ec-9dfc-e8a2e3ca3858 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.842185 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524bb5e-bfee-49ec-9dfc-e8a2e3ca3858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:33.845011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524bb5e-bfee-49ec-9dfc-e8a2e3ca3858 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:33.850761 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87151d2-07e1-4dbf-8efd-735f51200fc4 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:33.857711 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b250f88-c45c-4137-96b9-fbab7325750d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:33.858672 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b250f88-c45c-4137-96b9-fbab7325750d admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.859206 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b250f88-c45c-4137-96b9-fbab7325750d admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.859989 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b250f88-c45c-4137-96b9-fbab7325750d admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.860604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b250f88-c45c-4137-96b9-fbab7325750d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:33.862938 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b250f88-c45c-4137-96b9-fbab7325750d admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:33.874709 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 802/1584] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:05:33 2022] POST /identity/v3/users => generated 292 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:33.876130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524bb5e-bfee-49ec-9dfc-e8a2e3ca3858 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:33.889341 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 783/1585] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:05:33 2022] POST /identity/v3/users => generated 297 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:33.890604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b250f88-c45c-4137-96b9-fbab7325750d admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:33.898053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524bb5e-bfee-49ec-9dfc-e8a2e3ca3858 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:33.902261 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b250f88-c45c-4137-96b9-fbab7325750d admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:33.907293 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d269748-61a6-456c-ac4d-4e8ef6ab80d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:33.908447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d269748-61a6-456c-ac4d-4e8ef6ab80d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.908918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d269748-61a6-456c-ac4d-4e8ef6ab80d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.909411 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d269748-61a6-456c-ac4d-4e8ef6ab80d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.909605 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba70068-0cd3-4749-ae52-ee173ade59b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:33.910384 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba70068-0cd3-4749-ae52-ee173ade59b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.910739 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d269748-61a6-456c-ac4d-4e8ef6ab80d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:33.910976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba70068-0cd3-4749-ae52-ee173ade59b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.911301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba70068-0cd3-4749-ae52-ee173ade59b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.912149 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba70068-0cd3-4749-ae52-ee173ade59b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:33.913709 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d269748-61a6-456c-ac4d-4e8ef6ab80d7 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:33.913907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba70068-0cd3-4749-ae52-ee173ade59b3 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:33.931833 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 803/1586] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:33.932113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 784/1587] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:33.932313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d269748-61a6-456c-ac4d-4e8ef6ab80d7 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:33.932472 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba70068-0cd3-4749-ae52-ee173ade59b3 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:33.939775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d269748-61a6-456c-ac4d-4e8ef6ab80d7 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:33.942633 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba70068-0cd3-4749-ae52-ee173ade59b3 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:33.945405 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e032d3-7e34-45c9-af2e-9bad7c3c2e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:33.946014 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e032d3-7e34-45c9-af2e-9bad7c3c2e19 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.946323 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e032d3-7e34-45c9-af2e-9bad7c3c2e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.946572 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e032d3-7e34-45c9-af2e-9bad7c3c2e19 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.947329 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e032d3-7e34-45c9-af2e-9bad7c3c2e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:33.949285 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e032d3-7e34-45c9-af2e-9bad7c3c2e19 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:33.950130 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfe119-1e0e-4dd4-b873-6a08ede7a66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:33.951352 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfe119-1e0e-4dd4-b873-6a08ede7a66a admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:33.951742 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfe119-1e0e-4dd4-b873-6a08ede7a66a admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:33.952196 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfe119-1e0e-4dd4-b873-6a08ede7a66a admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:33.952857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfe119-1e0e-4dd4-b873-6a08ede7a66a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:33.955028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfe119-1e0e-4dd4-b873-6a08ede7a66a admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:33.973770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 804/1588] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:05:33 2022] POST /identity/v3/users => generated 284 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:33.974482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e032d3-7e34-45c9-af2e-9bad7c3c2e19 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:34.003701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 785/1589] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:05:33 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:34.005398 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfe119-1e0e-4dd4-b873-6a08ede7a66a admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:34.048086 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e032d3-7e34-45c9-af2e-9bad7c3c2e19 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:34.091038 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfe119-1e0e-4dd4-b873-6a08ede7a66a admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:34.097550 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647550ea-d467-4845-bebd-c793635a3c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:34.098304 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647550ea-d467-4845-bebd-c793635a3c0a admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:34.098589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647550ea-d467-4845-bebd-c793635a3c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:34.098999 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647550ea-d467-4845-bebd-c793635a3c0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:34.099796 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647550ea-d467-4845-bebd-c793635a3c0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:34.102057 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647550ea-d467-4845-bebd-c793635a3c0a admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:34.124487 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4700d7-c88a-4a68-8e65-013548adbcae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:34.125552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4700d7-c88a-4a68-8e65-013548adbcae service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:34.125996 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4700d7-c88a-4a68-8e65-013548adbcae service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:34.126443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4700d7-c88a-4a68-8e65-013548adbcae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:34.140324 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 786/1590] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:05:34 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:34.140860 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4700d7-c88a-4a68-8e65-013548adbcae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:34.142008 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647550ea-d467-4845-bebd-c793635a3c0a admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:34.143790 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4700d7-c88a-4a68-8e65-013548adbcae service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:34.159644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 805/1591] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:34.161224 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4700d7-c88a-4a68-8e65-013548adbcae service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:34.178728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4700d7-c88a-4a68-8e65-013548adbcae service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:34.260316 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647550ea-d467-4845-bebd-c793635a3c0a admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:34.269385 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d22486-4b2a-433a-8e28-1788b582fca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:34.270570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d22486-4b2a-433a-8e28-1788b582fca7 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:34.271119 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d22486-4b2a-433a-8e28-1788b582fca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:34.271260 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449edeef-bcd3-4c77-ba9a-8fff440ed3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:34.271868 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d22486-4b2a-433a-8e28-1788b582fca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:34.272265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449edeef-bcd3-4c77-ba9a-8fff440ed3dd admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:34.272791 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449edeef-bcd3-4c77-ba9a-8fff440ed3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:34.273479 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d22486-4b2a-433a-8e28-1788b582fca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:34.273617 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449edeef-bcd3-4c77-ba9a-8fff440ed3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:34.274959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449edeef-bcd3-4c77-ba9a-8fff440ed3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:34.276118 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d22486-4b2a-433a-8e28-1788b582fca7 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:34.278190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449edeef-bcd3-4c77-ba9a-8fff440ed3dd admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:34.294719 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 787/1592] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:34.296343 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d22486-4b2a-433a-8e28-1788b582fca7 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:34.300296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 806/1593] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:34.302039 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449edeef-bcd3-4c77-ba9a-8fff440ed3dd admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:34.311569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d22486-4b2a-433a-8e28-1788b582fca7 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:34.317414 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76083a-03e4-40f6-ae29-82d8280aa4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:34.318325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76083a-03e4-40f6-ae29-82d8280aa4ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:34.318604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76083a-03e4-40f6-ae29-82d8280aa4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:34.319107 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76083a-03e4-40f6-ae29-82d8280aa4ed admin admin] PATH_INFO: `/v3/projects/1d9d1e93bd8b423fa9a05c3dae5f0caa/users/9fcc42e903204b3ab142a6d682bc8b4f/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:34.327062 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449edeef-bcd3-4c77-ba9a-8fff440ed3dd admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:34.334554 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be41b72-a4b5-4e29-9be1-12e767b9ccf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:34.336159 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be41b72-a4b5-4e29-9be1-12e767b9ccf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:34.336742 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be41b72-a4b5-4e29-9be1-12e767b9ccf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:34.337172 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be41b72-a4b5-4e29-9be1-12e767b9ccf2 admin admin] PATH_INFO: `/v3/projects/65650abbf31f4ef8a10c264485b47be3/users/fde5c781420e46639473b439cc69de64/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:34.338318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76083a-03e4-40f6-ae29-82d8280aa4ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9d1e93bd8b423fa9a05c3dae5f0caa, user_id=9fcc42e903204b3ab142a6d682bc8b4f, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:34.341812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76083a-03e4-40f6-ae29-82d8280aa4ed admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:34.363390 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 788/1594] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:05:34 2022] PUT /identity/v3/projects/1d9d1e93bd8b423fa9a05c3dae5f0caa/users/9fcc42e903204b3ab142a6d682bc8b4f/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:34.363390 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76083a-03e4-40f6-ae29-82d8280aa4ed admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:34.363828 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be41b72-a4b5-4e29-9be1-12e767b9ccf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65650abbf31f4ef8a10c264485b47be3, user_id=fde5c781420e46639473b439cc69de64, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:34.368079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be41b72-a4b5-4e29-9be1-12e767b9ccf2 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:34.391846 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 807/1595] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:05:34 2022] PUT /identity/v3/projects/65650abbf31f4ef8a10c264485b47be3/users/fde5c781420e46639473b439cc69de64/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:34.393196 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be41b72-a4b5-4e29-9be1-12e767b9ccf2 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:34.474020 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76083a-03e4-40f6-ae29-82d8280aa4ed admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:34.487613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be41b72-a4b5-4e29-9be1-12e767b9ccf2 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:34.493662 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14461844-178d-4b8f-81e3-dd97bd4af24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:34.494366 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14461844-178d-4b8f-81e3-dd97bd4af24f admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:34.494864 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14461844-178d-4b8f-81e3-dd97bd4af24f admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:34.495155 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14461844-178d-4b8f-81e3-dd97bd4af24f admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:34.495712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14461844-178d-4b8f-81e3-dd97bd4af24f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:34.498170 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14461844-178d-4b8f-81e3-dd97bd4af24f admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:34.530120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 808/1596] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:05:34 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:34.531908 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14461844-178d-4b8f-81e3-dd97bd4af24f admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:34.543849 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14461844-178d-4b8f-81e3-dd97bd4af24f admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:34.552464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acb08d-8b28-4c0a-9ad4-cba309ad977c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:34.554344 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acb08d-8b28-4c0a-9ad4-cba309ad977c admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:34.554344 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acb08d-8b28-4c0a-9ad4-cba309ad977c admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:34.554811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acb08d-8b28-4c0a-9ad4-cba309ad977c admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:34.556433 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2acb08d-8b28-4c0a-9ad4-cba309ad977c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:34.560938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2acb08d-8b28-4c0a-9ad4-cba309ad977c admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:34.585324 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422bbd1-9a83-4967-a7aa-4e9565427596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:34.586191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422bbd1-9a83-4967-a7aa-4e9565427596 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:34.586479 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422bbd1-9a83-4967-a7aa-4e9565427596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:34.586798 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422bbd1-9a83-4967-a7aa-4e9565427596 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:34.587636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422bbd1-9a83-4967-a7aa-4e9565427596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:34.589567 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422bbd1-9a83-4967-a7aa-4e9565427596 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:34.596682 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 809/1597] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:05:34 2022] POST /identity/v3/users => generated 294 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:34.600702 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acb08d-8b28-4c0a-9ad4-cba309ad977c admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:34.601752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 789/1598] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:34.608325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422bbd1-9a83-4967-a7aa-4e9565427596 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:34.614266 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acb08d-8b28-4c0a-9ad4-cba309ad977c admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:34.620406 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbd71d-17a8-4c09-ab8b-bdb7f4324902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:34.621209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbd71d-17a8-4c09-ab8b-bdb7f4324902 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:34.621565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbd71d-17a8-4c09-ab8b-bdb7f4324902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:34.621914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbd71d-17a8-4c09-ab8b-bdb7f4324902 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:34.623369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbd71d-17a8-4c09-ab8b-bdb7f4324902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:34.625272 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbd71d-17a8-4c09-ab8b-bdb7f4324902 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:34.629510 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422bbd1-9a83-4967-a7aa-4e9565427596 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:34.640918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 810/1599] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:34.640918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbd71d-17a8-4c09-ab8b-bdb7f4324902 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:34.642941 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863562ab-09ff-4e5a-b01f-17baa92c176b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:34.644157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863562ab-09ff-4e5a-b01f-17baa92c176b admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:34.644948 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863562ab-09ff-4e5a-b01f-17baa92c176b admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:34.645528 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863562ab-09ff-4e5a-b01f-17baa92c176b admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:34.647066 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863562ab-09ff-4e5a-b01f-17baa92c176b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:34.650451 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863562ab-09ff-4e5a-b01f-17baa92c176b admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:34.652541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbd71d-17a8-4c09-ab8b-bdb7f4324902 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:34.658218 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82136e55-e5d6-475d-a54c-16ba30f85b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:34.659108 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82136e55-e5d6-475d-a54c-16ba30f85b5e admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:34.659398 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82136e55-e5d6-475d-a54c-16ba30f85b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:34.659780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82136e55-e5d6-475d-a54c-16ba30f85b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:34.660605 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82136e55-e5d6-475d-a54c-16ba30f85b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:34.662346 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82136e55-e5d6-475d-a54c-16ba30f85b5e admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:34.675845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 790/1600] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:34.676099 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 811/1601] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:34.676099 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82136e55-e5d6-475d-a54c-16ba30f85b5e admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:34.676300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca871e1-94f2-41f8-a8f8-51ab7f78e4c9 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:34.676524 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca871e1-94f2-41f8-a8f8-51ab7f78e4c9 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:34.677106 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca871e1-94f2-41f8-a8f8-51ab7f78e4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:34.687711 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82136e55-e5d6-475d-a54c-16ba30f85b5e admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:34.697859 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf3934-9545-4dd5-ac2c-bb30365369ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:34.699088 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf3934-9545-4dd5-ac2c-bb30365369ce admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:34.699582 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf3934-9545-4dd5-ac2c-bb30365369ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:34.700068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf3934-9545-4dd5-ac2c-bb30365369ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:34.701715 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf3934-9545-4dd5-ac2c-bb30365369ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:34.705411 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf3934-9545-4dd5-ac2c-bb30365369ce admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:34.724983 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 812/1602] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:34.726055 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf3934-9545-4dd5-ac2c-bb30365369ce admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:34.739605 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-cca871e1-94f2-41f8-a8f8-51ab7f78e4c9 None None] MFA Rules not processed for user `fde5c781420e46639473b439cc69de64`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:34.742205 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-cca871e1-94f2-41f8-a8f8-51ab7f78e4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:34.744422 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf3934-9545-4dd5-ac2c-bb30365369ce admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:34.750436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4273b-5d1e-425d-a82a-2f3e542a40e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:34.751301 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4273b-5d1e-425d-a82a-2f3e542a40e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:34.751531 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4273b-5d1e-425d-a82a-2f3e542a40e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:34.751825 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4273b-5d1e-425d-a82a-2f3e542a40e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:34.752590 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4273b-5d1e-425d-a82a-2f3e542a40e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:34.754252 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4273b-5d1e-425d-a82a-2f3e542a40e6 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:34.766429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 813/1603] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:34.767398 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4273b-5d1e-425d-a82a-2f3e542a40e6 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:34.778347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4273b-5d1e-425d-a82a-2f3e542a40e6 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:34.784750 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f169969-da0f-4197-b464-18390cf6a3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:34.785706 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f169969-da0f-4197-b464-18390cf6a3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:34.786048 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f169969-da0f-4197-b464-18390cf6a3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:34.786778 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f169969-da0f-4197-b464-18390cf6a3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:34.787329 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f169969-da0f-4197-b464-18390cf6a3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:34.789240 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f169969-da0f-4197-b464-18390cf6a3c4 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:34.807050 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 814/1604] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:34.807050 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f169969-da0f-4197-b464-18390cf6a3c4 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:34.823077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f169969-da0f-4197-b464-18390cf6a3c4 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:34.834514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58e7a4-7cbb-4802-9d4c-61a64f551e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:34.836182 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58e7a4-7cbb-4802-9d4c-61a64f551e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:34.836667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58e7a4-7cbb-4802-9d4c-61a64f551e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:34.837171 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58e7a4-7cbb-4802-9d4c-61a64f551e5c admin admin] PATH_INFO: `/v3/projects/6b311c72bd364ab6b8097d0f92f08c01/users/21c6ac7db0044888a42c9182ea676878/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:34.869133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58e7a4-7cbb-4802-9d4c-61a64f551e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b311c72bd364ab6b8097d0f92f08c01, user_id=21c6ac7db0044888a42c9182ea676878, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:34.871347 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 791/1605] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:34.874153 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca871e1-94f2-41f8-a8f8-51ab7f78e4c9 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:34.875508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58e7a4-7cbb-4802-9d4c-61a64f551e5c admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:34.895385 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca871e1-94f2-41f8-a8f8-51ab7f78e4c9 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:34.902468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209ffb2-5000-4e8f-bfe8-994cd3ec8982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:34.903431 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209ffb2-5000-4e8f-bfe8-994cd3ec8982 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:34.903819 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209ffb2-5000-4e8f-bfe8-994cd3ec8982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:34.904248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209ffb2-5000-4e8f-bfe8-994cd3ec8982 admin admin] PATH_INFO: `/v3/projects/111be86266874d2ebfa7f6bd36125719/users/c1627da761c74fc79523a0fa319176b4/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:34.928122 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 815/1606] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:05:34 2022] PUT /identity/v3/projects/6b311c72bd364ab6b8097d0f92f08c01/users/21c6ac7db0044888a42c9182ea676878/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:34.930463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58e7a4-7cbb-4802-9d4c-61a64f551e5c admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:34.937996 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209ffb2-5000-4e8f-bfe8-994cd3ec8982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=111be86266874d2ebfa7f6bd36125719, user_id=c1627da761c74fc79523a0fa319176b4, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:34.944970 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209ffb2-5000-4e8f-bfe8-994cd3ec8982 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:34.969042 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 792/1607] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:05:34 2022] PUT /identity/v3/projects/111be86266874d2ebfa7f6bd36125719/users/c1627da761c74fc79523a0fa319176b4/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:34.970347 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209ffb2-5000-4e8f-bfe8-994cd3ec8982 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:35.034425 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58e7a4-7cbb-4802-9d4c-61a64f551e5c admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:35.060084 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209ffb2-5000-4e8f-bfe8-994cd3ec8982 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:35.065647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8b9bd-c7e5-4f01-98d1-74cbd6a9f763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:35.066476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8b9bd-c7e5-4f01-98d1-74cbd6a9f763 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:35.066647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8b9bd-c7e5-4f01-98d1-74cbd6a9f763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:35.067576 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8b9bd-c7e5-4f01-98d1-74cbd6a9f763 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:35.067706 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8b9bd-c7e5-4f01-98d1-74cbd6a9f763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:35.069322 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8b9bd-c7e5-4f01-98d1-74cbd6a9f763 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:35.081344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 793/1608] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:35.082212 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8b9bd-c7e5-4f01-98d1-74cbd6a9f763 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:35.096700 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8b9bd-c7e5-4f01-98d1-74cbd6a9f763 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:35.103810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90119dd2-96df-451e-8b62-516e714ffe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:35.103810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90119dd2-96df-451e-8b62-516e714ffe50 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:35.103810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90119dd2-96df-451e-8b62-516e714ffe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:35.104481 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90119dd2-96df-451e-8b62-516e714ffe50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:35.104839 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90119dd2-96df-451e-8b62-516e714ffe50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:35.106505 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90119dd2-96df-451e-8b62-516e714ffe50 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:35.124032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 794/1609] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:35.125067 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90119dd2-96df-451e-8b62-516e714ffe50 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:35.138163 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90119dd2-96df-451e-8b62-516e714ffe50 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:35.144762 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff9e8d-13ff-4f31-aeb6-550026fb0690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:35.145727 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff9e8d-13ff-4f31-aeb6-550026fb0690 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:35.146035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff9e8d-13ff-4f31-aeb6-550026fb0690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:35.146393 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff9e8d-13ff-4f31-aeb6-550026fb0690 admin admin] PATH_INFO: `/v3/projects/630997120b544518a9698d664678d072/users/f898d18dbab141aab898b0f2420ae04b/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:35.150995 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca794422-85da-497b-b8f3-6fc027dbc098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:35.152740 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca794422-85da-497b-b8f3-6fc027dbc098 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:35.153429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca794422-85da-497b-b8f3-6fc027dbc098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:35.154595 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca794422-85da-497b-b8f3-6fc027dbc098 admin admin] PATH_INFO: `/v3/projects/1d9d1e93bd8b423fa9a05c3dae5f0caa/users/9fcc42e903204b3ab142a6d682bc8b4f/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:35.158443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca794422-85da-497b-b8f3-6fc027dbc098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9d1e93bd8b423fa9a05c3dae5f0caa, user_id=9fcc42e903204b3ab142a6d682bc8b4f, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:35.164731 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca794422-85da-497b-b8f3-6fc027dbc098 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:35.168537 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff9e8d-13ff-4f31-aeb6-550026fb0690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=630997120b544518a9698d664678d072, user_id=f898d18dbab141aab898b0f2420ae04b, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:35.171975 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff9e8d-13ff-4f31-aeb6-550026fb0690 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:35.186003 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 816/1610] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:05:34 2022] PUT /identity/v3/projects/1d9d1e93bd8b423fa9a05c3dae5f0caa/users/9fcc42e903204b3ab142a6d682bc8b4f/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:35.188818 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbdbf8-b6fb-4cfb-a40b-0de5081d2ee0 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:35.189686 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbdbf8-b6fb-4cfb-a40b-0de5081d2ee0 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:35.190097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbdbf8-b6fb-4cfb-a40b-0de5081d2ee0 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:35.193005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 817/1611] 10.222.0.73 () {54 vars in 961 bytes} [Fri May 13 15:05:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 15:05:35.195269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0dbba-201e-4c2c-a397-50840848af9d None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:35.196429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0dbba-201e-4c2c-a397-50840848af9d None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:35.196804 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0dbba-201e-4c2c-a397-50840848af9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:35.202368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 795/1612] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:05:35 2022] PUT /identity/v3/projects/630997120b544518a9698d664678d072/users/f898d18dbab141aab898b0f2420ae04b/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:35.204875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d246f65-1f3d-4d9a-9850-cd236c957782 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:35.205457 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d246f65-1f3d-4d9a-9850-cd236c957782 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:35.205908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d246f65-1f3d-4d9a-9850-cd236c957782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:35.228586 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-7d246f65-1f3d-4d9a-9850-cd236c957782 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:35.229969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-7d246f65-1f3d-4d9a-9850-cd236c957782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:35.236574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-13f0dbba-201e-4c2c-a397-50840848af9d None None] MFA Rules not processed for user `21c6ac7db0044888a42c9182ea676878`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:35.238288 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-13f0dbba-201e-4c2c-a397-50840848af9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:35.327821 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 818/1613] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:35.328708 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0dbba-201e-4c2c-a397-50840848af9d None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:35.343884 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 796/1614] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:35.349655 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0dbba-201e-4c2c-a397-50840848af9d None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:35.354121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ce6ae-f5cc-4668-a73e-1dc9021257ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:35.354699 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d246f65-1f3d-4d9a-9850-cd236c957782 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:35.355767 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ce6ae-f5cc-4668-a73e-1dc9021257ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:35.355767 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ce6ae-f5cc-4668-a73e-1dc9021257ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:35.355767 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ce6ae-f5cc-4668-a73e-1dc9021257ca admin admin] PATH_INFO: `/v3/projects/bd7ca86cff8c4cea8ae70494f6d2e297/users/80566f337d344d3d82de74690546ffe4/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:35.385782 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ce6ae-f5cc-4668-a73e-1dc9021257ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7ca86cff8c4cea8ae70494f6d2e297, user_id=80566f337d344d3d82de74690546ffe4, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:35.407018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ce6ae-f5cc-4668-a73e-1dc9021257ca admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:35.407497 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d246f65-1f3d-4d9a-9850-cd236c957782 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:35.407497 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b26ed-cf9b-49c4-ba1b-e79386d33031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:35.407497 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b26ed-cf9b-49c4-ba1b-e79386d33031 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:35.407497 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b26ed-cf9b-49c4-ba1b-e79386d33031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:35.408138 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b26ed-cf9b-49c4-ba1b-e79386d33031 admin admin] PATH_INFO: `/v3/projects/e076e120b91a49b6896f0b16407564a2/users/477e3c3f65f6407c9c7a932c9650334d/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:35.436667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 819/1615] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:05:35 2022] PUT /identity/v3/projects/bd7ca86cff8c4cea8ae70494f6d2e297/users/80566f337d344d3d82de74690546ffe4/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:35.438254 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10cdf3-b8c0-40a7-b2df-88cb41752ee6 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:35.438502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b26ed-cf9b-49c4-ba1b-e79386d33031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e076e120b91a49b6896f0b16407564a2, user_id=477e3c3f65f6407c9c7a932c9650334d, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:35.438737 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10cdf3-b8c0-40a7-b2df-88cb41752ee6 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:35.439618 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10cdf3-b8c0-40a7-b2df-88cb41752ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:35.444467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b26ed-cf9b-49c4-ba1b-e79386d33031 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:35.467663 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 797/1616] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:05:35 2022] PUT /identity/v3/projects/e076e120b91a49b6896f0b16407564a2/users/477e3c3f65f6407c9c7a932c9650334d/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:35.470176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd50baf-e4a1-4229-b4a9-d8f7ebc091b6 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:35.470725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd50baf-e4a1-4229-b4a9-d8f7ebc091b6 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:35.471590 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd50baf-e4a1-4229-b4a9-d8f7ebc091b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:35.489527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-3a10cdf3-b8c0-40a7-b2df-88cb41752ee6 None None] MFA Rules not processed for user `9fcc42e903204b3ab142a6d682bc8b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:35.491756 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-3a10cdf3-b8c0-40a7-b2df-88cb41752ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:35.504261 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-ccd50baf-e4a1-4229-b4a9-d8f7ebc091b6 None None] MFA Rules not processed for user `52d539202cfb40a48b231713e16a599a`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:35.506681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ccd50baf-e4a1-4229-b4a9-d8f7ebc091b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:35.620311 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 798/1617] 10.222.0.73 () {58 vars in 1058 bytes} [Fri May 13 15:05:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:35.622908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f33be-53c5-4aa4-b87c-75d0b72453f9 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:35.623559 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f33be-53c5-4aa4-b87c-75d0b72453f9 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:35.624268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f33be-53c5-4aa4-b87c-75d0b72453f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:35.649420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 820/1618] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:35 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:35.650786 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10cdf3-b8c0-40a7-b2df-88cb41752ee6 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:35.676311 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-256f33be-53c5-4aa4-b87c-75d0b72453f9 None None] MFA Rules not processed for user `f898d18dbab141aab898b0f2420ae04b`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:35.678926 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-256f33be-53c5-4aa4-b87c-75d0b72453f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:35.740160 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10cdf3-b8c0-40a7-b2df-88cb41752ee6 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:35.747240 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb50783-4500-4f64-9f28-ff55f2c37144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:35.749073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb50783-4500-4f64-9f28-ff55f2c37144 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:35.749754 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb50783-4500-4f64-9f28-ff55f2c37144 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:35.750249 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb50783-4500-4f64-9f28-ff55f2c37144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:35.782058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 799/1619] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:35.783725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e7d38-06ca-4081-b8ed-10797644996c None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:35.784017 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e7d38-06ca-4081-b8ed-10797644996c None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:35.784379 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e7d38-06ca-4081-b8ed-10797644996c None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:35.785944 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 800/1620] 10.222.0.73 () {54 vars in 961 bytes} [Fri May 13 15:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 15:05:35.787518 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3de77-2cac-4ede-b09b-f031b5feddcc None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:35.787813 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3de77-2cac-4ede-b09b-f031b5feddcc None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:35.788101 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3de77-2cac-4ede-b09b-f031b5feddcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:35.831638 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-c0a3de77-2cac-4ede-b09b-f031b5feddcc None None] MFA Rules not processed for user `36f22701b4514d32a15c66e5e4d63bf1`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:35.833801 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c0a3de77-2cac-4ede-b09b-f031b5feddcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:35.848482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb50783-4500-4f64-9f28-ff55f2c37144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:35.850593 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb50783-4500-4f64-9f28-ff55f2c37144 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:35.863237 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 821/1621] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:35.864722 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91004daa-79e9-4e38-9764-4f5788fca84b None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:35.865098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91004daa-79e9-4e38-9764-4f5788fca84b None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:35.865262 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91004daa-79e9-4e38-9764-4f5788fca84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:35.912430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-91004daa-79e9-4e38-9764-4f5788fca84b None None] MFA Rules not processed for user `80566f337d344d3d82de74690546ffe4`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:35.914188 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-91004daa-79e9-4e38-9764-4f5788fca84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:35.970945 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 801/1622] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:35.973476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9df5b3-12ae-4247-a244-266586b49110 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:35.973987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9df5b3-12ae-4247-a244-266586b49110 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:35.974518 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9df5b3-12ae-4247-a244-266586b49110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:36.009311 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-3d9df5b3-12ae-4247-a244-266586b49110 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:36.011813 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-3d9df5b3-12ae-4247-a244-266586b49110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:36.024894 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 802/1623] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:36.026521 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9df5b3-12ae-4247-a244-266586b49110 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:36.041929 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 822/1624] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:36.043664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91004daa-79e9-4e38-9764-4f5788fca84b None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:36.062988 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9df5b3-12ae-4247-a244-266586b49110 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:36.071679 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa3499-f2cc-4bf2-8460-2bcf7a1495b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:36.071679 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa3499-f2cc-4bf2-8460-2bcf7a1495b8 service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:36.072215 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa3499-f2cc-4bf2-8460-2bcf7a1495b8 service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:36.072422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa3499-f2cc-4bf2-8460-2bcf7a1495b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:36.123812 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91004daa-79e9-4e38-9764-4f5788fca84b None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:36.128475 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef1b72-2d84-4ffc-b5e8-f72051d4fc5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:36.129400 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef1b72-2d84-4ffc-b5e8-f72051d4fc5f service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:36.129701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef1b72-2d84-4ffc-b5e8-f72051d4fc5f service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:36.130098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef1b72-2d84-4ffc-b5e8-f72051d4fc5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:36.143459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef1b72-2d84-4ffc-b5e8-f72051d4fc5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:36.145647 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef1b72-2d84-4ffc-b5e8-f72051d4fc5f service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:36.159025 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 823/1625] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:36 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:36.160943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817aacba-eb8f-420b-aede-6f58b3d61aa9 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:36.160943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817aacba-eb8f-420b-aede-6f58b3d61aa9 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:36.161343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817aacba-eb8f-420b-aede-6f58b3d61aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:36.178141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa3499-f2cc-4bf2-8460-2bcf7a1495b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:36.182602 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa3499-f2cc-4bf2-8460-2bcf7a1495b8 service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:36.191471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-817aacba-eb8f-420b-aede-6f58b3d61aa9 None None] MFA Rules not processed for user `52d539202cfb40a48b231713e16a599a`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:36.193250 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-817aacba-eb8f-420b-aede-6f58b3d61aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:36.212007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 824/1626] 10.222.0.73 () {58 vars in 1058 bytes} [Fri May 13 15:05:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:36.213931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817aacba-eb8f-420b-aede-6f58b3d61aa9 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:36.214485 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 803/1627] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:36.219725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b083fb2-d73c-4de8-9604-77d705b9d866 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:36.220001 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b083fb2-d73c-4de8-9604-77d705b9d866 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:36.220328 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b083fb2-d73c-4de8-9604-77d705b9d866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:36.231084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817aacba-eb8f-420b-aede-6f58b3d61aa9 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:36.244153 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c5d8b-37de-44d6-859d-363ee873d3fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:36.245509 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c5d8b-37de-44d6-859d-363ee873d3fd service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:36.245994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c5d8b-37de-44d6-859d-363ee873d3fd service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:36.246508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c5d8b-37de-44d6-859d-363ee873d3fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:36.258987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-9b083fb2-d73c-4de8-9604-77d705b9d866 None None] MFA Rules not processed for user `36f22701b4514d32a15c66e5e4d63bf1`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:36.261551 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-9b083fb2-d73c-4de8-9604-77d705b9d866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:36.275992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 804/1628] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:36.278380 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b083fb2-d73c-4de8-9604-77d705b9d866 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:36.299906 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c5d8b-37de-44d6-859d-363ee873d3fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:36.304756 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c5d8b-37de-44d6-859d-363ee873d3fd service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:36.312356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b083fb2-d73c-4de8-9604-77d705b9d866 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:36.320309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03a7b5-e030-48ba-b03d-5067e5fb7576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:36.321514 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a7b5-e030-48ba-b03d-5067e5fb7576 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:36.322129 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a7b5-e030-48ba-b03d-5067e5fb7576 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:36.322670 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a7b5-e030-48ba-b03d-5067e5fb7576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:36.349051 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03a7b5-e030-48ba-b03d-5067e5fb7576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:36.349651 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 825/1629] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:36.357466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c5d8b-37de-44d6-859d-363ee873d3fd service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:36.364567 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03a7b5-e030-48ba-b03d-5067e5fb7576 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:36.402678 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c5d8b-37de-44d6-859d-363ee873d3fd service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:36.406632 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 805/1630] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:36.424772 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03a7b5-e030-48ba-b03d-5067e5fb7576 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:36.433094 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67987b-a553-4759-a5b4-3c3575cc1178 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:36.433825 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67987b-a553-4759-a5b4-3c3575cc1178 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:36.434166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67987b-a553-4759-a5b4-3c3575cc1178 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:36.434444 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67987b-a553-4759-a5b4-3c3575cc1178 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:36.447285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03a7b5-e030-48ba-b03d-5067e5fb7576 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:36.467073 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801dd0b-24ef-4a76-8b4f-8d122a6c3451 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:36.468808 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801dd0b-24ef-4a76-8b4f-8d122a6c3451 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:36.469593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801dd0b-24ef-4a76-8b4f-8d122a6c3451 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:36.470310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801dd0b-24ef-4a76-8b4f-8d122a6c3451 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:36.624480 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67987b-a553-4759-a5b4-3c3575cc1178 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:36.624795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801dd0b-24ef-4a76-8b4f-8d122a6c3451 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:36.624795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801dd0b-24ef-4a76-8b4f-8d122a6c3451 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:36.625407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67987b-a553-4759-a5b4-3c3575cc1178 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:36.625497 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 806/1631] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:36 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:05:36.651405 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 826/1632] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:36.657120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801dd0b-24ef-4a76-8b4f-8d122a6c3451 service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:36.684338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801dd0b-24ef-4a76-8b4f-8d122a6c3451 service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:36.706770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72ec39-6a2c-4ca5-8461-f4cdcfd61b2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:36.708594 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72ec39-6a2c-4ca5-8461-f4cdcfd61b2e service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:36.712354 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72ec39-6a2c-4ca5-8461-f4cdcfd61b2e service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:36.716764 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72ec39-6a2c-4ca5-8461-f4cdcfd61b2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:36.745223 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72ec39-6a2c-4ca5-8461-f4cdcfd61b2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:36.749811 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72ec39-6a2c-4ca5-8461-f4cdcfd61b2e service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:36.771570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 807/1633] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:36.862168 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a5823-04bb-434a-be00-279d81d97350 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:36.862851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a5823-04bb-434a-be00-279d81d97350 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:36.863451 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a5823-04bb-434a-be00-279d81d97350 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:36.868428 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 827/1634] 10.222.0.73 () {54 vars in 912 bytes} [Fri May 13 15:05:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 15:05:36.877574 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55911336-d87b-4d38-b9bc-7b3ce6f8bd0f None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:36.878202 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55911336-d87b-4d38-b9bc-7b3ce6f8bd0f None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:36.879045 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55911336-d87b-4d38-b9bc-7b3ce6f8bd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:36.950006 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-55911336-d87b-4d38-b9bc-7b3ce6f8bd0f None None] MFA Rules not processed for user `52d539202cfb40a48b231713e16a599a`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:36.955654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-55911336-d87b-4d38-b9bc-7b3ce6f8bd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:36.992326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 808/1635] 10.222.0.73 () {58 vars in 1009 bytes} [Fri May 13 15:05:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:37.132586 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a5823-04bb-434a-be00-279d81d97350 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:37.147721 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a5823-04bb-434a-be00-279d81d97350 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:37.152226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71ccb9-1f97-4008-b083-35f46ba2abaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:37.153969 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71ccb9-1f97-4008-b083-35f46ba2abaa service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:37.153969 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71ccb9-1f97-4008-b083-35f46ba2abaa service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:37.153969 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71ccb9-1f97-4008-b083-35f46ba2abaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:37.174779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71ccb9-1f97-4008-b083-35f46ba2abaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:37.177632 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71ccb9-1f97-4008-b083-35f46ba2abaa service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:37.225966 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 828/1636] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:37.312842 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84664a-8ad4-4c24-9d2b-cc2184430b87 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:37.313360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84664a-8ad4-4c24-9d2b-cc2184430b87 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:37.313875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84664a-8ad4-4c24-9d2b-cc2184430b87 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:37.317520 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 809/1637] 10.222.0.73 () {54 vars in 912 bytes} [Fri May 13 15:05:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 15:05:37.327632 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f86d0-81b8-40e6-a0be-ba5a8e936331 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:37.328224 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f86d0-81b8-40e6-a0be-ba5a8e936331 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:37.328752 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f86d0-81b8-40e6-a0be-ba5a8e936331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:37.387631 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-479f86d0-81b8-40e6-a0be-ba5a8e936331 None None] MFA Rules not processed for user `52d539202cfb40a48b231713e16a599a`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:37.390863 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-479f86d0-81b8-40e6-a0be-ba5a8e936331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:37.421118 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 829/1638] 10.222.0.73 () {58 vars in 1009 bytes} [Fri May 13 15:05:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:05:38.067295 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84664a-8ad4-4c24-9d2b-cc2184430b87 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:38.110914 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84664a-8ad4-4c24-9d2b-cc2184430b87 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:38.131847 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9ad93-3601-4155-a5f2-403ee4889044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:38.135467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9ad93-3601-4155-a5f2-403ee4889044 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:38.136830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9ad93-3601-4155-a5f2-403ee4889044 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:38.140759 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9ad93-3601-4155-a5f2-403ee4889044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:38.207288 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9ad93-3601-4155-a5f2-403ee4889044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:38.217456 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9ad93-3601-4155-a5f2-403ee4889044 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:38.271404 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 810/1639] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:38.980965 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f86d0-81b8-40e6-a0be-ba5a8e936331 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:39.007783 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f86d0-81b8-40e6-a0be-ba5a8e936331 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:39.037104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a94bf1-c1f5-4b71-8e3d-1a4d03c367f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:39.038113 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a94bf1-c1f5-4b71-8e3d-1a4d03c367f5 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:39.038687 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a94bf1-c1f5-4b71-8e3d-1a4d03c367f5 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:39.039153 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a94bf1-c1f5-4b71-8e3d-1a4d03c367f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:39.067869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a94bf1-c1f5-4b71-8e3d-1a4d03c367f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:39.072236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a94bf1-c1f5-4b71-8e3d-1a4d03c367f5 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:39.104078 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 830/1640] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:05:40.066339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9ad93-3601-4155-a5f2-403ee4889044 service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:40.104016 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9ad93-3601-4155-a5f2-403ee4889044 service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:40.116669 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb44f5-02fb-492f-a12d-773a29b39bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:40.118055 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb44f5-02fb-492f-a12d-773a29b39bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:40.120394 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb44f5-02fb-492f-a12d-773a29b39bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:40.121041 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb44f5-02fb-492f-a12d-773a29b39bca admin admin] PATH_INFO: `/v3/users/fde5c781420e46639473b439cc69de64` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:40.128169 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb44f5-02fb-492f-a12d-773a29b39bca admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde5c781420e46639473b439cc69de64)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:40.135108 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb44f5-02fb-492f-a12d-773a29b39bca admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:40.183170 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48742f7c-6fd2-429c-8d58-08b58bf52fb1 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:40.184124 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48742f7c-6fd2-429c-8d58-08b58bf52fb1 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:40.184124 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48742f7c-6fd2-429c-8d58-08b58bf52fb1 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:40.186675 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 831/1641] 10.222.0.73 () {54 vars in 912 bytes} [Fri May 13 15:05:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 15:05:40.197249 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b414a-5427-4ddd-97f3-3d39753ef9bc None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:40.197582 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b414a-5427-4ddd-97f3-3d39753ef9bc None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:40.197796 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b414a-5427-4ddd-97f3-3d39753ef9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:40.290560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-0b4b414a-5427-4ddd-97f3-3d39753ef9bc None None] MFA Rules not processed for user `ee97a542470644f89cd665dfdf2f9e92`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:40.293329 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-0b4b414a-5427-4ddd-97f3-3d39753ef9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:40.306440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9afb44f5-02fb-492f-a12d-773a29b39bca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde5c781420e46639473b439cc69de64'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:40.315229 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 832/1642] 10.222.0.73 () {58 vars in 1009 bytes} [Fri May 13 15:05:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:05:40.322787 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9afb44f5-02fb-492f-a12d-773a29b39bca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde5c781420e46639473b439cc69de64'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:40.334203 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b414a-5427-4ddd-97f3-3d39753ef9bc None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:40.355455 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9afb44f5-02fb-492f-a12d-773a29b39bca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde5c781420e46639473b439cc69de64'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:40.357617 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9afb44f5-02fb-492f-a12d-773a29b39bca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde5c781420e46639473b439cc69de64'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:40.362135 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b414a-5427-4ddd-97f3-3d39753ef9bc None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:40.371583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b119bd-3e9b-466c-922d-1c58aa3e123e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:40.373651 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b119bd-3e9b-466c-922d-1c58aa3e123e service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:40.374079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b119bd-3e9b-466c-922d-1c58aa3e123e service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:40.374940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b119bd-3e9b-466c-922d-1c58aa3e123e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:40.376176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9afb44f5-02fb-492f-a12d-773a29b39bca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde5c781420e46639473b439cc69de64'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:40.382908 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-86b119bd-3e9b-466c-922d-1c58aa3e123e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:40.390256 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 811/1643] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:05:40 2022] DELETE /identity/v3/users/fde5c781420e46639473b439cc69de64 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:05:40.396584 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffba3c-0791-4357-a15a-8fda329e4419 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:40.397068 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffba3c-0791-4357-a15a-8fda329e4419 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:40.397197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffba3c-0791-4357-a15a-8fda329e4419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:40.433913 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-20ffba3c-0791-4357-a15a-8fda329e4419 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:40.435122 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-20ffba3c-0791-4357-a15a-8fda329e4419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:40.436892 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b119bd-3e9b-466c-922d-1c58aa3e123e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:40.444612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b119bd-3e9b-466c-922d-1c58aa3e123e service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:40.492622 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 833/1644] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:40.607928 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 812/1645] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:40.646778 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b119bd-3e9b-466c-922d-1c58aa3e123e service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:40.649721 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-86b119bd-3e9b-466c-922d-1c58aa3e123e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:40.689809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b119bd-3e9b-466c-922d-1c58aa3e123e service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:40.882446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70255964-6006-4eda-8d2e-5a98e17d7d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:40.896320 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70255964-6006-4eda-8d2e-5a98e17d7d9c service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:40.896942 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70255964-6006-4eda-8d2e-5a98e17d7d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:40.898508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70255964-6006-4eda-8d2e-5a98e17d7d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:40.939617 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70255964-6006-4eda-8d2e-5a98e17d7d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:40.941127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70255964-6006-4eda-8d2e-5a98e17d7d9c service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:41.002445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 834/1646] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:05:41.604615 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8278c9a-aaeb-4dc0-9672-2f2891b5b60a None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:41.605157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8278c9a-aaeb-4dc0-9672-2f2891b5b60a None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:41.605351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8278c9a-aaeb-4dc0-9672-2f2891b5b60a None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:41.607824 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 813/1647] 10.222.0.73 () {54 vars in 960 bytes} [Fri May 13 15:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 15:05:41.616500 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e5bc5-0b55-4b41-b004-3cd0769d57aa None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:41.617090 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e5bc5-0b55-4b41-b004-3cd0769d57aa None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:41.617090 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e5bc5-0b55-4b41-b004-3cd0769d57aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:41.656373 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8278c9a-aaeb-4dc0-9672-2f2891b5b60a None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:41.658448 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-f8278c9a-aaeb-4dc0-9672-2f2891b5b60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:41.677205 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8278c9a-aaeb-4dc0-9672-2f2891b5b60a None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:41.687071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-048e5bc5-0b55-4b41-b004-3cd0769d57aa None None] MFA Rules not processed for user `908d23b035f14756b438b3a61a63b2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:41.687916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83e7ef-68ce-420d-bb4c-5554f4782537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:41.689083 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83e7ef-68ce-420d-bb4c-5554f4782537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:41.689411 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-048e5bc5-0b55-4b41-b004-3cd0769d57aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:41.689530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83e7ef-68ce-420d-bb4c-5554f4782537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:41.689970 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83e7ef-68ce-420d-bb4c-5554f4782537 admin admin] PATH_INFO: `/v3/users/bc8670d683f545788ce67b98931e8389` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:41.691895 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83e7ef-68ce-420d-bb4c-5554f4782537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc8670d683f545788ce67b98931e8389)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:41.698141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83e7ef-68ce-420d-bb4c-5554f4782537 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:41.808677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-cc83e7ef-68ce-420d-bb4c-5554f4782537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc8670d683f545788ce67b98931e8389'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:41.828557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-cc83e7ef-68ce-420d-bb4c-5554f4782537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc8670d683f545788ce67b98931e8389'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:41.859251 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-cc83e7ef-68ce-420d-bb4c-5554f4782537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc8670d683f545788ce67b98931e8389'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:41.860301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-cc83e7ef-68ce-420d-bb4c-5554f4782537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc8670d683f545788ce67b98931e8389'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:41.876248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-cc83e7ef-68ce-420d-bb4c-5554f4782537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc8670d683f545788ce67b98931e8389'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:41.887459 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 814/1648] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:05:41 2022] DELETE /identity/v3/users/bc8670d683f545788ce67b98931e8389 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:41.893745 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44567b3a-6ea6-411a-bdc8-7deacc5dfaa8 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:41.894362 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44567b3a-6ea6-411a-bdc8-7deacc5dfaa8 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:41.894850 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44567b3a-6ea6-411a-bdc8-7deacc5dfaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:41.915206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 835/1649] 10.222.0.73 () {58 vars in 1057 bytes} [Fri May 13 15:05:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:41.929583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e5bc5-0b55-4b41-b004-3cd0769d57aa None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:41.944195 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-44567b3a-6ea6-411a-bdc8-7deacc5dfaa8 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:41.949245 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e5bc5-0b55-4b41-b004-3cd0769d57aa None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:41.951344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-44567b3a-6ea6-411a-bdc8-7deacc5dfaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:42.108095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34797758-b424-441d-b8d4-ad49b4636733 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908d23b035f14756b438b3a61a63b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:42.108979 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34797758-b424-441d-b8d4-ad49b4636733 service placement] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:42.109408 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34797758-b424-441d-b8d4-ad49b4636733 service placement] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:42.109910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34797758-b424-441d-b8d4-ad49b4636733 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:42.113633 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 815/1650] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:05:42.117897 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-34797758-b424-441d-b8d4-ad49b4636733 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:42.136304 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44567b3a-6ea6-411a-bdc8-7deacc5dfaa8 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:42.137054 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34797758-b424-441d-b8d4-ad49b4636733 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:42.139015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34797758-b424-441d-b8d4-ad49b4636733 service placement] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:42.140443 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-44567b3a-6ea6-411a-bdc8-7deacc5dfaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:42.152520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 836/1651] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:05:42.220032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44567b3a-6ea6-411a-bdc8-7deacc5dfaa8 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:42.225165 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398cb9f8-092c-4e46-af99-f9c9d2f77b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:42.226081 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cb9f8-092c-4e46-af99-f9c9d2f77b3d service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:42.226562 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cb9f8-092c-4e46-af99-f9c9d2f77b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:42.227331 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cb9f8-092c-4e46-af99-f9c9d2f77b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:42.246051 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398cb9f8-092c-4e46-af99-f9c9d2f77b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:42.250246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398cb9f8-092c-4e46-af99-f9c9d2f77b3d service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:42.286234 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 816/1652] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:43.171252 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34797758-b424-441d-b8d4-ad49b4636733 service placement] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:43.172671 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-34797758-b424-441d-b8d4-ad49b4636733 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:43.223185 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34797758-b424-441d-b8d4-ad49b4636733 service placement] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:43.242240 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd81b9-e446-45ca-81f3-17a45f7c91d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:43.243199 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd81b9-e446-45ca-81f3-17a45f7c91d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:43.243489 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd81b9-e446-45ca-81f3-17a45f7c91d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:43.243759 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd81b9-e446-45ca-81f3-17a45f7c91d0 admin admin] PATH_INFO: `/v3/projects/65650abbf31f4ef8a10c264485b47be3` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:43.245097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd81b9-e446-45ca-81f3-17a45f7c91d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65650abbf31f4ef8a10c264485b47be3)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:43.248491 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd81b9-e446-45ca-81f3-17a45f7c91d0 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:43.437541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-73fd81b9-e446-45ca-81f3-17a45f7c91d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65650abbf31f4ef8a10c264485b47be3', 'request_id': 'req-73fd81b9-e446-45ca-81f3-17a45f7c91d0'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:43.455072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-73fd81b9-e446-45ca-81f3-17a45f7c91d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65650abbf31f4ef8a10c264485b47be3', 'request_id': 'req-73fd81b9-e446-45ca-81f3-17a45f7c91d0'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:43.479252 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-73fd81b9-e446-45ca-81f3-17a45f7c91d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65650abbf31f4ef8a10c264485b47be3', 'request_id': 'req-73fd81b9-e446-45ca-81f3-17a45f7c91d0'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:43.506249 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-73fd81b9-e446-45ca-81f3-17a45f7c91d0 admin admin] The token cache is being invalidate because project 65650abbf31f4ef8a10c264485b47be3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:05:43.506980 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-73fd81b9-e446-45ca-81f3-17a45f7c91d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:43.509698 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-73fd81b9-e446-45ca-81f3-17a45f7c91d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:43.523912 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 837/1653] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:05:43 2022] DELETE /identity/v3/projects/65650abbf31f4ef8a10c264485b47be3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:43.531763 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e79932-dce4-4102-ab7b-1296c0226574 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:43.534214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e79932-dce4-4102-ab7b-1296c0226574 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:43.535058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e79932-dce4-4102-ab7b-1296c0226574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:43.651224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-85e79932-dce4-4102-ab7b-1296c0226574 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:43.653009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-85e79932-dce4-4102-ab7b-1296c0226574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:43.796779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 817/1654] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:43.809559 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ecbdf-17ff-4dc0-ad64-8216109ce061 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:43.809761 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ecbdf-17ff-4dc0-ad64-8216109ce061 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:43.810033 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ecbdf-17ff-4dc0-ad64-8216109ce061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:43.853830 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-3f0ecbdf-17ff-4dc0-ad64-8216109ce061 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:43.856066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-3f0ecbdf-17ff-4dc0-ad64-8216109ce061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:43.927215 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e79932-dce4-4102-ab7b-1296c0226574 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:43.939245 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 838/1655] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:43.959836 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e79932-dce4-4102-ab7b-1296c0226574 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:43.988708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b57ee-c258-465e-ab46-707844fdab90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:43.990415 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b57ee-c258-465e-ab46-707844fdab90 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:43.990979 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b57ee-c258-465e-ab46-707844fdab90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:43.991577 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b57ee-c258-465e-ab46-707844fdab90 admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:43.992885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b57ee-c258-465e-ab46-707844fdab90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:05:43.996640 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b57ee-c258-465e-ab46-707844fdab90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:44.006947 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b57ee-c258-465e-ab46-707844fdab90 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:44.045338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 818/1656] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:05:44.049104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ecbdf-17ff-4dc0-ad64-8216109ce061 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:44.064189 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b57ee-c258-465e-ab46-707844fdab90 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:44.066781 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ecbdf-17ff-4dc0-ad64-8216109ce061 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:44.068133 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ed1b57ee-c258-465e-ab46-707844fdab90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:44.085815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d60a9-05d2-4cc6-8ea2-8f8747c89786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:44.087958 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d60a9-05d2-4cc6-8ea2-8f8747c89786 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:44.089781 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d60a9-05d2-4cc6-8ea2-8f8747c89786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:44.091740 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d60a9-05d2-4cc6-8ea2-8f8747c89786 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:44.092680 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d60a9-05d2-4cc6-8ea2-8f8747c89786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:44.097790 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d60a9-05d2-4cc6-8ea2-8f8747c89786 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:44.115485 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b57ee-c258-465e-ab46-707844fdab90 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:44.125430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb1012-78a9-4701-a122-718812d95f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:44.126558 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb1012-78a9-4701-a122-718812d95f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:44.127055 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb1012-78a9-4701-a122-718812d95f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:44.128796 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb1012-78a9-4701-a122-718812d95f28 admin admin] PATH_INFO: `/v3/projects/222187af9c754881b4b2fcf972877379` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:44.131088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb1012-78a9-4701-a122-718812d95f28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=222187af9c754881b4b2fcf972877379)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:44.135044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: WARNING py.warnings [None req-4efb1012-78a9-4701-a122-718812d95f28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 15:05:44.135044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: warnings.warn(msg) May 13 15:05:44.135044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: May 13 15:05:44.136659 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb1012-78a9-4701-a122-718812d95f28 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:44.161560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 839/1657] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:05:44 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:44.166409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d60a9-05d2-4cc6-8ea2-8f8747c89786 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:44.325848 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4efb1012-78a9-4701-a122-718812d95f28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '222187af9c754881b4b2fcf972877379', 'request_id': 'req-4efb1012-78a9-4701-a122-718812d95f28'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:44.365192 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d60a9-05d2-4cc6-8ea2-8f8747c89786 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:44.404897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4efb1012-78a9-4701-a122-718812d95f28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '222187af9c754881b4b2fcf972877379', 'request_id': 'req-4efb1012-78a9-4701-a122-718812d95f28'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:44.426017 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4efb1012-78a9-4701-a122-718812d95f28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '222187af9c754881b4b2fcf972877379', 'request_id': 'req-4efb1012-78a9-4701-a122-718812d95f28'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:44.459212 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4efb1012-78a9-4701-a122-718812d95f28 admin admin] The token cache is being invalidate because project 222187af9c754881b4b2fcf972877379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:05:44.461815 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4efb1012-78a9-4701-a122-718812d95f28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:44.463751 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4efb1012-78a9-4701-a122-718812d95f28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:44.467690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 819/1658] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:05:44 2022] DELETE /identity/v3/projects/222187af9c754881b4b2fcf972877379 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:44.473563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb1012-78a9-4701-a122-718812d95f28 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:44.476523 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-4efb1012-78a9-4701-a122-718812d95f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:44.580070 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a997ec-13ca-48d5-909b-ccfc6c957ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:44.587993 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a997ec-13ca-48d5-909b-ccfc6c957ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:44.588516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a997ec-13ca-48d5-909b-ccfc6c957ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:44.589027 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a997ec-13ca-48d5-909b-ccfc6c957ef1 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:44.590289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a997ec-13ca-48d5-909b-ccfc6c957ef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:44.597664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a997ec-13ca-48d5-909b-ccfc6c957ef1 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:44.673175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb1012-78a9-4701-a122-718812d95f28 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:44.682918 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84da167-0181-4ee1-acd3-2b11e523e2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:44.684023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84da167-0181-4ee1-acd3-2b11e523e2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:44.685221 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84da167-0181-4ee1-acd3-2b11e523e2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:44.685637 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84da167-0181-4ee1-acd3-2b11e523e2fa admin admin] PATH_INFO: `/v3/users/9fcc42e903204b3ab142a6d682bc8b4f` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:44.688426 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84da167-0181-4ee1-acd3-2b11e523e2fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fcc42e903204b3ab142a6d682bc8b4f)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:44.696568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 840/1659] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:05:44 2022] POST /identity/v3/users => generated 290 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:44.698753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a997ec-13ca-48d5-909b-ccfc6c957ef1 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:44.699248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84da167-0181-4ee1-acd3-2b11e523e2fa admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:44.709139 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-27a997ec-13ca-48d5-909b-ccfc6c957ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:44.751993 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a997ec-13ca-48d5-909b-ccfc6c957ef1 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:44.765322 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a36ec-38ad-4bda-8575-162a40d001f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:44.770447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a36ec-38ad-4bda-8575-162a40d001f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:44.771137 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a36ec-38ad-4bda-8575-162a40d001f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:44.771647 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a36ec-38ad-4bda-8575-162a40d001f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:44.774392 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a36ec-38ad-4bda-8575-162a40d001f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:44.776722 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a36ec-38ad-4bda-8575-162a40d001f0 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:44.795544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 841/1660] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:44.799181 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a36ec-38ad-4bda-8575-162a40d001f0 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:44.816862 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a36ec-38ad-4bda-8575-162a40d001f0 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:44.824308 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443793f-f6f1-4e4a-b716-bb86fc358ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:44.825428 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443793f-f6f1-4e4a-b716-bb86fc358ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:44.825854 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443793f-f6f1-4e4a-b716-bb86fc358ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:44.826139 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-a84da167-0181-4ee1-acd3-2b11e523e2fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fcc42e903204b3ab142a6d682bc8b4f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:44.826450 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443793f-f6f1-4e4a-b716-bb86fc358ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:44.827765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443793f-f6f1-4e4a-b716-bb86fc358ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:44.829841 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443793f-f6f1-4e4a-b716-bb86fc358ae1 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:44.842954 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-a84da167-0181-4ee1-acd3-2b11e523e2fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fcc42e903204b3ab142a6d682bc8b4f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:44.846956 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 842/1661] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:44.851029 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443793f-f6f1-4e4a-b716-bb86fc358ae1 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:44.864912 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443793f-f6f1-4e4a-b716-bb86fc358ae1 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:44.869234 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-a84da167-0181-4ee1-acd3-2b11e523e2fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fcc42e903204b3ab142a6d682bc8b4f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:44.870970 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-a84da167-0181-4ee1-acd3-2b11e523e2fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fcc42e903204b3ab142a6d682bc8b4f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:44.872683 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00c4aa-7d60-466a-9c60-7b01dcc0969c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:44.873824 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00c4aa-7d60-466a-9c60-7b01dcc0969c admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:44.874274 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00c4aa-7d60-466a-9c60-7b01dcc0969c admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:44.874710 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00c4aa-7d60-466a-9c60-7b01dcc0969c admin admin] PATH_INFO: `/v3/projects/b18d74013d9046839354b379b5dab1b8/users/4b33f6327c3f43c29e6bfd726740b869/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:44.902354 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-a84da167-0181-4ee1-acd3-2b11e523e2fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fcc42e903204b3ab142a6d682bc8b4f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:44.907510 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00c4aa-7d60-466a-9c60-7b01dcc0969c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b18d74013d9046839354b379b5dab1b8, user_id=4b33f6327c3f43c29e6bfd726740b869, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:44.910694 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 820/1662] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:05:44 2022] DELETE /identity/v3/users/9fcc42e903204b3ab142a6d682bc8b4f => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:44.912151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00c4aa-7d60-466a-9c60-7b01dcc0969c admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:44.954859 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 843/1663] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:05:44 2022] PUT /identity/v3/projects/b18d74013d9046839354b379b5dab1b8/users/4b33f6327c3f43c29e6bfd726740b869/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:05:44.969287 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220d4a4-5e08-47c8-a793-4390e53d788a None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:44.969675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220d4a4-5e08-47c8-a793-4390e53d788a None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:44.970106 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220d4a4-5e08-47c8-a793-4390e53d788a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:45.041902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-c220d4a4-5e08-47c8-a793-4390e53d788a None None] MFA Rules not processed for user `4b33f6327c3f43c29e6bfd726740b869`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:45.042094 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c220d4a4-5e08-47c8-a793-4390e53d788a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:45.193374 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 821/1664] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:45.195046 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00c4aa-7d60-466a-9c60-7b01dcc0969c admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:45.197817 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-2f00c4aa-7d60-466a-9c60-7b01dcc0969c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:45.462511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00c4aa-7d60-466a-9c60-7b01dcc0969c admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:45.483626 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0481e-0f57-4610-9f73-1ba8ce61cf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:45.486274 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0481e-0f57-4610-9f73-1ba8ce61cf70 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:45.492462 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0481e-0f57-4610-9f73-1ba8ce61cf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:45.495520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0481e-0f57-4610-9f73-1ba8ce61cf70 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:45.500795 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0481e-0f57-4610-9f73-1ba8ce61cf70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:45.512596 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0481e-0f57-4610-9f73-1ba8ce61cf70 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:45.593860 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 844/1665] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:05:45 2022] POST /identity/v3/projects => generated 381 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:45.598598 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220d4a4-5e08-47c8-a793-4390e53d788a None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:45.618629 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220d4a4-5e08-47c8-a793-4390e53d788a None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:45.798717 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04599089-555f-43dd-a0c3-0776fdf07a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:45.801835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04599089-555f-43dd-a0c3-0776fdf07a56 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:45.802152 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04599089-555f-43dd-a0c3-0776fdf07a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:45.819857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04599089-555f-43dd-a0c3-0776fdf07a56 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:45.822026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04599089-555f-43dd-a0c3-0776fdf07a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:45.829934 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04599089-555f-43dd-a0c3-0776fdf07a56 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:45.923999 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 822/1666] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:05:45 2022] POST /identity/v3/users => generated 297 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:45.928992 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0481e-0f57-4610-9f73-1ba8ce61cf70 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:46.003484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0481e-0f57-4610-9f73-1ba8ce61cf70 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:46.030042 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5a31b-d56d-48ae-8503-287fe1496c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:46.031821 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5a31b-d56d-48ae-8503-287fe1496c7d admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:46.032459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5a31b-d56d-48ae-8503-287fe1496c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:46.040768 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5a31b-d56d-48ae-8503-287fe1496c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:46.042028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5a31b-d56d-48ae-8503-287fe1496c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:46.045924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5a31b-d56d-48ae-8503-287fe1496c7d admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:46.119523 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 845/1667] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:46.121682 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04599089-555f-43dd-a0c3-0776fdf07a56 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:46.207093 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04599089-555f-43dd-a0c3-0776fdf07a56 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:46.244945 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54efd3-a590-40f1-addb-8538ba4a2ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:46.249135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54efd3-a590-40f1-addb-8538ba4a2ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:46.252155 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54efd3-a590-40f1-addb-8538ba4a2ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:46.253358 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54efd3-a590-40f1-addb-8538ba4a2ec0 admin admin] PATH_INFO: `/v3/projects/cf55b4edbb104e8088d38f813b3455b6/users/a0a9f51bbac84f7a973bf5ad77a3454b/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:46.361917 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54efd3-a590-40f1-addb-8538ba4a2ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf55b4edbb104e8088d38f813b3455b6, user_id=a0a9f51bbac84f7a973bf5ad77a3454b, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:46.362156 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5a31b-d56d-48ae-8503-287fe1496c7d admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:46.365110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-3aa5a31b-d56d-48ae-8503-287fe1496c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:46.415924 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54efd3-a590-40f1-addb-8538ba4a2ec0 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:46.453673 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 823/1668] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:05:46 2022] PUT /identity/v3/projects/cf55b4edbb104e8088d38f813b3455b6/users/a0a9f51bbac84f7a973bf5ad77a3454b/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:46.458035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54efd3-a590-40f1-addb-8538ba4a2ec0 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:46.473441 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5a31b-d56d-48ae-8503-287fe1496c7d admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:46.623290 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54efd3-a590-40f1-addb-8538ba4a2ec0 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:46.639113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21665c1b-ab76-4a03-ac4b-f2d86ac5b67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:46.640199 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21665c1b-ab76-4a03-ac4b-f2d86ac5b67c admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:46.640502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21665c1b-ab76-4a03-ac4b-f2d86ac5b67c admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:46.640776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21665c1b-ab76-4a03-ac4b-f2d86ac5b67c admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:46.641523 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21665c1b-ab76-4a03-ac4b-f2d86ac5b67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:46.643231 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21665c1b-ab76-4a03-ac4b-f2d86ac5b67c admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:46.665422 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f66b6-cf28-4e4f-aa5b-a7f7827c636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:46.667036 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f66b6-cf28-4e4f-aa5b-a7f7827c636f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:46.667812 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f66b6-cf28-4e4f-aa5b-a7f7827c636f admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:46.668504 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f66b6-cf28-4e4f-aa5b-a7f7827c636f admin admin] PATH_INFO: `/v3/projects/1d9d1e93bd8b423fa9a05c3dae5f0caa` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:46.671880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f66b6-cf28-4e4f-aa5b-a7f7827c636f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d9d1e93bd8b423fa9a05c3dae5f0caa)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:46.676074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f66b6-cf28-4e4f-aa5b-a7f7827c636f admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:46.679685 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 824/1669] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:05:46.686012 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21665c1b-ab76-4a03-ac4b-f2d86ac5b67c admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:46.713244 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21665c1b-ab76-4a03-ac4b-f2d86ac5b67c admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:46.721179 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f09e4-00e2-477a-8bd3-920e123404a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:46.722139 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f09e4-00e2-477a-8bd3-920e123404a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:46.722426 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f09e4-00e2-477a-8bd3-920e123404a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:46.722690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f09e4-00e2-477a-8bd3-920e123404a8 admin admin] PATH_INFO: `/v3/projects/cf55b4edbb104e8088d38f813b3455b6/users/a0a9f51bbac84f7a973bf5ad77a3454b/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:46.724882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f09e4-00e2-477a-8bd3-920e123404a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf55b4edbb104e8088d38f813b3455b6, user_id=a0a9f51bbac84f7a973bf5ad77a3454b, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:46.727652 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f09e4-00e2-477a-8bd3-920e123404a8 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:46.740015 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 825/1670] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:05:46 2022] PUT /identity/v3/projects/cf55b4edbb104e8088d38f813b3455b6/users/a0a9f51bbac84f7a973bf5ad77a3454b/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:46.751018 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde29255-f58b-4d2b-be89-4601dff5499f None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:46.751898 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde29255-f58b-4d2b-be89-4601dff5499f None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:46.752467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde29255-f58b-4d2b-be89-4601dff5499f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:46.797428 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-cde29255-f58b-4d2b-be89-4601dff5499f None None] MFA Rules not processed for user `a0a9f51bbac84f7a973bf5ad77a3454b`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:46.799131 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-cde29255-f58b-4d2b-be89-4601dff5499f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:46.839871 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-de9f66b6-cf28-4e4f-aa5b-a7f7827c636f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d9d1e93bd8b423fa9a05c3dae5f0caa', 'request_id': 'req-de9f66b6-cf28-4e4f-aa5b-a7f7827c636f'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:46.870043 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-de9f66b6-cf28-4e4f-aa5b-a7f7827c636f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d9d1e93bd8b423fa9a05c3dae5f0caa', 'request_id': 'req-de9f66b6-cf28-4e4f-aa5b-a7f7827c636f'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:46.891862 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-de9f66b6-cf28-4e4f-aa5b-a7f7827c636f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d9d1e93bd8b423fa9a05c3dae5f0caa', 'request_id': 'req-de9f66b6-cf28-4e4f-aa5b-a7f7827c636f'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:46.924633 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 826/1671] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:05:46.939023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde29255-f58b-4d2b-be89-4601dff5499f None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:46.940605 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-cde29255-f58b-4d2b-be89-4601dff5499f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:46.957969 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-de9f66b6-cf28-4e4f-aa5b-a7f7827c636f admin admin] The token cache is being invalidate because project 1d9d1e93bd8b423fa9a05c3dae5f0caa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:05:46.958497 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-de9f66b6-cf28-4e4f-aa5b-a7f7827c636f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:46.965415 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-de9f66b6-cf28-4e4f-aa5b-a7f7827c636f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:46.977220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 846/1672] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:05:46 2022] DELETE /identity/v3/projects/1d9d1e93bd8b423fa9a05c3dae5f0caa => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:46.987692 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f404b-e783-4f60-8be0-db79f5baa21d None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:46.988190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f404b-e783-4f60-8be0-db79f5baa21d None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:46.988707 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f404b-e783-4f60-8be0-db79f5baa21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:47.042455 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde29255-f58b-4d2b-be89-4601dff5499f None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:47.047911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de522ff-c288-45f3-9a7b-3ed53fd75391 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:47.049160 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de522ff-c288-45f3-9a7b-3ed53fd75391 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:47.049547 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de522ff-c288-45f3-9a7b-3ed53fd75391 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:47.049902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de522ff-c288-45f3-9a7b-3ed53fd75391 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:47.054274 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-7de522ff-c288-45f3-9a7b-3ed53fd75391 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:47.076905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-3a3f404b-e783-4f60-8be0-db79f5baa21d None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:47.079738 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-3a3f404b-e783-4f60-8be0-db79f5baa21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:47.086043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de522ff-c288-45f3-9a7b-3ed53fd75391 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:47.088336 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de522ff-c288-45f3-9a7b-3ed53fd75391 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:47.110233 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 827/1673] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:05:47.257234 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de522ff-c288-45f3-9a7b-3ed53fd75391 service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:47.263373 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-7de522ff-c288-45f3-9a7b-3ed53fd75391 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:47.291253 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de522ff-c288-45f3-9a7b-3ed53fd75391 service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:47.302629 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505eacc2-1a61-4e13-8633-d936280104f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:47.303732 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505eacc2-1a61-4e13-8633-d936280104f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:47.304274 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505eacc2-1a61-4e13-8633-d936280104f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:47.304728 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505eacc2-1a61-4e13-8633-d936280104f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:47.312078 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-505eacc2-1a61-4e13-8633-d936280104f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:47.325765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 847/1674] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:47.328816 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d1d0e-428f-4c81-98ad-e6909bfac62f None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:47.329414 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d1d0e-428f-4c81-98ad-e6909bfac62f None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:47.330002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d1d0e-428f-4c81-98ad-e6909bfac62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:47.367957 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-732d1d0e-428f-4c81-98ad-e6909bfac62f None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:47.370519 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-732d1d0e-428f-4c81-98ad-e6909bfac62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:47.385890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 848/1675] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:47.394488 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d1d0e-428f-4c81-98ad-e6909bfac62f None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:47.468806 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d1d0e-428f-4c81-98ad-e6909bfac62f None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:47.487580 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d0d27-31ac-42f7-8e29-dc3d7d84aa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:47.488545 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d0d27-31ac-42f7-8e29-dc3d7d84aa93 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:47.489336 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d0d27-31ac-42f7-8e29-dc3d7d84aa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:47.489920 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d0d27-31ac-42f7-8e29-dc3d7d84aa93 admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:47.491341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d0d27-31ac-42f7-8e29-dc3d7d84aa93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:05:47.492009 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d0d27-31ac-42f7-8e29-dc3d7d84aa93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:47.495355 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d0d27-31ac-42f7-8e29-dc3d7d84aa93 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:47.517507 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 849/1676] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:05:47.524890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d0d27-31ac-42f7-8e29-dc3d7d84aa93 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:47.580731 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d0d27-31ac-42f7-8e29-dc3d7d84aa93 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:47.594111 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505eacc2-1a61-4e13-8633-d936280104f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:47.610382 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505eacc2-1a61-4e13-8633-d936280104f7 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:47.611042 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d88123-2364-40d7-b95b-db21c58f69b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:47.612401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d88123-2364-40d7-b95b-db21c58f69b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:47.612901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d88123-2364-40d7-b95b-db21c58f69b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:47.613383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d88123-2364-40d7-b95b-db21c58f69b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:47.614689 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d88123-2364-40d7-b95b-db21c58f69b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:47.626961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d88123-2364-40d7-b95b-db21c58f69b0 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:47.677969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 828/1677] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:05:47.807298 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 850/1678] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:05:47 2022] POST /identity/v3/projects => generated 375 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:47.812584 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505eacc2-1a61-4e13-8633-d936280104f7 service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:47.861503 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505eacc2-1a61-4e13-8633-d936280104f7 service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:48.049606 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e024221-8f1d-49b7-94fe-c863339bdb4c None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:48.050081 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e024221-8f1d-49b7-94fe-c863339bdb4c None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:48.050443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e024221-8f1d-49b7-94fe-c863339bdb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:48.143626 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ed72e-7d3d-47d5-8e0c-23134c8a8b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:48.144292 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ed72e-7d3d-47d5-8e0c-23134c8a8b8a admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:48.144645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ed72e-7d3d-47d5-8e0c-23134c8a8b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:48.144945 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ed72e-7d3d-47d5-8e0c-23134c8a8b8a admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:48.146061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ed72e-7d3d-47d5-8e0c-23134c8a8b8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:48.164401 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ed72e-7d3d-47d5-8e0c-23134c8a8b8a admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:48.192105 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-1e024221-8f1d-49b7-94fe-c863339bdb4c None None] MFA Rules not processed for user `477e3c3f65f6407c9c7a932c9650334d`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:48.196483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-1e024221-8f1d-49b7-94fe-c863339bdb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:48.212504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 829/1679] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:05:47 2022] POST /identity/v3/users => generated 288 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:48.216390 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ed72e-7d3d-47d5-8e0c-23134c8a8b8a admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:48.245316 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ed72e-7d3d-47d5-8e0c-23134c8a8b8a admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:48.260001 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b2f92-033e-4c98-a552-794b98121a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:48.263013 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b2f92-033e-4c98-a552-794b98121a67 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:48.263402 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b2f92-033e-4c98-a552-794b98121a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:48.263820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b2f92-033e-4c98-a552-794b98121a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:48.266341 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b2f92-033e-4c98-a552-794b98121a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:48.272951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b2f92-033e-4c98-a552-794b98121a67 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:48.303197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 830/1680] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:05:48.310528 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b2f92-033e-4c98-a552-794b98121a67 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:48.343499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b2f92-033e-4c98-a552-794b98121a67 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:48.363861 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba871af-4b30-44ec-9121-7fad72616119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:48.364639 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba871af-4b30-44ec-9121-7fad72616119 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:48.367155 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba871af-4b30-44ec-9121-7fad72616119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:48.368767 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba871af-4b30-44ec-9121-7fad72616119 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:48.371192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba871af-4b30-44ec-9121-7fad72616119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:48.376012 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba871af-4b30-44ec-9121-7fad72616119 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:48.394162 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 831/1681] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:48.395901 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37726b-040c-41e3-b097-ada3b070693f None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:48.396368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37726b-040c-41e3-b097-ada3b070693f None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:48.396957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37726b-040c-41e3-b097-ada3b070693f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:48.414062 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 851/1682] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:48.415086 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e024221-8f1d-49b7-94fe-c863339bdb4c None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:48.441672 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e024221-8f1d-49b7-94fe-c863339bdb4c None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:48.452387 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-4a37726b-040c-41e3-b097-ada3b070693f None None] MFA Rules not processed for user `c1627da761c74fc79523a0fa319176b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:48.454331 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-4a37726b-040c-41e3-b097-ada3b070693f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:48.464444 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ab06d-0bf0-4ea6-bcd1-e1d6bd6ac158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:48.466726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ab06d-0bf0-4ea6-bcd1-e1d6bd6ac158 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:48.467029 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ab06d-0bf0-4ea6-bcd1-e1d6bd6ac158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:48.467314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ab06d-0bf0-4ea6-bcd1-e1d6bd6ac158 admin admin] PATH_INFO: `/v3/projects/03ee484d6a4b45d0bdcd1a459204c9e9/users/ca2250687b8b4d0a82059423f9af7ed0/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:48.509061 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ab06d-0bf0-4ea6-bcd1-e1d6bd6ac158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ee484d6a4b45d0bdcd1a459204c9e9, user_id=ca2250687b8b4d0a82059423f9af7ed0, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:48.514394 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ab06d-0bf0-4ea6-bcd1-e1d6bd6ac158 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:48.551741 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 852/1683] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:05:48 2022] PUT /identity/v3/projects/03ee484d6a4b45d0bdcd1a459204c9e9/users/ca2250687b8b4d0a82059423f9af7ed0/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:48.553296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ab06d-0bf0-4ea6-bcd1-e1d6bd6ac158 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:48.566465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-187ab06d-0bf0-4ea6-bcd1-e1d6bd6ac158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:48.624660 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 832/1684] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:48.627815 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14861257-18a8-4cb3-aef5-081ce9cd41ab None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:48.628745 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14861257-18a8-4cb3-aef5-081ce9cd41ab None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:48.629252 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14861257-18a8-4cb3-aef5-081ce9cd41ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:48.666167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-14861257-18a8-4cb3-aef5-081ce9cd41ab None None] MFA Rules not processed for user `ca2250687b8b4d0a82059423f9af7ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:48.667495 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-14861257-18a8-4cb3-aef5-081ce9cd41ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:48.690962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ab06d-0bf0-4ea6-bcd1-e1d6bd6ac158 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:48.700042 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b7007-1b52-421f-900b-8862727b715b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:48.701293 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b7007-1b52-421f-900b-8862727b715b service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:48.701809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b7007-1b52-421f-900b-8862727b715b service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:48.702072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b7007-1b52-421f-900b-8862727b715b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:48.818328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b7007-1b52-421f-900b-8862727b715b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:48.821269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b7007-1b52-421f-900b-8862727b715b service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:48.848297 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 853/1685] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:48.850459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c457ba6-2f5b-465b-b20e-a5d23aa9d3f9 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:48.851018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c457ba6-2f5b-465b-b20e-a5d23aa9d3f9 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:48.852306 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c457ba6-2f5b-465b-b20e-a5d23aa9d3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:48.911009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 833/1686] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:48.912794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14861257-18a8-4cb3-aef5-081ce9cd41ab None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:48.926268 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-8c457ba6-2f5b-465b-b20e-a5d23aa9d3f9 None None] MFA Rules not processed for user `c1627da761c74fc79523a0fa319176b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:48.939082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-8c457ba6-2f5b-465b-b20e-a5d23aa9d3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:49.039254 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14861257-18a8-4cb3-aef5-081ce9cd41ab None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:49.056324 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62836c0-8cd8-4e83-96da-e015b87116a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:49.057158 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62836c0-8cd8-4e83-96da-e015b87116a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:49.057606 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62836c0-8cd8-4e83-96da-e015b87116a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:49.057986 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62836c0-8cd8-4e83-96da-e015b87116a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:49.058981 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62836c0-8cd8-4e83-96da-e015b87116a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:49.061713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62836c0-8cd8-4e83-96da-e015b87116a6 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:49.183807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 854/1687] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:49.221311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c457ba6-2f5b-465b-b20e-a5d23aa9d3f9 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:49.249095 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 834/1688] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:05:48 2022] POST /identity/v3/projects => generated 375 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:49.253892 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62836c0-8cd8-4e83-96da-e015b87116a6 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:49.302589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c457ba6-2f5b-465b-b20e-a5d23aa9d3f9 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:49.581617 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75974ae5-44bf-4ed1-aded-a11e268bc353 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:49.584908 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75974ae5-44bf-4ed1-aded-a11e268bc353 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:49.585253 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75974ae5-44bf-4ed1-aded-a11e268bc353 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:49.585533 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75974ae5-44bf-4ed1-aded-a11e268bc353 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:49.653256 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62836c0-8cd8-4e83-96da-e015b87116a6 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:49.681711 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c35c68-6207-424c-8208-2a14edafb1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:49.699018 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c35c68-6207-424c-8208-2a14edafb1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:49.699601 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c35c68-6207-424c-8208-2a14edafb1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:49.700516 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c35c68-6207-424c-8208-2a14edafb1a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:49.705134 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c35c68-6207-424c-8208-2a14edafb1a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:49.723884 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c35c68-6207-424c-8208-2a14edafb1a8 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:49.786930 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 835/1689] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:05:49 2022] POST /identity/v3/users => generated 294 bytes in 537 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:49.792124 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c35c68-6207-424c-8208-2a14edafb1a8 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:49.826049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75974ae5-44bf-4ed1-aded-a11e268bc353 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:49.827729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75974ae5-44bf-4ed1-aded-a11e268bc353 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:49.837756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c35c68-6207-424c-8208-2a14edafb1a8 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:49.854604 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 855/1690] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:49.876474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37910b9c-e6f1-4e42-9431-b55197011278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:49.877191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37910b9c-e6f1-4e42-9431-b55197011278 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:49.877479 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37910b9c-e6f1-4e42-9431-b55197011278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:49.877792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37910b9c-e6f1-4e42-9431-b55197011278 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:49.878908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37910b9c-e6f1-4e42-9431-b55197011278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:49.897543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37910b9c-e6f1-4e42-9431-b55197011278 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:49.938068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75974ae5-44bf-4ed1-aded-a11e268bc353 service nova] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:49.938578 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 836/1691] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:49.955331 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75974ae5-44bf-4ed1-aded-a11e268bc353 service nova] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:49.981766 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26aaa0-eef2-4747-ba93-4d2abdd5a38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:49.982698 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26aaa0-eef2-4747-ba93-4d2abdd5a38b admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:49.983007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26aaa0-eef2-4747-ba93-4d2abdd5a38b admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:49.983281 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26aaa0-eef2-4747-ba93-4d2abdd5a38b admin admin] PATH_INFO: `/v3/projects/f9f670a4b97c483eacc9990e4cb882a9/users/079ced9e791049c496f1482003a3410c/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:49.997640 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37910b9c-e6f1-4e42-9431-b55197011278 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:49.999633 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-37910b9c-e6f1-4e42-9431-b55197011278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:50.049680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37910b9c-e6f1-4e42-9431-b55197011278 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:50.072706 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26aaa0-eef2-4747-ba93-4d2abdd5a38b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f670a4b97c483eacc9990e4cb882a9, user_id=079ced9e791049c496f1482003a3410c, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:50.080940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26aaa0-eef2-4747-ba93-4d2abdd5a38b admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:50.081621 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a52a5-3bfe-452c-afdf-9d4433063d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:50.082718 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a52a5-3bfe-452c-afdf-9d4433063d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:50.085378 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a52a5-3bfe-452c-afdf-9d4433063d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:50.085808 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a52a5-3bfe-452c-afdf-9d4433063d5f admin admin] PATH_INFO: `/v3/users/80566f337d344d3d82de74690546ffe4` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:50.091458 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a52a5-3bfe-452c-afdf-9d4433063d5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=80566f337d344d3d82de74690546ffe4)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:50.097039 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a52a5-3bfe-452c-afdf-9d4433063d5f admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:50.131230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 856/1692] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:05:49 2022] PUT /identity/v3/projects/f9f670a4b97c483eacc9990e4cb882a9/users/079ced9e791049c496f1482003a3410c/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:50.136663 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26aaa0-eef2-4747-ba93-4d2abdd5a38b admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:50.274742 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e64a52a5-3bfe-452c-afdf-9d4433063d5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80566f337d344d3d82de74690546ffe4'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:50.290476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e64a52a5-3bfe-452c-afdf-9d4433063d5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80566f337d344d3d82de74690546ffe4'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:50.338470 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26aaa0-eef2-4747-ba93-4d2abdd5a38b admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:50.339664 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e64a52a5-3bfe-452c-afdf-9d4433063d5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80566f337d344d3d82de74690546ffe4'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:50.340631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e64a52a5-3bfe-452c-afdf-9d4433063d5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80566f337d344d3d82de74690546ffe4'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:50.357070 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12f8fa-6b50-4247-87e5-08d764eb478f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:50.357785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12f8fa-6b50-4247-87e5-08d764eb478f admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:50.358070 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12f8fa-6b50-4247-87e5-08d764eb478f admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:50.358350 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12f8fa-6b50-4247-87e5-08d764eb478f admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:50.359355 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12f8fa-6b50-4247-87e5-08d764eb478f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:50.360998 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12f8fa-6b50-4247-87e5-08d764eb478f admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:50.389476 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 857/1693] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:50.390804 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12f8fa-6b50-4247-87e5-08d764eb478f admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:50.391191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e64a52a5-3bfe-452c-afdf-9d4433063d5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80566f337d344d3d82de74690546ffe4'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:50.394933 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-4d12f8fa-6b50-4247-87e5-08d764eb478f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:50.411265 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 837/1694] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:05:49 2022] DELETE /identity/v3/users/80566f337d344d3d82de74690546ffe4 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:05:50.413082 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195948bf-3b4b-403c-8cb2-badfc3819a10 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:50.417158 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195948bf-3b4b-403c-8cb2-badfc3819a10 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:50.417865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195948bf-3b4b-403c-8cb2-badfc3819a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:50.429645 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12f8fa-6b50-4247-87e5-08d764eb478f admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:50.457194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-195948bf-3b4b-403c-8cb2-badfc3819a10 None None] MFA Rules not processed for user `0c04f5fb770d49c0a50f2cfbd77e17e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:50.460469 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-195948bf-3b4b-403c-8cb2-badfc3819a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:50.662049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6ed40-3c15-49c6-8043-1eaed4dcf98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:50.663001 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6ed40-3c15-49c6-8043-1eaed4dcf98a admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:50.663286 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6ed40-3c15-49c6-8043-1eaed4dcf98a admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:50.663566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6ed40-3c15-49c6-8043-1eaed4dcf98a admin admin] PATH_INFO: `/v3/projects/f9f670a4b97c483eacc9990e4cb882a9/users/079ced9e791049c496f1482003a3410c/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:50.667941 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6ed40-3c15-49c6-8043-1eaed4dcf98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f670a4b97c483eacc9990e4cb882a9, user_id=079ced9e791049c496f1482003a3410c, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:50.671305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6ed40-3c15-49c6-8043-1eaed4dcf98a admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:50.677632 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 838/1695] 10.222.0.73 () {58 vars in 1009 bytes} [Fri May 13 15:05:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:50.679042 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab0f8f-5c5a-44b7-a193-736d30b24f9f None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:50.679336 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab0f8f-5c5a-44b7-a193-736d30b24f9f None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:50.679619 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab0f8f-5c5a-44b7-a193-736d30b24f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:50.725424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 858/1696] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:05:50 2022] PUT /identity/v3/projects/f9f670a4b97c483eacc9990e4cb882a9/users/079ced9e791049c496f1482003a3410c/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:50.730454 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd4ff9-970f-4010-ba94-e7bd1e7f9c66 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:50.731029 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd4ff9-970f-4010-ba94-e7bd1e7f9c66 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:50.735055 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd4ff9-970f-4010-ba94-e7bd1e7f9c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:50.750122 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-51ab0f8f-5c5a-44b7-a193-736d30b24f9f None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:50.752863 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-51ab0f8f-5c5a-44b7-a193-736d30b24f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:50.833237 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-e1bd4ff9-970f-4010-ba94-e7bd1e7f9c66 None None] MFA Rules not processed for user `079ced9e791049c496f1482003a3410c`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:50.836701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e1bd4ff9-970f-4010-ba94-e7bd1e7f9c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:50.919235 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 839/1697] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:50.991479 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab0f8f-5c5a-44b7-a193-736d30b24f9f None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:50.993984 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-51ab0f8f-5c5a-44b7-a193-736d30b24f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:51.065647 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 859/1698] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:51.071382 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd4ff9-970f-4010-ba94-e7bd1e7f9c66 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:51.084277 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e1bd4ff9-970f-4010-ba94-e7bd1e7f9c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:51.149842 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab0f8f-5c5a-44b7-a193-736d30b24f9f None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:51.154973 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca49d8-5301-4836-bc57-4b3a210c112f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:51.156004 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca49d8-5301-4836-bc57-4b3a210c112f service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:51.156431 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca49d8-5301-4836-bc57-4b3a210c112f service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:51.156847 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca49d8-5301-4836-bc57-4b3a210c112f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:51.189947 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca49d8-5301-4836-bc57-4b3a210c112f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:51.191701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca49d8-5301-4836-bc57-4b3a210c112f service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:51.213397 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 840/1699] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:05:51.214617 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca49d8-5301-4836-bc57-4b3a210c112f service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:51.218323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-1dca49d8-5301-4836-bc57-4b3a210c112f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:51.320214 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd4ff9-970f-4010-ba94-e7bd1e7f9c66 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:51.343820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa255f-d67b-4170-90b2-6871ae9a8f39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27265a0c2e6b47c09f28b9cd3ac47d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:51.344545 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa255f-d67b-4170-90b2-6871ae9a8f39 service swift] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:51.344822 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa255f-d67b-4170-90b2-6871ae9a8f39 service swift] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:51.345198 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa255f-d67b-4170-90b2-6871ae9a8f39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:51.435405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca49d8-5301-4836-bc57-4b3a210c112f service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:51.454783 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08255e7-3c6c-4626-b131-7150640e4331 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:51.455554 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08255e7-3c6c-4626-b131-7150640e4331 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:51.457218 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08255e7-3c6c-4626-b131-7150640e4331 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:51.457456 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08255e7-3c6c-4626-b131-7150640e4331 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:51.461820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-d08255e7-3c6c-4626-b131-7150640e4331 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:51.584652 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa255f-d67b-4170-90b2-6871ae9a8f39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:51.586285 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa255f-d67b-4170-90b2-6871ae9a8f39 service swift] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:51.648465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 860/1700] 10.222.0.73 () {60 vars in 1384 bytes} [Fri May 13 15:05:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 15:05:51.653634 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08255e7-3c6c-4626-b131-7150640e4331 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:51.655170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08255e7-3c6c-4626-b131-7150640e4331 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:51.656727 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401de89-1eff-48d0-8216-e8171b74ea84 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:51.661563 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401de89-1eff-48d0-8216-e8171b74ea84 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:51.663541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401de89-1eff-48d0-8216-e8171b74ea84 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:51.678249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 841/1701] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:51.687397 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 861/1702] 10.222.0.73 () {54 vars in 912 bytes} [Fri May 13 15:05:51 2022] GET /identity => generated 270 bytes in 38 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 15:05:51.704054 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8424ae-4bef-427b-9cbc-c237cfecb799 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:51.704344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8424ae-4bef-427b-9cbc-c237cfecb799 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:51.704620 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8424ae-4bef-427b-9cbc-c237cfecb799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:51.745828 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-1d8424ae-4bef-427b-9cbc-c237cfecb799 None None] MFA Rules not processed for user `ee97a542470644f89cd665dfdf2f9e92`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:51.748109 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-1d8424ae-4bef-427b-9cbc-c237cfecb799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:51.776681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 842/1703] 10.222.0.73 () {58 vars in 1009 bytes} [Fri May 13 15:05:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:51.861072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401de89-1eff-48d0-8216-e8171b74ea84 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:51.897844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401de89-1eff-48d0-8216-e8171b74ea84 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:51.927822 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773dcd7-beba-4127-bcf6-16fa0dd4812c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:51.928518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773dcd7-beba-4127-bcf6-16fa0dd4812c service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:51.928947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773dcd7-beba-4127-bcf6-16fa0dd4812c service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:51.929227 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773dcd7-beba-4127-bcf6-16fa0dd4812c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:51.972513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773dcd7-beba-4127-bcf6-16fa0dd4812c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:51.974348 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773dcd7-beba-4127-bcf6-16fa0dd4812c service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:52.012673 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 862/1704] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:05:52.624088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8424ae-4bef-427b-9cbc-c237cfecb799 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:52.626207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-1d8424ae-4bef-427b-9cbc-c237cfecb799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:52.679109 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8424ae-4bef-427b-9cbc-c237cfecb799 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:52.724174 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67bda0-187e-49c6-8784-d4eccbd56564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:52.725861 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67bda0-187e-49c6-8784-d4eccbd56564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:52.734162 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67bda0-187e-49c6-8784-d4eccbd56564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:52.734532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67bda0-187e-49c6-8784-d4eccbd56564 admin admin] PATH_INFO: `/v3/projects/bd7ca86cff8c4cea8ae70494f6d2e297` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:52.744479 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67bda0-187e-49c6-8784-d4eccbd56564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd7ca86cff8c4cea8ae70494f6d2e297)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:52.744479 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67bda0-187e-49c6-8784-d4eccbd56564 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:52.993283 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ad67bda0-187e-49c6-8784-d4eccbd56564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7ca86cff8c4cea8ae70494f6d2e297', 'request_id': 'req-ad67bda0-187e-49c6-8784-d4eccbd56564'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:53.003736 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ad67bda0-187e-49c6-8784-d4eccbd56564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7ca86cff8c4cea8ae70494f6d2e297', 'request_id': 'req-ad67bda0-187e-49c6-8784-d4eccbd56564'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:53.023279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ad67bda0-187e-49c6-8784-d4eccbd56564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7ca86cff8c4cea8ae70494f6d2e297', 'request_id': 'req-ad67bda0-187e-49c6-8784-d4eccbd56564'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:53.080589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ad67bda0-187e-49c6-8784-d4eccbd56564 admin admin] The token cache is being invalidate because project bd7ca86cff8c4cea8ae70494f6d2e297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:05:53.083398 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ad67bda0-187e-49c6-8784-d4eccbd56564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:53.085194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ad67bda0-187e-49c6-8784-d4eccbd56564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:53.092783 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 843/1705] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:05:52 2022] DELETE /identity/v3/projects/bd7ca86cff8c4cea8ae70494f6d2e297 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:53.099298 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f4f44-1717-4995-b7c7-ce649e943e63 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:53.101235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f4f44-1717-4995-b7c7-ce649e943e63 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:53.101675 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f4f44-1717-4995-b7c7-ce649e943e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:53.153762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-bd0f4f44-1717-4995-b7c7-ce649e943e63 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:53.158917 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-bd0f4f44-1717-4995-b7c7-ce649e943e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:53.364607 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 863/1706] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:53.375582 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a8450-efe4-40dd-8a80-54e5bd0cafb3 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:53.376113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a8450-efe4-40dd-8a80-54e5bd0cafb3 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:53.376533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a8450-efe4-40dd-8a80-54e5bd0cafb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:53.473125 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-227a8450-efe4-40dd-8a80-54e5bd0cafb3 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:53.477512 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-227a8450-efe4-40dd-8a80-54e5bd0cafb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:53.547712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 844/1707] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:53.551402 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f4f44-1717-4995-b7c7-ce649e943e63 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:53.564352 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f4f44-1717-4995-b7c7-ce649e943e63 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:53.578251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b10899-e15f-4aef-887d-acaf48a32253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:53.580495 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b10899-e15f-4aef-887d-acaf48a32253 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:53.581990 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b10899-e15f-4aef-887d-acaf48a32253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:53.583312 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b10899-e15f-4aef-887d-acaf48a32253 admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:53.586295 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b10899-e15f-4aef-887d-acaf48a32253 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:05:53.587787 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b10899-e15f-4aef-887d-acaf48a32253 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:53.590688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b10899-e15f-4aef-887d-acaf48a32253 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:53.631870 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 864/1708] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:05:53.633680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a8450-efe4-40dd-8a80-54e5bd0cafb3 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:53.651731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a8450-efe4-40dd-8a80-54e5bd0cafb3 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:53.662033 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee923574-9301-4f69-9dd4-081b53f41420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:53.663057 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee923574-9301-4f69-9dd4-081b53f41420 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:53.663712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee923574-9301-4f69-9dd4-081b53f41420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:53.664341 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee923574-9301-4f69-9dd4-081b53f41420 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:53.665545 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee923574-9301-4f69-9dd4-081b53f41420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:53.672390 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee923574-9301-4f69-9dd4-081b53f41420 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:53.694785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b10899-e15f-4aef-887d-acaf48a32253 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:53.698947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-c8b10899-e15f-4aef-887d-acaf48a32253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:53.755156 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b10899-e15f-4aef-887d-acaf48a32253 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:53.784580 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc7797-d247-4911-891c-47e600a13637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:53.788057 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc7797-d247-4911-891c-47e600a13637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:53.789699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc7797-d247-4911-891c-47e600a13637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:53.790303 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc7797-d247-4911-891c-47e600a13637 admin admin] PATH_INFO: `/v3/users/21c6ac7db0044888a42c9182ea676878` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:53.801176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc7797-d247-4911-891c-47e600a13637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21c6ac7db0044888a42c9182ea676878)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:53.804017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: WARNING py.warnings [None req-d7bc7797-d247-4911-891c-47e600a13637 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 15:05:53.804017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: warnings.warn(msg) May 13 15:05:53.804017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: May 13 15:05:53.814254 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc7797-d247-4911-891c-47e600a13637 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:53.817015 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 845/1709] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:05:53 2022] POST /identity/v3/projects => generated 403 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:05:53.820056 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee923574-9301-4f69-9dd4-081b53f41420 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:54.101442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d7bc7797-d247-4911-891c-47e600a13637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21c6ac7db0044888a42c9182ea676878'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:54.122642 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee923574-9301-4f69-9dd4-081b53f41420 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:54.155876 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c7a71-693d-4c88-9398-bde2f10945e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:54.156715 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c7a71-693d-4c88-9398-bde2f10945e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:54.157001 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c7a71-693d-4c88-9398-bde2f10945e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:54.157278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c7a71-693d-4c88-9398-bde2f10945e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:54.160576 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c7a71-693d-4c88-9398-bde2f10945e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:54.177866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c7a71-693d-4c88-9398-bde2f10945e5 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:54.206969 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d7bc7797-d247-4911-891c-47e600a13637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21c6ac7db0044888a42c9182ea676878'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:54.210537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d7bc7797-d247-4911-891c-47e600a13637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21c6ac7db0044888a42c9182ea676878'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:54.212304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d7bc7797-d247-4911-891c-47e600a13637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21c6ac7db0044888a42c9182ea676878'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:54.248455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d7bc7797-d247-4911-891c-47e600a13637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21c6ac7db0044888a42c9182ea676878'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:54.282112 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 846/1710] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:05:53 2022] POST /identity/v3/users => generated 302 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:54.284697 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a9859-9b25-4044-8399-45f8002abb43 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:54.287180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a9859-9b25-4044-8399-45f8002abb43 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:54.287710 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a9859-9b25-4044-8399-45f8002abb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:54.295758 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 865/1711] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:05:53 2022] DELETE /identity/v3/users/21c6ac7db0044888a42c9182ea676878 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:54.295758 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc7797-d247-4911-891c-47e600a13637 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:54.298465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-d7bc7797-d247-4911-891c-47e600a13637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:54.412687 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-ed1a9859-9b25-4044-8399-45f8002abb43 None None] MFA Rules not processed for user `c1627da761c74fc79523a0fa319176b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:54.417835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ed1a9859-9b25-4044-8399-45f8002abb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:54.641163 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 847/1712] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:54.646426 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5071f3f-8b9f-43cf-94cb-93f0be87b4d0 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:54.648992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5071f3f-8b9f-43cf-94cb-93f0be87b4d0 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:54.649648 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5071f3f-8b9f-43cf-94cb-93f0be87b4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:54.655543 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc7797-d247-4911-891c-47e600a13637 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:54.686231 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaeec92-a271-435f-bdd6-8cd81c742976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:54.688624 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaeec92-a271-435f-bdd6-8cd81c742976 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:54.691755 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaeec92-a271-435f-bdd6-8cd81c742976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:54.692270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaeec92-a271-435f-bdd6-8cd81c742976 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:54.693402 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaeec92-a271-435f-bdd6-8cd81c742976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:54.696708 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaeec92-a271-435f-bdd6-8cd81c742976 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:54.768949 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-e5071f3f-8b9f-43cf-94cb-93f0be87b4d0 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:54.770190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-e5071f3f-8b9f-43cf-94cb-93f0be87b4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:54.796922 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 866/1713] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 504 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:54.806998 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaeec92-a271-435f-bdd6-8cd81c742976 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:54.827465 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 848/1714] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:54.845832 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaeec92-a271-435f-bdd6-8cd81c742976 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:54.854383 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5071f3f-8b9f-43cf-94cb-93f0be87b4d0 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:54.857156 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-e5071f3f-8b9f-43cf-94cb-93f0be87b4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:54.867698 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f75547-960d-4c7b-8e4a-117e4a76a5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:54.869818 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f75547-960d-4c7b-8e4a-117e4a76a5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:54.871914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f75547-960d-4c7b-8e4a-117e4a76a5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:54.872211 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f75547-960d-4c7b-8e4a-117e4a76a5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:54.875965 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f75547-960d-4c7b-8e4a-117e4a76a5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:54.879926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f75547-960d-4c7b-8e4a-117e4a76a5c5 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:54.914707 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 867/1715] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:54.919753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f75547-960d-4c7b-8e4a-117e4a76a5c5 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:54.940145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f75547-960d-4c7b-8e4a-117e4a76a5c5 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:54.959671 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c27f71-b7c9-4253-8137-757ddff74bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:54.960995 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c27f71-b7c9-4253-8137-757ddff74bc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:54.962352 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c27f71-b7c9-4253-8137-757ddff74bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:54.963533 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c27f71-b7c9-4253-8137-757ddff74bc7 admin admin] PATH_INFO: `/v3/projects/1ca2ee4158f442ae8cd51e430d8e032c/users/b73c15bdc89e4f21894940e164a9605a/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:54.998389 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c27f71-b7c9-4253-8137-757ddff74bc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ca2ee4158f442ae8cd51e430d8e032c, user_id=b73c15bdc89e4f21894940e164a9605a, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:55.003406 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c27f71-b7c9-4253-8137-757ddff74bc7 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:55.058384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 868/1716] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:05:54 2022] PUT /identity/v3/projects/1ca2ee4158f442ae8cd51e430d8e032c/users/b73c15bdc89e4f21894940e164a9605a/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:55.064636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5071f3f-8b9f-43cf-94cb-93f0be87b4d0 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:55.071953 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697e3e0-6339-4368-b280-abe065eb3cc2 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:55.072246 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697e3e0-6339-4368-b280-abe065eb3cc2 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:55.072532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697e3e0-6339-4368-b280-abe065eb3cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:55.164984 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-c697e3e0-6339-4368-b280-abe065eb3cc2 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:55.166267 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-c697e3e0-6339-4368-b280-abe065eb3cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:55.341582 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2fde1-c3d7-4a65-a7bb-47e2a5013ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:55.344141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2fde1-c3d7-4a65-a7bb-47e2a5013ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:55.344513 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2fde1-c3d7-4a65-a7bb-47e2a5013ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:55.345371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2fde1-c3d7-4a65-a7bb-47e2a5013ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:55.397156 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 869/1717] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:55.444618 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697e3e0-6339-4368-b280-abe065eb3cc2 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:55.462570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697e3e0-6339-4368-b280-abe065eb3cc2 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:55.477927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654b985-9b87-4374-9e69-6b9d9c620e1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:55.478933 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654b985-9b87-4374-9e69-6b9d9c620e1e service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:55.479218 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654b985-9b87-4374-9e69-6b9d9c620e1e service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:55.479667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654b985-9b87-4374-9e69-6b9d9c620e1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:55.520187 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654b985-9b87-4374-9e69-6b9d9c620e1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:55.525002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654b985-9b87-4374-9e69-6b9d9c620e1e service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:55.564340 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 870/1718] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:05:55.595004 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2fde1-c3d7-4a65-a7bb-47e2a5013ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:55.597867 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2fde1-c3d7-4a65-a7bb-47e2a5013ea4 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:55.633186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 849/1719] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 780 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:56.356473 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae91eea-908f-4e0a-ae6b-dc5c2185137f None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:56.357061 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae91eea-908f-4e0a-ae6b-dc5c2185137f None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:56.357061 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae91eea-908f-4e0a-ae6b-dc5c2185137f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:56.412937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-1ae91eea-908f-4e0a-ae6b-dc5c2185137f None None] MFA Rules not processed for user `477e3c3f65f6407c9c7a932c9650334d`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:56.414576 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-1ae91eea-908f-4e0a-ae6b-dc5c2185137f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:56.560839 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 871/1720] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:57.080801 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2fde1-c3d7-4a65-a7bb-47e2a5013ea4 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:57.082983 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-41f2fde1-c3d7-4a65-a7bb-47e2a5013ea4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:57.122721 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2fde1-c3d7-4a65-a7bb-47e2a5013ea4 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:57.136680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec681c33-2720-4ff8-b872-c64c6de188a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:57.137622 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec681c33-2720-4ff8-b872-c64c6de188a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:57.137921 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec681c33-2720-4ff8-b872-c64c6de188a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:57.138256 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec681c33-2720-4ff8-b872-c64c6de188a1 admin admin] PATH_INFO: `/v3/projects/6b311c72bd364ab6b8097d0f92f08c01` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:57.142729 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec681c33-2720-4ff8-b872-c64c6de188a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b311c72bd364ab6b8097d0f92f08c01)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:57.147929 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec681c33-2720-4ff8-b872-c64c6de188a1 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:57.264344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ec681c33-2720-4ff8-b872-c64c6de188a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b311c72bd364ab6b8097d0f92f08c01', 'request_id': 'req-ec681c33-2720-4ff8-b872-c64c6de188a1'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:57.277084 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ec681c33-2720-4ff8-b872-c64c6de188a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b311c72bd364ab6b8097d0f92f08c01', 'request_id': 'req-ec681c33-2720-4ff8-b872-c64c6de188a1'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:57.285726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ec681c33-2720-4ff8-b872-c64c6de188a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b311c72bd364ab6b8097d0f92f08c01', 'request_id': 'req-ec681c33-2720-4ff8-b872-c64c6de188a1'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:57.357435 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ec681c33-2720-4ff8-b872-c64c6de188a1 admin admin] The token cache is being invalidate because project 6b311c72bd364ab6b8097d0f92f08c01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:05:57.357746 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ec681c33-2720-4ff8-b872-c64c6de188a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:57.368875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ec681c33-2720-4ff8-b872-c64c6de188a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:05:57.378519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 850/1721] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:05:57 2022] DELETE /identity/v3/projects/6b311c72bd364ab6b8097d0f92f08c01 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:57.383186 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8f3bd-aa34-46c3-b6df-9c39a4812af0 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:57.383993 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8f3bd-aa34-46c3-b6df-9c39a4812af0 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:57.383993 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8f3bd-aa34-46c3-b6df-9c39a4812af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:57.427570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336bf68-ba62-4e20-8033-620379a0b492 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:57.427570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336bf68-ba62-4e20-8033-620379a0b492 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:57.427570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336bf68-ba62-4e20-8033-620379a0b492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:57.484416 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-b336bf68-ba62-4e20-8033-620379a0b492 None None] MFA Rules not processed for user `ee97a542470644f89cd665dfdf2f9e92`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:57.484915 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-8eb8f3bd-aa34-46c3-b6df-9c39a4812af0 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:57.486193 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-8eb8f3bd-aa34-46c3-b6df-9c39a4812af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:57.491466 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-b336bf68-ba62-4e20-8033-620379a0b492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:57.703387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 872/1722] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:57.719789 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e426bc-99d1-4b34-aba7-e7ee86f65494 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:57.720240 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e426bc-99d1-4b34-aba7-e7ee86f65494 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:57.720674 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e426bc-99d1-4b34-aba7-e7ee86f65494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:57.794215 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 851/1723] 10.222.0.109 () {58 vars in 1016 bytes} [Fri May 13 15:05:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:05:57.808691 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-a5e426bc-99d1-4b34-aba7-e7ee86f65494 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:57.814403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a5e426bc-99d1-4b34-aba7-e7ee86f65494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:57.863475 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 873/1724] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:57.868829 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336bf68-ba62-4e20-8033-620379a0b492 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:57.892757 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336bf68-ba62-4e20-8033-620379a0b492 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:57.919149 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91c32c-3297-4fc8-906e-abb090ad896b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:57.920378 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91c32c-3297-4fc8-906e-abb090ad896b admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:57.927291 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91c32c-3297-4fc8-906e-abb090ad896b admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:57.927752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91c32c-3297-4fc8-906e-abb090ad896b admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:57.928716 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91c32c-3297-4fc8-906e-abb090ad896b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:05:57.930139 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91c32c-3297-4fc8-906e-abb090ad896b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:57.932910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91c32c-3297-4fc8-906e-abb090ad896b admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:57.985466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e426bc-99d1-4b34-aba7-e7ee86f65494 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:57.987520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a5e426bc-99d1-4b34-aba7-e7ee86f65494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:57.996264 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 852/1725] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:05:57.997729 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91c32c-3297-4fc8-906e-abb090ad896b admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:58.045707 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e426bc-99d1-4b34-aba7-e7ee86f65494 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:58.075433 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e404571-ab82-473d-ab37-9b3f0a2e4705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:58.076616 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e404571-ab82-473d-ab37-9b3f0a2e4705 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:58.077107 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e404571-ab82-473d-ab37-9b3f0a2e4705 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:58.077610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e404571-ab82-473d-ab37-9b3f0a2e4705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:58.083469 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91c32c-3297-4fc8-906e-abb090ad896b admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:58.112139 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39693afc-c83e-499b-8679-968e1a956f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:58.113468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39693afc-c83e-499b-8679-968e1a956f2f admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:58.113936 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39693afc-c83e-499b-8679-968e1a956f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:58.115445 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39693afc-c83e-499b-8679-968e1a956f2f admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:58.118767 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39693afc-c83e-499b-8679-968e1a956f2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:58.124416 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e404571-ab82-473d-ab37-9b3f0a2e4705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:58.127730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e404571-ab82-473d-ab37-9b3f0a2e4705 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:58.128664 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39693afc-c83e-499b-8679-968e1a956f2f admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:58.187515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 874/1726] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:05:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:05:58.210678 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e404571-ab82-473d-ab37-9b3f0a2e4705 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:58.216092 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 853/1727] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:05:57 2022] POST /identity/v3/projects => generated 389 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:58.252089 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e404571-ab82-473d-ab37-9b3f0a2e4705 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:58.618418 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bca795-f41f-4c87-bd0c-fbfaa0e05e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:58.619763 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bca795-f41f-4c87-bd0c-fbfaa0e05e2d admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:58.620023 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bca795-f41f-4c87-bd0c-fbfaa0e05e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:58.628462 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bca795-f41f-4c87-bd0c-fbfaa0e05e2d admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:58.633349 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bca795-f41f-4c87-bd0c-fbfaa0e05e2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:58.642696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bca795-f41f-4c87-bd0c-fbfaa0e05e2d admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:58.746111 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 875/1728] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:05:58 2022] POST /identity/v3/users => generated 295 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:05:58.750280 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39693afc-c83e-499b-8679-968e1a956f2f admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:58.765982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39693afc-c83e-499b-8679-968e1a956f2f admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:58.777234 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285c806-b8e3-46bc-abb8-2cf3b5159948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:58.778872 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285c806-b8e3-46bc-abb8-2cf3b5159948 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:58.779590 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285c806-b8e3-46bc-abb8-2cf3b5159948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:58.780065 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285c806-b8e3-46bc-abb8-2cf3b5159948 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:58.781233 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285c806-b8e3-46bc-abb8-2cf3b5159948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:58.783366 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285c806-b8e3-46bc-abb8-2cf3b5159948 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:58.840229 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bca795-f41f-4c87-bd0c-fbfaa0e05e2d admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:58.842097 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 854/1729] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:58.892177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bca795-f41f-4c87-bd0c-fbfaa0e05e2d admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:58.909369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200df29-ea60-4c6f-8e5d-40a63ff27c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:58.915073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200df29-ea60-4c6f-8e5d-40a63ff27c57 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:58.915416 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200df29-ea60-4c6f-8e5d-40a63ff27c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:58.915717 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200df29-ea60-4c6f-8e5d-40a63ff27c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:58.920488 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0200df29-ea60-4c6f-8e5d-40a63ff27c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:58.928028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0200df29-ea60-4c6f-8e5d-40a63ff27c57 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:58.997593 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 876/1730] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:05:59.002379 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285c806-b8e3-46bc-abb8-2cf3b5159948 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:05:59.020817 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285c806-b8e3-46bc-abb8-2cf3b5159948 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:05:59.073846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ecbd5-e664-4178-814f-b7d5cb522f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:05:59.080222 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ecbd5-e664-4178-814f-b7d5cb522f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:59.085646 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ecbd5-e664-4178-814f-b7d5cb522f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:59.087299 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ecbd5-e664-4178-814f-b7d5cb522f22 admin admin] PATH_INFO: `/v3/projects/6cf1aad6db654a3ab26bf43984883d19/users/8d14f9cd39fe4855929216354f8b0afb/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:59.177995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ecbd5-e664-4178-814f-b7d5cb522f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf1aad6db654a3ab26bf43984883d19, user_id=8d14f9cd39fe4855929216354f8b0afb, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:05:59.186142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ecbd5-e664-4178-814f-b7d5cb522f22 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:05:59.234457 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 855/1731] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:05:59 2022] PUT /identity/v3/projects/6cf1aad6db654a3ab26bf43984883d19/users/8d14f9cd39fe4855929216354f8b0afb/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:05:59.251778 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c39b7-3715-43cc-805c-c7b05b2e2a76 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:05:59.252351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c39b7-3715-43cc-805c-c7b05b2e2a76 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:05:59.253115 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c39b7-3715-43cc-805c-c7b05b2e2a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:05:59.518774 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-280c39b7-3715-43cc-805c-c7b05b2e2a76 None None] MFA Rules not processed for user `8d14f9cd39fe4855929216354f8b0afb`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:05:59.521384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-280c39b7-3715-43cc-805c-c7b05b2e2a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:05:59.833750 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 877/1732] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:05:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 585 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:05:59.835392 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ecbd5-e664-4178-814f-b7d5cb522f22 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:00.038061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ecbd5-e664-4178-814f-b7d5cb522f22 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:00.053614 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e348d-8cc3-472f-984d-2544d6fcc25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:00.054302 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e348d-8cc3-472f-984d-2544d6fcc25a admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:00.067950 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e348d-8cc3-472f-984d-2544d6fcc25a admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:00.068658 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e348d-8cc3-472f-984d-2544d6fcc25a admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:00.070672 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e348d-8cc3-472f-984d-2544d6fcc25a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:00.094996 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e348d-8cc3-472f-984d-2544d6fcc25a admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:00.161679 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 856/1733] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:05:59 2022] POST /identity/v3/projects => generated 389 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:00.169731 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c39b7-3715-43cc-805c-c7b05b2e2a76 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:00.192148 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c39b7-3715-43cc-805c-c7b05b2e2a76 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:00.415242 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a934fdb-644a-4672-b57b-fea6e033f222 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:00.415991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a934fdb-644a-4672-b57b-fea6e033f222 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:00.417601 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a934fdb-644a-4672-b57b-fea6e033f222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:00.459387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8056daa-0962-4c3d-9970-a00b3441bb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:00.460267 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8056daa-0962-4c3d-9970-a00b3441bb77 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:00.460654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8056daa-0962-4c3d-9970-a00b3441bb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:00.461057 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8056daa-0962-4c3d-9970-a00b3441bb77 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:00.461941 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8056daa-0962-4c3d-9970-a00b3441bb77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:00.468211 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8056daa-0962-4c3d-9970-a00b3441bb77 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:00.486969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-7a934fdb-644a-4672-b57b-fea6e033f222 None None] MFA Rules not processed for user `b73c15bdc89e4f21894940e164a9605a`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:00.489085 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-7a934fdb-644a-4672-b57b-fea6e033f222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:00.513334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 878/1734] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:00 2022] POST /identity/v3/users => generated 301 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:00.517107 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8056daa-0962-4c3d-9970-a00b3441bb77 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:00.530571 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8056daa-0962-4c3d-9970-a00b3441bb77 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:00.536710 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1b2fb-5422-49d6-8e38-668d694b9acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:00.537281 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1b2fb-5422-49d6-8e38-668d694b9acd admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:00.537555 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1b2fb-5422-49d6-8e38-668d694b9acd admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:00.537998 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1b2fb-5422-49d6-8e38-668d694b9acd admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:00.539096 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1b2fb-5422-49d6-8e38-668d694b9acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:00.540904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1b2fb-5422-49d6-8e38-668d694b9acd admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:00.558217 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 879/1735] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:06:00.560485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1b2fb-5422-49d6-8e38-668d694b9acd admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:00.583116 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1b2fb-5422-49d6-8e38-668d694b9acd admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:00.592213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8c753-e5c6-4fae-89e8-0db1ce70f017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:00.594276 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8c753-e5c6-4fae-89e8-0db1ce70f017 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:00.595033 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8c753-e5c6-4fae-89e8-0db1ce70f017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:00.595828 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8c753-e5c6-4fae-89e8-0db1ce70f017 admin admin] PATH_INFO: `/v3/projects/93c64627eaf24d12a779bd8ebfdb7072/users/5de5706b8f6e49708ab380a380fcbdb1/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:00.635614 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8c753-e5c6-4fae-89e8-0db1ce70f017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c64627eaf24d12a779bd8ebfdb7072, user_id=5de5706b8f6e49708ab380a380fcbdb1, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:00.642292 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8c753-e5c6-4fae-89e8-0db1ce70f017 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:00.682661 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 880/1736] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:00 2022] PUT /identity/v3/projects/93c64627eaf24d12a779bd8ebfdb7072/users/5de5706b8f6e49708ab380a380fcbdb1/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:00.685136 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8c753-e5c6-4fae-89e8-0db1ce70f017 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:00.695572 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 857/1737] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:00.697707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a934fdb-644a-4672-b57b-fea6e033f222 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:00.702931 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-7a934fdb-644a-4672-b57b-fea6e033f222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:00.745593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a934fdb-644a-4672-b57b-fea6e033f222 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:00.871936 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8c753-e5c6-4fae-89e8-0db1ce70f017 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:00.899856 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5f679-01bc-46c4-b7c0-114bf5cdf038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:00.900870 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5f679-01bc-46c4-b7c0-114bf5cdf038 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:00.901311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5f679-01bc-46c4-b7c0-114bf5cdf038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:00.901862 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5f679-01bc-46c4-b7c0-114bf5cdf038 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:00.902811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5f679-01bc-46c4-b7c0-114bf5cdf038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:00.910957 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5f679-01bc-46c4-b7c0-114bf5cdf038 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:00.934494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 881/1738] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:00.941478 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5f679-01bc-46c4-b7c0-114bf5cdf038 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:00.977571 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f41243-e117-47ff-b776-c561df89b870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:00.978517 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f41243-e117-47ff-b776-c561df89b870 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:00.985361 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f41243-e117-47ff-b776-c561df89b870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:00.986553 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f41243-e117-47ff-b776-c561df89b870 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:00.988098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5f679-01bc-46c4-b7c0-114bf5cdf038 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:00.988322 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f41243-e117-47ff-b776-c561df89b870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:00.992757 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f41243-e117-47ff-b776-c561df89b870 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:01.020925 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f2070-2c74-42a0-98df-676e92932620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:01.023554 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f2070-2c74-42a0-98df-676e92932620 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:01.024528 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f2070-2c74-42a0-98df-676e92932620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:01.025279 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f2070-2c74-42a0-98df-676e92932620 admin admin] PATH_INFO: `/v3/projects/93c64627eaf24d12a779bd8ebfdb7072/users/5de5706b8f6e49708ab380a380fcbdb1/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:01.032899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f2070-2c74-42a0-98df-676e92932620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c64627eaf24d12a779bd8ebfdb7072, user_id=5de5706b8f6e49708ab380a380fcbdb1, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:01.039267 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f2070-2c74-42a0-98df-676e92932620 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:01.083571 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 882/1739] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:00 2022] PUT /identity/v3/projects/93c64627eaf24d12a779bd8ebfdb7072/users/5de5706b8f6e49708ab380a380fcbdb1/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:01.085527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814512e0-856b-4fb0-99c3-374b165662fb None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:01.085839 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814512e0-856b-4fb0-99c3-374b165662fb None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:01.086092 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814512e0-856b-4fb0-99c3-374b165662fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:01.089552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 858/1740] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:00 2022] POST /identity/v3/projects => generated 403 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:01.097135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f41243-e117-47ff-b776-c561df89b870 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:01.130371 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-814512e0-856b-4fb0-99c3-374b165662fb None None] MFA Rules not processed for user `5de5706b8f6e49708ab380a380fcbdb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:01.131863 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-814512e0-856b-4fb0-99c3-374b165662fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:01.272502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f41243-e117-47ff-b776-c561df89b870 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:01.283808 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb61800-6853-44d1-a290-7469e7a12fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:01.285292 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb61800-6853-44d1-a290-7469e7a12fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:01.285838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb61800-6853-44d1-a290-7469e7a12fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:01.286615 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb61800-6853-44d1-a290-7469e7a12fa5 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:01.287991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb61800-6853-44d1-a290-7469e7a12fa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:01.293622 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb61800-6853-44d1-a290-7469e7a12fa5 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:01.342232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 883/1741] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:01.356710 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814512e0-856b-4fb0-99c3-374b165662fb None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:01.357461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 859/1742] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:01 2022] POST /identity/v3/users => generated 308 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:01.376198 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814512e0-856b-4fb0-99c3-374b165662fb None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:01.392314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934759cd-08c7-4d97-9e5b-2691ce4c0f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:01.393218 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934759cd-08c7-4d97-9e5b-2691ce4c0f98 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:01.393573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934759cd-08c7-4d97-9e5b-2691ce4c0f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:01.393765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934759cd-08c7-4d97-9e5b-2691ce4c0f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:01.394698 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934759cd-08c7-4d97-9e5b-2691ce4c0f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:01.397442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934759cd-08c7-4d97-9e5b-2691ce4c0f98 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:01.432861 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 884/1743] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:01.442266 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb61800-6853-44d1-a290-7469e7a12fa5 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:01.478220 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb61800-6853-44d1-a290-7469e7a12fa5 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:01.490874 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934759cd-08c7-4d97-9e5b-2691ce4c0f98 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:01.494519 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-934759cd-08c7-4d97-9e5b-2691ce4c0f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:01.495020 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e539a-37c6-4593-84fb-2aadc91bf04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:01.496790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e539a-37c6-4593-84fb-2aadc91bf04a admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:01.497245 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e539a-37c6-4593-84fb-2aadc91bf04a admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:01.497769 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e539a-37c6-4593-84fb-2aadc91bf04a admin admin] PATH_INFO: `/v3/projects/a27b60ab2db74e6a9c0a0c3a7ed6ce6d/users/0516ac14d89746dc9f750bb409f33570/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:01.519456 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e539a-37c6-4593-84fb-2aadc91bf04a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27b60ab2db74e6a9c0a0c3a7ed6ce6d, user_id=0516ac14d89746dc9f750bb409f33570, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:01.522645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e539a-37c6-4593-84fb-2aadc91bf04a admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:01.542579 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 860/1744] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:01 2022] PUT /identity/v3/projects/a27b60ab2db74e6a9c0a0c3a7ed6ce6d/users/0516ac14d89746dc9f750bb409f33570/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:01.544820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5c7b9-a5df-41fc-8bde-90a0d363836a None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:01.545239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5c7b9-a5df-41fc-8bde-90a0d363836a None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:01.545519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5c7b9-a5df-41fc-8bde-90a0d363836a None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:01.548213 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 861/1745] 10.222.0.73 () {54 vars in 921 bytes} [Fri May 13 15:06:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 15:06:01.549086 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5c7b9-a5df-41fc-8bde-90a0d363836a None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:01.654792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5c7b9-a5df-41fc-8bde-90a0d363836a None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:01.671272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed9059-e8d4-4d86-b0ee-bac1c2562a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:01.673959 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed9059-e8d4-4d86-b0ee-bac1c2562a98 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:01.674485 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed9059-e8d4-4d86-b0ee-bac1c2562a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:01.674865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed9059-e8d4-4d86-b0ee-bac1c2562a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:01.676206 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed9059-e8d4-4d86-b0ee-bac1c2562a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:01.680774 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed9059-e8d4-4d86-b0ee-bac1c2562a98 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:01.717982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 862/1746] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:01.722909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a569c84-bf2a-49e8-b9b0-c0551596800c None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:01.724561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a569c84-bf2a-49e8-b9b0-c0551596800c None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:01.724937 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a569c84-bf2a-49e8-b9b0-c0551596800c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:01.729997 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934759cd-08c7-4d97-9e5b-2691ce4c0f98 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:01.744947 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-9a569c84-bf2a-49e8-b9b0-c0551596800c None None] MFA Rules not processed for user `52d539202cfb40a48b231713e16a599a`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:01.746263 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-9a569c84-bf2a-49e8-b9b0-c0551596800c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:01.798556 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a61990-0dfa-4370-834f-7ba93f6e545a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:01.799512 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a61990-0dfa-4370-834f-7ba93f6e545a service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:01.799951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a61990-0dfa-4370-834f-7ba93f6e545a service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:01.800457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a61990-0dfa-4370-834f-7ba93f6e545a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:01.836814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 863/1747] 10.222.0.73 () {58 vars in 1018 bytes} [Fri May 13 15:06:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:01.838016 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a569c84-bf2a-49e8-b9b0-c0551596800c None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:01.854780 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a569c84-bf2a-49e8-b9b0-c0551596800c None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:01.861737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd87f7d-4730-4d19-9507-ba84f1949033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:01.863213 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd87f7d-4730-4d19-9507-ba84f1949033 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:01.863673 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd87f7d-4730-4d19-9507-ba84f1949033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:01.864129 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd87f7d-4730-4d19-9507-ba84f1949033 admin admin] PATH_INFO: `/v3/projects/a27b60ab2db74e6a9c0a0c3a7ed6ce6d/users/0516ac14d89746dc9f750bb409f33570/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:01.867130 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd87f7d-4730-4d19-9507-ba84f1949033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27b60ab2db74e6a9c0a0c3a7ed6ce6d, user_id=0516ac14d89746dc9f750bb409f33570, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:01.871793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd87f7d-4730-4d19-9507-ba84f1949033 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:01.888709 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 864/1748] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:01 2022] PUT /identity/v3/projects/a27b60ab2db74e6a9c0a0c3a7ed6ce6d/users/0516ac14d89746dc9f750bb409f33570/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:01.890080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd87f7d-4730-4d19-9507-ba84f1949033 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:01.894712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-8bd87f7d-4730-4d19-9507-ba84f1949033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:01.911325 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a61990-0dfa-4370-834f-7ba93f6e545a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:01.913894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a61990-0dfa-4370-834f-7ba93f6e545a service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:01.941958 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 885/1749] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:02.053114 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd87f7d-4730-4d19-9507-ba84f1949033 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:02.063885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3b5d3-478f-4392-8614-02b528af586c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:02.065135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3b5d3-478f-4392-8614-02b528af586c service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:02.065730 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3b5d3-478f-4392-8614-02b528af586c service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:02.066313 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3b5d3-478f-4392-8614-02b528af586c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:02.086587 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3b5d3-478f-4392-8614-02b528af586c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:02.090283 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3b5d3-478f-4392-8614-02b528af586c service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:02.138259 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 865/1750] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:02.198848 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a61990-0dfa-4370-834f-7ba93f6e545a service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:02.225832 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a61990-0dfa-4370-834f-7ba93f6e545a service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:02.310855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9c943-2b37-49e8-9b9b-41358006216c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:02.312041 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9c943-2b37-49e8-9b9b-41358006216c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:02.312316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9c943-2b37-49e8-9b9b-41358006216c admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:02.312587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9c943-2b37-49e8-9b9b-41358006216c admin admin] PATH_INFO: `/v3/users/8d14f9cd39fe4855929216354f8b0afb` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:02.313823 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9c943-2b37-49e8-9b9b-41358006216c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d14f9cd39fe4855929216354f8b0afb)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:02.315823 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9c943-2b37-49e8-9b9b-41358006216c admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:02.379057 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-8dd9c943-2b37-49e8-9b9b-41358006216c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d14f9cd39fe4855929216354f8b0afb'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:02.397827 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-8dd9c943-2b37-49e8-9b9b-41358006216c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d14f9cd39fe4855929216354f8b0afb'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:02.398972 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-8dd9c943-2b37-49e8-9b9b-41358006216c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d14f9cd39fe4855929216354f8b0afb'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:02.399426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-8dd9c943-2b37-49e8-9b9b-41358006216c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d14f9cd39fe4855929216354f8b0afb'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:02.413868 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-8dd9c943-2b37-49e8-9b9b-41358006216c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d14f9cd39fe4855929216354f8b0afb'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:02.443696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 886/1751] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:02 2022] DELETE /identity/v3/users/8d14f9cd39fe4855929216354f8b0afb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:02.446056 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaf423-dfa3-4315-b9a5-a474a9fe1b82 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:02.446350 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaf423-dfa3-4315-b9a5-a474a9fe1b82 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:02.446633 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaf423-dfa3-4315-b9a5-a474a9fe1b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:02.465545 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-7dcaf423-dfa3-4315-b9a5-a474a9fe1b82 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:02.466851 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-7dcaf423-dfa3-4315-b9a5-a474a9fe1b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:02.535886 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 866/1752] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:02.556197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9c943-2b37-49e8-9b9b-41358006216c admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:02.559429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-8dd9c943-2b37-49e8-9b9b-41358006216c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:02.673956 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9c943-2b37-49e8-9b9b-41358006216c admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:02.681031 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfc16a-8539-4079-84d0-358d83c0e886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:02.682272 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfc16a-8539-4079-84d0-358d83c0e886 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:02.682770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfc16a-8539-4079-84d0-358d83c0e886 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:02.683290 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfc16a-8539-4079-84d0-358d83c0e886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:02.696995 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfc16a-8539-4079-84d0-358d83c0e886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:02.698473 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfc16a-8539-4079-84d0-358d83c0e886 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:02.710236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 887/1753] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:06:02.941585 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11011a3-533a-4663-a36d-958ec96f640e None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:02.941873 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11011a3-533a-4663-a36d-958ec96f640e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:02.942401 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11011a3-533a-4663-a36d-958ec96f640e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:03.005077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-b11011a3-533a-4663-a36d-958ec96f640e None None] MFA Rules not processed for user `0516ac14d89746dc9f750bb409f33570`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:03.006604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-b11011a3-533a-4663-a36d-958ec96f640e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:03.119103 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 867/1754] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:02 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:03.275597 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfc16a-8539-4079-84d0-358d83c0e886 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:03.278853 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-fddfc16a-8539-4079-84d0-358d83c0e886 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:03.326939 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfc16a-8539-4079-84d0-358d83c0e886 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:03.335291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b66c2f-a8d9-44b6-acd1-13f8447c37a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:03.337914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b66c2f-a8d9-44b6-acd1-13f8447c37a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:03.338204 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b66c2f-a8d9-44b6-acd1-13f8447c37a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:03.338528 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b66c2f-a8d9-44b6-acd1-13f8447c37a3 admin admin] PATH_INFO: `/v3/projects/6cf1aad6db654a3ab26bf43984883d19` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:03.342079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b66c2f-a8d9-44b6-acd1-13f8447c37a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf1aad6db654a3ab26bf43984883d19)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:03.346474 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b66c2f-a8d9-44b6-acd1-13f8447c37a3 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:03.421075 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-15b66c2f-a8d9-44b6-acd1-13f8447c37a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf1aad6db654a3ab26bf43984883d19', 'request_id': 'req-15b66c2f-a8d9-44b6-acd1-13f8447c37a3'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:03.433816 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-15b66c2f-a8d9-44b6-acd1-13f8447c37a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf1aad6db654a3ab26bf43984883d19', 'request_id': 'req-15b66c2f-a8d9-44b6-acd1-13f8447c37a3'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:03.443892 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-15b66c2f-a8d9-44b6-acd1-13f8447c37a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf1aad6db654a3ab26bf43984883d19', 'request_id': 'req-15b66c2f-a8d9-44b6-acd1-13f8447c37a3'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:03.461617 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-15b66c2f-a8d9-44b6-acd1-13f8447c37a3 admin admin] The token cache is being invalidate because project 6cf1aad6db654a3ab26bf43984883d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:03.462141 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-15b66c2f-a8d9-44b6-acd1-13f8447c37a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:03.463303 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-15b66c2f-a8d9-44b6-acd1-13f8447c37a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:03.466403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 888/1755] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:03 2022] DELETE /identity/v3/projects/6cf1aad6db654a3ab26bf43984883d19 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:03.472058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11011a3-533a-4663-a36d-958ec96f640e None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:03.493529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11011a3-533a-4663-a36d-958ec96f640e None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:03.564114 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce59470-0aa4-452c-b696-164ca9522ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:03.565014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce59470-0aa4-452c-b696-164ca9522ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:03.565297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce59470-0aa4-452c-b696-164ca9522ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:03.565575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce59470-0aa4-452c-b696-164ca9522ce8 admin admin] PATH_INFO: `/v3/users/5de5706b8f6e49708ab380a380fcbdb1` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:03.566866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce59470-0aa4-452c-b696-164ca9522ce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de5706b8f6e49708ab380a380fcbdb1)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:03.569177 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce59470-0aa4-452c-b696-164ca9522ce8 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:03.656063 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6ce59470-0aa4-452c-b696-164ca9522ce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de5706b8f6e49708ab380a380fcbdb1'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:03.680768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6ce59470-0aa4-452c-b696-164ca9522ce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de5706b8f6e49708ab380a380fcbdb1'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:03.697616 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6ce59470-0aa4-452c-b696-164ca9522ce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de5706b8f6e49708ab380a380fcbdb1'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:03.698126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6ce59470-0aa4-452c-b696-164ca9522ce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de5706b8f6e49708ab380a380fcbdb1'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:03.712019 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6ce59470-0aa4-452c-b696-164ca9522ce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de5706b8f6e49708ab380a380fcbdb1'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:03.738861 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 868/1756] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:03 2022] DELETE /identity/v3/users/5de5706b8f6e49708ab380a380fcbdb1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:04.780759 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b66c2f-a8d9-44b6-acd1-13f8447c37a3 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:04.784318 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-15b66c2f-a8d9-44b6-acd1-13f8447c37a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:04.802018 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce59470-0aa4-452c-b696-164ca9522ce8 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:04.805571 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6ce59470-0aa4-452c-b696-164ca9522ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:04.829990 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b66c2f-a8d9-44b6-acd1-13f8447c37a3 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:04.948507 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10528e3-2931-4cce-816e-57242317642c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:04.950061 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10528e3-2931-4cce-816e-57242317642c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:04.950459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10528e3-2931-4cce-816e-57242317642c admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:04.950787 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10528e3-2931-4cce-816e-57242317642c admin admin] PATH_INFO: `/v3/users/f898d18dbab141aab898b0f2420ae04b` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:04.952541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10528e3-2931-4cce-816e-57242317642c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f898d18dbab141aab898b0f2420ae04b)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:04.955025 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10528e3-2931-4cce-816e-57242317642c admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:04.972942 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce59470-0aa4-452c-b696-164ca9522ce8 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:04.982017 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df61ae-5030-498b-befb-f5f22d37f34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:04.984257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df61ae-5030-498b-befb-f5f22d37f34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:04.986175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df61ae-5030-498b-befb-f5f22d37f34f admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:04.987338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df61ae-5030-498b-befb-f5f22d37f34f admin admin] PATH_INFO: `/v3/projects/93c64627eaf24d12a779bd8ebfdb7072` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:05.006598 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df61ae-5030-498b-befb-f5f22d37f34f admin admin] RBAC: Authorizing `identity:delete_project(project_id=93c64627eaf24d12a779bd8ebfdb7072)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:05.009809 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df61ae-5030-498b-befb-f5f22d37f34f admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:05.041030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d10528e3-2931-4cce-816e-57242317642c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f898d18dbab141aab898b0f2420ae04b'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:05.055934 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d10528e3-2931-4cce-816e-57242317642c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f898d18dbab141aab898b0f2420ae04b'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:05.057131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d10528e3-2931-4cce-816e-57242317642c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f898d18dbab141aab898b0f2420ae04b'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:05.057975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d10528e3-2931-4cce-816e-57242317642c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f898d18dbab141aab898b0f2420ae04b'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:05.072417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d10528e3-2931-4cce-816e-57242317642c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f898d18dbab141aab898b0f2420ae04b'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:05.107437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 889/1757] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:04 2022] DELETE /identity/v3/users/f898d18dbab141aab898b0f2420ae04b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:05.107437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10528e3-2931-4cce-816e-57242317642c admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:05.110126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-d10528e3-2931-4cce-816e-57242317642c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:05.162809 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-41df61ae-5030-498b-befb-f5f22d37f34f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93c64627eaf24d12a779bd8ebfdb7072', 'request_id': 'req-41df61ae-5030-498b-befb-f5f22d37f34f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:05.177995 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10528e3-2931-4cce-816e-57242317642c admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:05.182441 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7984d7-bf76-4c2f-bc1b-8881d649e003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:05.183980 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7984d7-bf76-4c2f-bc1b-8881d649e003 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:05.184270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7984d7-bf76-4c2f-bc1b-8881d649e003 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:05.184539 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7984d7-bf76-4c2f-bc1b-8881d649e003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:05.186479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-6e7984d7-bf76-4c2f-bc1b-8881d649e003 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:05.199888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-41df61ae-5030-498b-befb-f5f22d37f34f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93c64627eaf24d12a779bd8ebfdb7072', 'request_id': 'req-41df61ae-5030-498b-befb-f5f22d37f34f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:05.224888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-41df61ae-5030-498b-befb-f5f22d37f34f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93c64627eaf24d12a779bd8ebfdb7072', 'request_id': 'req-41df61ae-5030-498b-befb-f5f22d37f34f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:05.239472 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-41df61ae-5030-498b-befb-f5f22d37f34f admin admin] The token cache is being invalidate because project 93c64627eaf24d12a779bd8ebfdb7072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:05.239875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-41df61ae-5030-498b-befb-f5f22d37f34f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:05.240620 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-41df61ae-5030-498b-befb-f5f22d37f34f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:05.243337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 869/1758] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:04 2022] DELETE /identity/v3/projects/93c64627eaf24d12a779bd8ebfdb7072 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:06:05.245515 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098557e-9d20-4ef3-9ab2-aab5038df897 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:05.246427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098557e-9d20-4ef3-9ab2-aab5038df897 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:05.246720 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098557e-9d20-4ef3-9ab2-aab5038df897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:05.277326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-c098557e-9d20-4ef3-9ab2-aab5038df897 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:05.279953 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c098557e-9d20-4ef3-9ab2-aab5038df897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:05.280757 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7984d7-bf76-4c2f-bc1b-8881d649e003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:05.282445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7984d7-bf76-4c2f-bc1b-8881d649e003 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:05.296010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 890/1759] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:05.312613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f6680-a658-4204-b69a-d78eaa586dfb None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:05.312952 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f6680-a658-4204-b69a-d78eaa586dfb None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:05.313184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f6680-a658-4204-b69a-d78eaa586dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:05.351611 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-347f6680-a658-4204-b69a-d78eaa586dfb None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:05.352949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-347f6680-a658-4204-b69a-d78eaa586dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:05.374836 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 870/1760] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:05.391151 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098557e-9d20-4ef3-9ab2-aab5038df897 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:05.393222 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c098557e-9d20-4ef3-9ab2-aab5038df897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:05.519900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 891/1761] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:05.524299 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfabb7-0f50-441a-a297-b143a79c10b2 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:05.524741 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098557e-9d20-4ef3-9ab2-aab5038df897 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:05.526348 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfabb7-0f50-441a-a297-b143a79c10b2 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:05.526679 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfabb7-0f50-441a-a297-b143a79c10b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:05.530796 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022f2d3-b514-4f7f-af07-1fc272c90aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:05.530796 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022f2d3-b514-4f7f-af07-1fc272c90aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:05.531146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022f2d3-b514-4f7f-af07-1fc272c90aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:05.531146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022f2d3-b514-4f7f-af07-1fc272c90aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:05.545255 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022f2d3-b514-4f7f-af07-1fc272c90aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:05.547030 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022f2d3-b514-4f7f-af07-1fc272c90aa3 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:05.559288 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-3abfabb7-0f50-441a-a297-b143a79c10b2 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:05.560783 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-3abfabb7-0f50-441a-a297-b143a79c10b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:05.593484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 892/1762] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:05.595092 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfabb7-0f50-441a-a297-b143a79c10b2 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:05.603794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 871/1763] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:06:05.613971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfabb7-0f50-441a-a297-b143a79c10b2 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:05.622300 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24301adf-6de9-42a1-8e64-6d6d828c2035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:05.623644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24301adf-6de9-42a1-8e64-6d6d828c2035 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:05.623876 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24301adf-6de9-42a1-8e64-6d6d828c2035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:05.624296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24301adf-6de9-42a1-8e64-6d6d828c2035 admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:05.625486 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24301adf-6de9-42a1-8e64-6d6d828c2035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:06:05.626063 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24301adf-6de9-42a1-8e64-6d6d828c2035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:05.629420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24301adf-6de9-42a1-8e64-6d6d828c2035 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:05.689328 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022f2d3-b514-4f7f-af07-1fc272c90aa3 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:05.691858 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 893/1764] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:06:05.721153 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022f2d3-b514-4f7f-af07-1fc272c90aa3 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:05.732162 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1acdf-87d9-4691-abfc-eae3980caa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:05.732844 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1acdf-87d9-4691-abfc-eae3980caa5b admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:05.733306 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1acdf-87d9-4691-abfc-eae3980caa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:05.733595 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1acdf-87d9-4691-abfc-eae3980caa5b admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:05.734456 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1acdf-87d9-4691-abfc-eae3980caa5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:05.736435 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1acdf-87d9-4691-abfc-eae3980caa5b admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:05.795587 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 872/1765] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:05 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:06:05.800799 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24301adf-6de9-42a1-8e64-6d6d828c2035 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:05.829757 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24301adf-6de9-42a1-8e64-6d6d828c2035 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:06.052786 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450c165-11f9-4c04-85ad-9642e80a53fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:06.053516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450c165-11f9-4c04-85ad-9642e80a53fe admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:06.056262 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450c165-11f9-4c04-85ad-9642e80a53fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:06.056564 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450c165-11f9-4c04-85ad-9642e80a53fe admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:06.057307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450c165-11f9-4c04-85ad-9642e80a53fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:06.059455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450c165-11f9-4c04-85ad-9642e80a53fe admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:06.119534 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 894/1766] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:05 2022] POST /identity/v3/users => generated 284 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:06.124257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1acdf-87d9-4691-abfc-eae3980caa5b admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:06.141544 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1acdf-87d9-4691-abfc-eae3980caa5b admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:06.158282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c28b4-1606-4608-b350-4ce97098d0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:06.161443 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c28b4-1606-4608-b350-4ce97098d0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:06.161924 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c28b4-1606-4608-b350-4ce97098d0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:06.162392 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c28b4-1606-4608-b350-4ce97098d0d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:06.169687 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c28b4-1606-4608-b350-4ce97098d0d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:06.181828 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c28b4-1606-4608-b350-4ce97098d0d0 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:06.224244 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 873/1767] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:06.230890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450c165-11f9-4c04-85ad-9642e80a53fe admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:06.254414 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450c165-11f9-4c04-85ad-9642e80a53fe admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:06.271679 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9193ffe-73d2-4ca9-abff-afb266b1725d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:06.272377 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9193ffe-73d2-4ca9-abff-afb266b1725d admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:06.272664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9193ffe-73d2-4ca9-abff-afb266b1725d admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:06.272934 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9193ffe-73d2-4ca9-abff-afb266b1725d admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:06.273660 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9193ffe-73d2-4ca9-abff-afb266b1725d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:06.275355 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9193ffe-73d2-4ca9-abff-afb266b1725d admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:06.306956 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 895/1768] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:06.313049 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c28b4-1606-4608-b350-4ce97098d0d0 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:06.339576 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c28b4-1606-4608-b350-4ce97098d0d0 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:06.344023 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9193ffe-73d2-4ca9-abff-afb266b1725d admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:06.346011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a9193ffe-73d2-4ca9-abff-afb266b1725d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:06.378962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9193ffe-73d2-4ca9-abff-afb266b1725d admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:06.386182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51331b92-139a-48cf-8c24-67061e4d5a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:06.387692 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51331b92-139a-48cf-8c24-67061e4d5a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:06.388083 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51331b92-139a-48cf-8c24-67061e4d5a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:06.388506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51331b92-139a-48cf-8c24-67061e4d5a51 admin admin] PATH_INFO: `/v3/projects/5a1fe4ba99994a92899e2387dc43edcc/users/4b60c3609240460dabca0ba6c3428fbf/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:06.392062 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b6135-2f41-4e3a-a5bd-3ca1967ea2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:06.393897 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b6135-2f41-4e3a-a5bd-3ca1967ea2a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:06.394200 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b6135-2f41-4e3a-a5bd-3ca1967ea2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:06.394484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b6135-2f41-4e3a-a5bd-3ca1967ea2a6 admin admin] PATH_INFO: `/v3/projects/630997120b544518a9698d664678d072` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:06.402266 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b6135-2f41-4e3a-a5bd-3ca1967ea2a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=630997120b544518a9698d664678d072)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:06.404970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b6135-2f41-4e3a-a5bd-3ca1967ea2a6 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:06.443124 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51331b92-139a-48cf-8c24-67061e4d5a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a1fe4ba99994a92899e2387dc43edcc, user_id=4b60c3609240460dabca0ba6c3428fbf, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:06.443124 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51331b92-139a-48cf-8c24-67061e4d5a51 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:06.463740 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 874/1769] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:06 2022] PUT /identity/v3/projects/5a1fe4ba99994a92899e2387dc43edcc/users/4b60c3609240460dabca0ba6c3428fbf/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:06.480966 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccd258-71bb-42c2-a90b-b27fb1a56f8e None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:06.481379 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccd258-71bb-42c2-a90b-b27fb1a56f8e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:06.481833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccd258-71bb-42c2-a90b-b27fb1a56f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:06.527506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-e4ccd258-71bb-42c2-a90b-b27fb1a56f8e None None] MFA Rules not processed for user `4b60c3609240460dabca0ba6c3428fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:06.529007 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-e4ccd258-71bb-42c2-a90b-b27fb1a56f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:06.659534 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4c3b6135-2f41-4e3a-a5bd-3ca1967ea2a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '630997120b544518a9698d664678d072', 'request_id': 'req-4c3b6135-2f41-4e3a-a5bd-3ca1967ea2a6'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:06.668880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4c3b6135-2f41-4e3a-a5bd-3ca1967ea2a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '630997120b544518a9698d664678d072', 'request_id': 'req-4c3b6135-2f41-4e3a-a5bd-3ca1967ea2a6'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:06.679167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 875/1770] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:06.688359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccd258-71bb-42c2-a90b-b27fb1a56f8e None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:06.690429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4c3b6135-2f41-4e3a-a5bd-3ca1967ea2a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '630997120b544518a9698d664678d072', 'request_id': 'req-4c3b6135-2f41-4e3a-a5bd-3ca1967ea2a6'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:06.715646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4c3b6135-2f41-4e3a-a5bd-3ca1967ea2a6 admin admin] The token cache is being invalidate because project 630997120b544518a9698d664678d072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:06.716265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4c3b6135-2f41-4e3a-a5bd-3ca1967ea2a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:06.717604 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4c3b6135-2f41-4e3a-a5bd-3ca1967ea2a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:06.721033 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 896/1771] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:06 2022] DELETE /identity/v3/projects/630997120b544518a9698d664678d072 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:06.727758 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4868c-2e70-4667-968a-b8112846b6d0 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:06.728759 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4868c-2e70-4667-968a-b8112846b6d0 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:06.732098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4868c-2e70-4667-968a-b8112846b6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:06.783121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-4cb4868c-2e70-4667-968a-b8112846b6d0 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:06.783121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-4cb4868c-2e70-4667-968a-b8112846b6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:06.916367 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccd258-71bb-42c2-a90b-b27fb1a56f8e None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:06.975318 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 897/1772] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:06.977300 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4868c-2e70-4667-968a-b8112846b6d0 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:06.990255 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-4cb4868c-2e70-4667-968a-b8112846b6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:07.042790 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4868c-2e70-4667-968a-b8112846b6d0 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:07.053790 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9c4f7-bb6f-4a7f-94fa-aa649874c34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:07.056400 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9c4f7-bb6f-4a7f-94fa-aa649874c34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:07.056871 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9c4f7-bb6f-4a7f-94fa-aa649874c34c admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:07.057452 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9c4f7-bb6f-4a7f-94fa-aa649874c34c admin admin] PATH_INFO: `/v3/users/b73c15bdc89e4f21894940e164a9605a` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:07.058632 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be590399-9bbe-4e56-9580-95053d7ab16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:07.059581 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be590399-9bbe-4e56-9580-95053d7ab16e admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:07.060020 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be590399-9bbe-4e56-9580-95053d7ab16e admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:07.060501 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be590399-9bbe-4e56-9580-95053d7ab16e admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:07.062622 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be590399-9bbe-4e56-9580-95053d7ab16e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:07.067452 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9c4f7-bb6f-4a7f-94fa-aa649874c34c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b73c15bdc89e4f21894940e164a9605a)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:07.068646 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be590399-9bbe-4e56-9580-95053d7ab16e admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:07.070897 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9c4f7-bb6f-4a7f-94fa-aa649874c34c admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:07.151944 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 876/1773] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:06 2022] POST /identity/v3/projects => generated 365 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:06:07.156980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7ea06-f3ef-4f17-aa91-f1eb398665b4 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:07.159531 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7ea06-f3ef-4f17-aa91-f1eb398665b4 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:07.160164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7ea06-f3ef-4f17-aa91-f1eb398665b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:07.194170 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-09d9c4f7-bb6f-4a7f-94fa-aa649874c34c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b73c15bdc89e4f21894940e164a9605a'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:07.210696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-09d9c4f7-bb6f-4a7f-94fa-aa649874c34c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b73c15bdc89e4f21894940e164a9605a'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:07.211578 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-09d9c4f7-bb6f-4a7f-94fa-aa649874c34c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b73c15bdc89e4f21894940e164a9605a'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:07.212284 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-09d9c4f7-bb6f-4a7f-94fa-aa649874c34c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b73c15bdc89e4f21894940e164a9605a'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:07.229252 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-afc7ea06-f3ef-4f17-aa91-f1eb398665b4 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:07.229457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-09d9c4f7-bb6f-4a7f-94fa-aa649874c34c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b73c15bdc89e4f21894940e164a9605a'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:07.234033 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-afc7ea06-f3ef-4f17-aa91-f1eb398665b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:07.270162 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 898/1774] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:06 2022] DELETE /identity/v3/users/b73c15bdc89e4f21894940e164a9605a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:07.271820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9c4f7-bb6f-4a7f-94fa-aa649874c34c admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:07.287418 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-09d9c4f7-bb6f-4a7f-94fa-aa649874c34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:07.477727 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9c4f7-bb6f-4a7f-94fa-aa649874c34c admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:07.486941 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 877/1775] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:07.486941 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7ea06-f3ef-4f17-aa91-f1eb398665b4 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:07.490942 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811372b8-cacf-451c-9aaf-479f8862fb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:07.492402 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811372b8-cacf-451c-9aaf-479f8862fb53 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:07.492686 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811372b8-cacf-451c-9aaf-479f8862fb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:07.493049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811372b8-cacf-451c-9aaf-479f8862fb53 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:07.497132 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811372b8-cacf-451c-9aaf-479f8862fb53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:07.497430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7ea06-f3ef-4f17-aa91-f1eb398665b4 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:07.503283 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4d0cc-c939-4c9a-85d6-6bf39fd48259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:07.504769 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4d0cc-c939-4c9a-85d6-6bf39fd48259 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:07.505157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4d0cc-c939-4c9a-85d6-6bf39fd48259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:07.505438 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4d0cc-c939-4c9a-85d6-6bf39fd48259 admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:07.506645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4d0cc-c939-4c9a-85d6-6bf39fd48259 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:06:07.507006 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4d0cc-c939-4c9a-85d6-6bf39fd48259 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:07.507621 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811372b8-cacf-451c-9aaf-479f8862fb53 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:07.508736 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4d0cc-c939-4c9a-85d6-6bf39fd48259 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:07.522378 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 878/1776] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:06:07.527683 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4d0cc-c939-4c9a-85d6-6bf39fd48259 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:07.540249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4d0cc-c939-4c9a-85d6-6bf39fd48259 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:07.546646 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b292671-2a2f-49f6-8abd-6c6c08028a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:07.547691 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b292671-2a2f-49f6-8abd-6c6c08028a44 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:07.548062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b292671-2a2f-49f6-8abd-6c6c08028a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:07.548404 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b292671-2a2f-49f6-8abd-6c6c08028a44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:07.549539 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b292671-2a2f-49f6-8abd-6c6c08028a44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:07.553477 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b292671-2a2f-49f6-8abd-6c6c08028a44 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:07.568362 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 899/1777] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:07 2022] POST /identity/v3/users => generated 289 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:07.573320 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811372b8-cacf-451c-9aaf-479f8862fb53 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:07.591151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811372b8-cacf-451c-9aaf-479f8862fb53 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:07.604419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acca499-d708-41c7-82a6-0633abbcacc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:07.605263 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acca499-d708-41c7-82a6-0633abbcacc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:07.605617 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acca499-d708-41c7-82a6-0633abbcacc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:07.605921 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acca499-d708-41c7-82a6-0633abbcacc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:07.606692 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acca499-d708-41c7-82a6-0633abbcacc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:07.608457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acca499-d708-41c7-82a6-0633abbcacc8 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:07.609067 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 879/1778] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:07 2022] POST /identity/v3/projects => generated 357 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:06:07.610062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b292671-2a2f-49f6-8abd-6c6c08028a44 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:07.633928 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 900/1779] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:07.639232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acca499-d708-41c7-82a6-0633abbcacc8 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:07.651130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acca499-d708-41c7-82a6-0633abbcacc8 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:07.712620 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b292671-2a2f-49f6-8abd-6c6c08028a44 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:07.720241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e0049-8544-45bb-9ef7-8ede35cc2507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:07.721207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e0049-8544-45bb-9ef7-8ede35cc2507 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:07.722424 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e0049-8544-45bb-9ef7-8ede35cc2507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:07.722424 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e0049-8544-45bb-9ef7-8ede35cc2507 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:07.722651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e0049-8544-45bb-9ef7-8ede35cc2507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:07.725179 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e0049-8544-45bb-9ef7-8ede35cc2507 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:07.751266 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 880/1780] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:07 2022] POST /identity/v3/users => generated 279 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:07.754129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af020eb-77e3-4fd5-9566-e62418ec8660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:07.755468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af020eb-77e3-4fd5-9566-e62418ec8660 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:07.755818 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af020eb-77e3-4fd5-9566-e62418ec8660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:07.755941 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e0049-8544-45bb-9ef7-8ede35cc2507 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:07.756226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af020eb-77e3-4fd5-9566-e62418ec8660 admin admin] PATH_INFO: `/v3/projects/371a12f2996040779fc633a49d998df1/users/17c9057e0f404297813e7d4c0e906e0b/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:07.772504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e0049-8544-45bb-9ef7-8ede35cc2507 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:07.781671 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b230c-b412-4d51-9c8d-d89ee36fc1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:07.782700 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b230c-b412-4d51-9c8d-d89ee36fc1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:07.782892 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af020eb-77e3-4fd5-9566-e62418ec8660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=371a12f2996040779fc633a49d998df1, user_id=17c9057e0f404297813e7d4c0e906e0b, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:07.783148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b230c-b412-4d51-9c8d-d89ee36fc1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:07.783540 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b230c-b412-4d51-9c8d-d89ee36fc1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:07.794040 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af020eb-77e3-4fd5-9566-e62418ec8660 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:07.794985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b230c-b412-4d51-9c8d-d89ee36fc1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:07.797595 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b230c-b412-4d51-9c8d-d89ee36fc1c6 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:07.810862 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 901/1781] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:07 2022] PUT /identity/v3/projects/371a12f2996040779fc633a49d998df1/users/17c9057e0f404297813e7d4c0e906e0b/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:07.816473 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af020eb-77e3-4fd5-9566-e62418ec8660 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:07.819399 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 881/1782] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:07.823394 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b230c-b412-4d51-9c8d-d89ee36fc1c6 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:07.850340 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b230c-b412-4d51-9c8d-d89ee36fc1c6 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:07.925818 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af020eb-77e3-4fd5-9566-e62418ec8660 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:07.935843 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b7280-a9fd-4eba-a53b-aff722ab6228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:07.937017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b7280-a9fd-4eba-a53b-aff722ab6228 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:07.937658 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b7280-a9fd-4eba-a53b-aff722ab6228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:07.938105 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b7280-a9fd-4eba-a53b-aff722ab6228 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:07.939697 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b7280-a9fd-4eba-a53b-aff722ab6228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:07.941638 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cac3ab-894a-4617-998c-c9d7c5d36150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:07.942393 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cac3ab-894a-4617-998c-c9d7c5d36150 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:07.942741 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cac3ab-894a-4617-998c-c9d7c5d36150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:07.942956 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b7280-a9fd-4eba-a53b-aff722ab6228 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:07.943188 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cac3ab-894a-4617-998c-c9d7c5d36150 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:07.943987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cac3ab-894a-4617-998c-c9d7c5d36150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:07.945755 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cac3ab-894a-4617-998c-c9d7c5d36150 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:07.957528 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 882/1783] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:07.958250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cac3ab-894a-4617-998c-c9d7c5d36150 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:07.964861 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 902/1784] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:07.965166 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-15cac3ab-894a-4617-998c-c9d7c5d36150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:07.965280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b7280-a9fd-4eba-a53b-aff722ab6228 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:07.976074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b7280-a9fd-4eba-a53b-aff722ab6228 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:07.983621 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecfa69-53a3-4eaa-bf6f-9ef3476ecab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:07.984652 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecfa69-53a3-4eaa-bf6f-9ef3476ecab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:07.985030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecfa69-53a3-4eaa-bf6f-9ef3476ecab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:07.985411 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecfa69-53a3-4eaa-bf6f-9ef3476ecab5 admin admin] PATH_INFO: `/v3/projects/cb1c74973ff84460b4dcdee41807d2fc/users/9501562fc7ca4d0dbdfdbfd476a16fbf/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:07.985517 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cac3ab-894a-4617-998c-c9d7c5d36150 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:07.991680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb27a42-0fb8-45a4-9b3d-1224a20739a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:07.992720 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb27a42-0fb8-45a4-9b3d-1224a20739a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:07.993007 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb27a42-0fb8-45a4-9b3d-1224a20739a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:07.993277 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb27a42-0fb8-45a4-9b3d-1224a20739a9 admin admin] PATH_INFO: `/v3/projects/1ca2ee4158f442ae8cd51e430d8e032c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:07.994554 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb27a42-0fb8-45a4-9b3d-1224a20739a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ca2ee4158f442ae8cd51e430d8e032c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:07.997453 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb27a42-0fb8-45a4-9b3d-1224a20739a9 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:08.013657 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecfa69-53a3-4eaa-bf6f-9ef3476ecab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1c74973ff84460b4dcdee41807d2fc, user_id=9501562fc7ca4d0dbdfdbfd476a16fbf, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:08.017310 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecfa69-53a3-4eaa-bf6f-9ef3476ecab5 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:08.035091 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 903/1785] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:07 2022] PUT /identity/v3/projects/cb1c74973ff84460b4dcdee41807d2fc/users/9501562fc7ca4d0dbdfdbfd476a16fbf/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:08.036328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecfa69-53a3-4eaa-bf6f-9ef3476ecab5 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:08.069412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-fcb27a42-0fb8-45a4-9b3d-1224a20739a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ca2ee4158f442ae8cd51e430d8e032c', 'request_id': 'req-fcb27a42-0fb8-45a4-9b3d-1224a20739a9'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:08.079105 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-fcb27a42-0fb8-45a4-9b3d-1224a20739a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ca2ee4158f442ae8cd51e430d8e032c', 'request_id': 'req-fcb27a42-0fb8-45a4-9b3d-1224a20739a9'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:08.094854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-fcb27a42-0fb8-45a4-9b3d-1224a20739a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ca2ee4158f442ae8cd51e430d8e032c', 'request_id': 'req-fcb27a42-0fb8-45a4-9b3d-1224a20739a9'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:08.112797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-fcb27a42-0fb8-45a4-9b3d-1224a20739a9 admin admin] The token cache is being invalidate because project 1ca2ee4158f442ae8cd51e430d8e032c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:08.113089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-fcb27a42-0fb8-45a4-9b3d-1224a20739a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:08.114473 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-fcb27a42-0fb8-45a4-9b3d-1224a20739a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:08.116140 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 883/1786] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:07 2022] DELETE /identity/v3/projects/1ca2ee4158f442ae8cd51e430d8e032c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:08.118210 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d67ec-9327-4f53-9de6-e08c25967051 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:08.118859 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d67ec-9327-4f53-9de6-e08c25967051 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:08.119157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d67ec-9327-4f53-9de6-e08c25967051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:08.148693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecfa69-53a3-4eaa-bf6f-9ef3476ecab5 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:08.169478 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-9d4d67ec-9327-4f53-9de6-e08c25967051 None None] MFA Rules not processed for user `9501562fc7ca4d0dbdfdbfd476a16fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:08.171657 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-9d4d67ec-9327-4f53-9de6-e08c25967051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:08.252229 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3d284-ea52-4625-8179-1f37880a4457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:08.255144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3d284-ea52-4625-8179-1f37880a4457 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:08.255912 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3d284-ea52-4625-8179-1f37880a4457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:08.256569 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3d284-ea52-4625-8179-1f37880a4457 admin admin] PATH_INFO: `/v3/projects/371a12f2996040779fc633a49d998df1/users/17c9057e0f404297813e7d4c0e906e0b/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:08.259498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3d284-ea52-4625-8179-1f37880a4457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=371a12f2996040779fc633a49d998df1, user_id=17c9057e0f404297813e7d4c0e906e0b, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:08.264298 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3d284-ea52-4625-8179-1f37880a4457 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:08.279850 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 904/1787] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:08 2022] PUT /identity/v3/projects/371a12f2996040779fc633a49d998df1/users/17c9057e0f404297813e7d4c0e906e0b/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:08.281003 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3d284-ea52-4625-8179-1f37880a4457 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:08.282612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-91b3d284-ea52-4625-8179-1f37880a4457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:08.308706 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 884/1788] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:08 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:08.310446 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e564f44-3cf9-4df3-a836-3d230e2434d6 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:08.310805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e564f44-3cf9-4df3-a836-3d230e2434d6 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:08.311208 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e564f44-3cf9-4df3-a836-3d230e2434d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:08.359161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-5e564f44-3cf9-4df3-a836-3d230e2434d6 None None] MFA Rules not processed for user `17c9057e0f404297813e7d4c0e906e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:08.361237 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-5e564f44-3cf9-4df3-a836-3d230e2434d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:08.404620 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3d284-ea52-4625-8179-1f37880a4457 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:08.416458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29725748-68f0-48dc-84ab-c2c0ff824613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:08.417516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29725748-68f0-48dc-84ab-c2c0ff824613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:08.417881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29725748-68f0-48dc-84ab-c2c0ff824613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:08.418233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29725748-68f0-48dc-84ab-c2c0ff824613 admin admin] PATH_INFO: `/v3/users/0516ac14d89746dc9f750bb409f33570` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:08.420089 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29725748-68f0-48dc-84ab-c2c0ff824613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0516ac14d89746dc9f750bb409f33570)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:08.424058 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29725748-68f0-48dc-84ab-c2c0ff824613 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:08.466987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 885/1789] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:08 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:08.467996 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e564f44-3cf9-4df3-a836-3d230e2434d6 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:08.469860 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-5e564f44-3cf9-4df3-a836-3d230e2434d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:08.481587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-29725748-68f0-48dc-84ab-c2c0ff824613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0516ac14d89746dc9f750bb409f33570'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:08.482949 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e564f44-3cf9-4df3-a836-3d230e2434d6 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:08.487604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb00f8d-2ca3-4ce2-8c77-9c784a95905d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:08.488274 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb00f8d-2ca3-4ce2-8c77-9c784a95905d admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:08.488557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb00f8d-2ca3-4ce2-8c77-9c784a95905d admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:08.488831 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb00f8d-2ca3-4ce2-8c77-9c784a95905d admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:08.489528 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb00f8d-2ca3-4ce2-8c77-9c784a95905d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:08.491511 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb00f8d-2ca3-4ce2-8c77-9c784a95905d admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:08.494013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-29725748-68f0-48dc-84ab-c2c0ff824613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0516ac14d89746dc9f750bb409f33570'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:08.494721 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-29725748-68f0-48dc-84ab-c2c0ff824613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0516ac14d89746dc9f750bb409f33570'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:08.495384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-29725748-68f0-48dc-84ab-c2c0ff824613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0516ac14d89746dc9f750bb409f33570'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:08.502373 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-29725748-68f0-48dc-84ab-c2c0ff824613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0516ac14d89746dc9f750bb409f33570'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:08.523709 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 905/1790] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:08 2022] DELETE /identity/v3/users/0516ac14d89746dc9f750bb409f33570 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:08.525298 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29725748-68f0-48dc-84ab-c2c0ff824613 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:08.529503 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-29725748-68f0-48dc-84ab-c2c0ff824613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:08.584495 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 886/1791] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:08 2022] POST /identity/v3/projects => generated 357 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:08.591603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb00f8d-2ca3-4ce2-8c77-9c784a95905d admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:08.593740 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-beb00f8d-2ca3-4ce2-8c77-9c784a95905d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:08.696994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29725748-68f0-48dc-84ab-c2c0ff824613 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:08.743197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb00f8d-2ca3-4ce2-8c77-9c784a95905d admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:08.757038 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219a5b1-d4bf-4b79-99f8-c7c2f66956f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:08.759814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219a5b1-d4bf-4b79-99f8-c7c2f66956f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:08.760571 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219a5b1-d4bf-4b79-99f8-c7c2f66956f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:08.761883 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219a5b1-d4bf-4b79-99f8-c7c2f66956f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:08.764472 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219a5b1-d4bf-4b79-99f8-c7c2f66956f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:08.769021 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219a5b1-d4bf-4b79-99f8-c7c2f66956f2 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:08.795088 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69d10a-d4e2-4447-94b5-625dd27f56b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:08.796454 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69d10a-d4e2-4447-94b5-625dd27f56b0 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:08.813692 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69d10a-d4e2-4447-94b5-625dd27f56b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:08.813692 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69d10a-d4e2-4447-94b5-625dd27f56b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:08.814069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 887/1792] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:08 2022] POST /identity/v3/users => generated 285 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:08.816521 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219a5b1-d4bf-4b79-99f8-c7c2f66956f2 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:08.817264 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ba69d10a-d4e2-4447-94b5-625dd27f56b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:08.837664 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219a5b1-d4bf-4b79-99f8-c7c2f66956f2 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:08.850490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b420d19-e5f7-4a87-aaff-efdbefe01150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:08.851276 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b420d19-e5f7-4a87-aaff-efdbefe01150 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:08.851559 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b420d19-e5f7-4a87-aaff-efdbefe01150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:08.851838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b420d19-e5f7-4a87-aaff-efdbefe01150 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:08.852579 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b420d19-e5f7-4a87-aaff-efdbefe01150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:08.854287 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b420d19-e5f7-4a87-aaff-efdbefe01150 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:08.871851 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 888/1793] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:06:08.873560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b420d19-e5f7-4a87-aaff-efdbefe01150 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:08.892479 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b420d19-e5f7-4a87-aaff-efdbefe01150 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:08.897892 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349ab76-7d29-48b5-b848-d0c84087ed0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:08.898843 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349ab76-7d29-48b5-b848-d0c84087ed0d admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:08.899187 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349ab76-7d29-48b5-b848-d0c84087ed0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:08.899901 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349ab76-7d29-48b5-b848-d0c84087ed0d admin admin] PATH_INFO: `/v3/projects/5cf4a6d8005b40f2a948032219d06a73/users/1d68c4155bcc4b1dbb6ee3fb8ae8144c/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:08.920995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349ab76-7d29-48b5-b848-d0c84087ed0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cf4a6d8005b40f2a948032219d06a73, user_id=1d68c4155bcc4b1dbb6ee3fb8ae8144c, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:08.924814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349ab76-7d29-48b5-b848-d0c84087ed0d admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:08.954259 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 889/1794] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:08 2022] PUT /identity/v3/projects/5cf4a6d8005b40f2a948032219d06a73/users/1d68c4155bcc4b1dbb6ee3fb8ae8144c/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:08.955252 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349ab76-7d29-48b5-b848-d0c84087ed0d admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:08.961316 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-e349ab76-7d29-48b5-b848-d0c84087ed0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:08.968196 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69d10a-d4e2-4447-94b5-625dd27f56b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:08.970977 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69d10a-d4e2-4447-94b5-625dd27f56b0 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:08.984170 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 906/1795] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:08.984837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69d10a-d4e2-4447-94b5-625dd27f56b0 service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:09.001073 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69d10a-d4e2-4447-94b5-625dd27f56b0 service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:09.136541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a47131-9a44-400f-a89f-a90fe4b5d21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:09.137877 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a47131-9a44-400f-a89f-a90fe4b5d21b admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:09.138587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a47131-9a44-400f-a89f-a90fe4b5d21b admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:09.139208 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a47131-9a44-400f-a89f-a90fe4b5d21b admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:09.143277 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a47131-9a44-400f-a89f-a90fe4b5d21b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:09.148487 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a47131-9a44-400f-a89f-a90fe4b5d21b admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:09.154121 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349ab76-7d29-48b5-b848-d0c84087ed0d admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:09.163823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9d3c9-e134-4376-9dd4-5fec3638af7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:09.164034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 907/1796] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:09.164152 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9d3c9-e134-4376-9dd4-5fec3638af7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:09.164249 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a47131-9a44-400f-a89f-a90fe4b5d21b admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:09.164331 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9d3c9-e134-4376-9dd4-5fec3638af7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:09.164331 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9d3c9-e134-4376-9dd4-5fec3638af7f admin admin] PATH_INFO: `/v3/projects/a27b60ab2db74e6a9c0a0c3a7ed6ce6d` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:09.166388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9d3c9-e134-4376-9dd4-5fec3638af7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a27b60ab2db74e6a9c0a0c3a7ed6ce6d)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:09.171066 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9d3c9-e134-4376-9dd4-5fec3638af7f admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:09.279316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a47131-9a44-400f-a89f-a90fe4b5d21b admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:09.283456 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4cf9d3c9-e134-4376-9dd4-5fec3638af7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a27b60ab2db74e6a9c0a0c3a7ed6ce6d', 'request_id': 'req-4cf9d3c9-e134-4376-9dd4-5fec3638af7f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:09.298210 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4cf9d3c9-e134-4376-9dd4-5fec3638af7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a27b60ab2db74e6a9c0a0c3a7ed6ce6d', 'request_id': 'req-4cf9d3c9-e134-4376-9dd4-5fec3638af7f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:09.322883 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4cf9d3c9-e134-4376-9dd4-5fec3638af7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a27b60ab2db74e6a9c0a0c3a7ed6ce6d', 'request_id': 'req-4cf9d3c9-e134-4376-9dd4-5fec3638af7f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:09.347728 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4cf9d3c9-e134-4376-9dd4-5fec3638af7f admin admin] The token cache is being invalidate because project a27b60ab2db74e6a9c0a0c3a7ed6ce6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:09.349331 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4cf9d3c9-e134-4376-9dd4-5fec3638af7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:09.350677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4cf9d3c9-e134-4376-9dd4-5fec3638af7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:09.358940 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 890/1797] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:08 2022] DELETE /identity/v3/projects/a27b60ab2db74e6a9c0a0c3a7ed6ce6d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:09.360785 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9d3c9-e134-4376-9dd4-5fec3638af7f admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:09.363840 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-4cf9d3c9-e134-4376-9dd4-5fec3638af7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:09.389858 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2928bd4-1b46-4703-b2ed-0686961a9d94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:09.390697 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2928bd4-1b46-4703-b2ed-0686961a9d94 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:09.391595 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2928bd4-1b46-4703-b2ed-0686961a9d94 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:09.391595 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2928bd4-1b46-4703-b2ed-0686961a9d94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:09.393501 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a2928bd4-1b46-4703-b2ed-0686961a9d94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:09.520774 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9d3c9-e134-4376-9dd4-5fec3638af7f admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:09.522926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2928bd4-1b46-4703-b2ed-0686961a9d94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:09.524395 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2928bd4-1b46-4703-b2ed-0686961a9d94 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:09.528480 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e4cfb-c417-46df-80d4-0dba3622a603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:09.529675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e4cfb-c417-46df-80d4-0dba3622a603 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:09.529958 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e4cfb-c417-46df-80d4-0dba3622a603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:09.530234 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e4cfb-c417-46df-80d4-0dba3622a603 admin admin] PATH_INFO: `/v3/projects/5cf4a6d8005b40f2a948032219d06a73/users/1d68c4155bcc4b1dbb6ee3fb8ae8144c/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:09.533886 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e4cfb-c417-46df-80d4-0dba3622a603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cf4a6d8005b40f2a948032219d06a73, user_id=1d68c4155bcc4b1dbb6ee3fb8ae8144c, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:09.536725 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 908/1798] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:09.537571 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e4cfb-c417-46df-80d4-0dba3622a603 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:09.552537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154a702-0126-401c-9eb9-9528f938095a None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:09.553135 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154a702-0126-401c-9eb9-9528f938095a None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:09.553591 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 891/1799] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:09 2022] PUT /identity/v3/projects/5cf4a6d8005b40f2a948032219d06a73/users/1d68c4155bcc4b1dbb6ee3fb8ae8144c/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:09.555242 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154a702-0126-401c-9eb9-9528f938095a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:09.564886 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d81df-653b-40b0-ac4c-81968a0cb3e2 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:09.565307 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d81df-653b-40b0-ac4c-81968a0cb3e2 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:09.565651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d81df-653b-40b0-ac4c-81968a0cb3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:09.605737 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-8154a702-0126-401c-9eb9-9528f938095a None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:09.607219 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-8154a702-0126-401c-9eb9-9528f938095a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:09.646318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-cb4d81df-653b-40b0-ac4c-81968a0cb3e2 None None] MFA Rules not processed for user `1d68c4155bcc4b1dbb6ee3fb8ae8144c`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:09.647549 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-cb4d81df-653b-40b0-ac4c-81968a0cb3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:09.710937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 909/1800] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:09.714566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f8cc1-a19c-4fb0-ac8a-3210e434aed9 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:09.715117 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f8cc1-a19c-4fb0-ac8a-3210e434aed9 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:09.715462 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f8cc1-a19c-4fb0-ac8a-3210e434aed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:09.736490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-9d9f8cc1-a19c-4fb0-ac8a-3210e434aed9 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:09.737842 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-9d9f8cc1-a19c-4fb0-ac8a-3210e434aed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:09.744721 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 892/1801] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:09 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:09.748014 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 910/1802] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:09.753824 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d81df-653b-40b0-ac4c-81968a0cb3e2 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:09.758970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f8cc1-a19c-4fb0-ac8a-3210e434aed9 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:09.760363 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-9d9f8cc1-a19c-4fb0-ac8a-3210e434aed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:09.766980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d81df-653b-40b0-ac4c-81968a0cb3e2 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:09.773977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3584b7-aa07-4d64-982e-719f3540ad7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:09.774740 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3584b7-aa07-4d64-982e-719f3540ad7e admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:09.775150 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3584b7-aa07-4d64-982e-719f3540ad7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:09.775486 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3584b7-aa07-4d64-982e-719f3540ad7e admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:09.776278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3584b7-aa07-4d64-982e-719f3540ad7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:06:09.776645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3584b7-aa07-4d64-982e-719f3540ad7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:09.778380 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3584b7-aa07-4d64-982e-719f3540ad7e admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:09.793317 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 893/1803] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:06:09.799328 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3584b7-aa07-4d64-982e-719f3540ad7e admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:09.813251 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3584b7-aa07-4d64-982e-719f3540ad7e admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:09.818497 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17084c87-d449-478a-892d-21b8d1b3d63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:09.819402 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17084c87-d449-478a-892d-21b8d1b3d63f admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:09.819934 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17084c87-d449-478a-892d-21b8d1b3d63f admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:09.820225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17084c87-d449-478a-892d-21b8d1b3d63f admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:09.820920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17084c87-d449-478a-892d-21b8d1b3d63f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:09.822873 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17084c87-d449-478a-892d-21b8d1b3d63f admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:09.838061 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f8cc1-a19c-4fb0-ac8a-3210e434aed9 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:09.842689 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9a523-fe59-4ba8-9c23-dc335749421a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:09.843574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9a523-fe59-4ba8-9c23-dc335749421a service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:09.843864 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9a523-fe59-4ba8-9c23-dc335749421a service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:09.844165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9a523-fe59-4ba8-9c23-dc335749421a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:09.856005 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9a523-fe59-4ba8-9c23-dc335749421a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:09.857696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9a523-fe59-4ba8-9c23-dc335749421a service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:09.878657 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 911/1804] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:09 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:09.891881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 894/1805] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:09 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:06:09.896833 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9a523-fe59-4ba8-9c23-dc335749421a service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:09.911136 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9a523-fe59-4ba8-9c23-dc335749421a service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:10.012383 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17084c87-d449-478a-892d-21b8d1b3d63f admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:10.043387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d3dee-0e66-4da2-ab51-1826012a5738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:10.044348 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d3dee-0e66-4da2-ab51-1826012a5738 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:10.045788 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d3dee-0e66-4da2-ab51-1826012a5738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:10.046169 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d3dee-0e66-4da2-ab51-1826012a5738 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:10.047021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d3dee-0e66-4da2-ab51-1826012a5738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:10.049845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d3dee-0e66-4da2-ab51-1826012a5738 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:10.082712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 912/1806] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:09 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:10.089655 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d3dee-0e66-4da2-ab51-1826012a5738 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:10.106404 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d3dee-0e66-4da2-ab51-1826012a5738 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:10.113735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e1ab8-beb5-4376-9158-1116a57c9a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:10.114955 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e1ab8-beb5-4376-9158-1116a57c9a81 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:10.115329 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e1ab8-beb5-4376-9158-1116a57c9a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:10.115860 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e1ab8-beb5-4376-9158-1116a57c9a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:10.116749 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e1ab8-beb5-4376-9158-1116a57c9a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:10.119335 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e1ab8-beb5-4376-9158-1116a57c9a81 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:10.129944 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17084c87-d449-478a-892d-21b8d1b3d63f admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:10.134308 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 913/1807] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:10.137511 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2a811-64ff-4bf4-a3fe-1aee9fc1bb00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:10.138463 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2a811-64ff-4bf4-a3fe-1aee9fc1bb00 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:10.138896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2a811-64ff-4bf4-a3fe-1aee9fc1bb00 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:10.139277 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2a811-64ff-4bf4-a3fe-1aee9fc1bb00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:10.139387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e1ab8-beb5-4376-9158-1116a57c9a81 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:10.141371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c6b2a811-64ff-4bf4-a3fe-1aee9fc1bb00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:10.154451 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e1ab8-beb5-4376-9158-1116a57c9a81 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:10.159689 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a8b4e-09be-4cd6-b0c1-bb72258abe5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:10.160506 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a8b4e-09be-4cd6-b0c1-bb72258abe5b admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:10.160862 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a8b4e-09be-4cd6-b0c1-bb72258abe5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:10.161211 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a8b4e-09be-4cd6-b0c1-bb72258abe5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:10.163510 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a8b4e-09be-4cd6-b0c1-bb72258abe5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:10.165149 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a8b4e-09be-4cd6-b0c1-bb72258abe5b admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:10.179370 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 914/1808] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:06:10.184706 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a8b4e-09be-4cd6-b0c1-bb72258abe5b admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:10.194935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a8b4e-09be-4cd6-b0c1-bb72258abe5b admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:10.200215 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369e094-5f4d-4774-962b-3251407e23c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:10.201119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369e094-5f4d-4774-962b-3251407e23c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:10.201398 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369e094-5f4d-4774-962b-3251407e23c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:10.201674 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369e094-5f4d-4774-962b-3251407e23c5 admin admin] PATH_INFO: `/v3/projects/8a073f10e7d14dc696cad222233d99df/users/a521044065d74e8992bd69c9fa63be19/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:10.218535 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369e094-5f4d-4774-962b-3251407e23c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a073f10e7d14dc696cad222233d99df, user_id=a521044065d74e8992bd69c9fa63be19, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:10.219180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2a811-64ff-4bf4-a3fe-1aee9fc1bb00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:10.220629 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2a811-64ff-4bf4-a3fe-1aee9fc1bb00 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:10.221301 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369e094-5f4d-4774-962b-3251407e23c5 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:10.232170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 895/1809] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:10 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:10.242881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 915/1810] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:10 2022] PUT /identity/v3/projects/8a073f10e7d14dc696cad222233d99df/users/a521044065d74e8992bd69c9fa63be19/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:10.253746 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f21172-f760-4c0e-b88f-cf8c910aea42 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:10.254077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f21172-f760-4c0e-b88f-cf8c910aea42 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:10.254357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f21172-f760-4c0e-b88f-cf8c910aea42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:10.284546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-c7f21172-f760-4c0e-b88f-cf8c910aea42 None None] MFA Rules not processed for user `a521044065d74e8992bd69c9fa63be19`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:10.285813 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c7f21172-f760-4c0e-b88f-cf8c910aea42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:10.365467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 896/1811] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:10.369219 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369e094-5f4d-4774-962b-3251407e23c5 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:10.448700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369e094-5f4d-4774-962b-3251407e23c5 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:10.453556 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743551d1-983d-4d8f-b537-53fa07a0223d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:10.454228 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743551d1-983d-4d8f-b537-53fa07a0223d admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:10.454511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743551d1-983d-4d8f-b537-53fa07a0223d admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:10.454789 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743551d1-983d-4d8f-b537-53fa07a0223d admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:10.455517 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743551d1-983d-4d8f-b537-53fa07a0223d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:10.457429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743551d1-983d-4d8f-b537-53fa07a0223d admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:10.490300 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 916/1812] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:10 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:06:10.494385 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f21172-f760-4c0e-b88f-cf8c910aea42 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:10.505719 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f21172-f760-4c0e-b88f-cf8c910aea42 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:10.566740 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5fb9d-6dcb-45a1-b988-cbf07252720a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:10.567496 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5fb9d-6dcb-45a1-b988-cbf07252720a admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:10.567780 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5fb9d-6dcb-45a1-b988-cbf07252720a admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:10.568063 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5fb9d-6dcb-45a1-b988-cbf07252720a admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:10.568770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5fb9d-6dcb-45a1-b988-cbf07252720a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:10.570684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5fb9d-6dcb-45a1-b988-cbf07252720a admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:10.591885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 897/1813] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:10 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:10.595885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743551d1-983d-4d8f-b537-53fa07a0223d admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:10.606462 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743551d1-983d-4d8f-b537-53fa07a0223d admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:10.611233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e558a53-7166-4835-a8f7-28200e166f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:10.611841 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e558a53-7166-4835-a8f7-28200e166f72 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:10.612123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e558a53-7166-4835-a8f7-28200e166f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:10.612395 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e558a53-7166-4835-a8f7-28200e166f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:10.613120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e558a53-7166-4835-a8f7-28200e166f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:10.614722 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e558a53-7166-4835-a8f7-28200e166f72 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:10.625755 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 917/1814] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:10.630217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5fb9d-6dcb-45a1-b988-cbf07252720a admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:10.641728 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5fb9d-6dcb-45a1-b988-cbf07252720a admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:10.646478 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c1d31-08a3-410f-ada9-d5e2eea342ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:10.647464 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c1d31-08a3-410f-ada9-d5e2eea342ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:10.647760 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c1d31-08a3-410f-ada9-d5e2eea342ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:10.648026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c1d31-08a3-410f-ada9-d5e2eea342ae admin admin] PATH_INFO: `/v3/projects/b336359bfc9546c3b7669496f778de8d/users/ce18b8611b65448eadec1f2424cb97af/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:10.663921 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c1d31-08a3-410f-ada9-d5e2eea342ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b336359bfc9546c3b7669496f778de8d, user_id=ce18b8611b65448eadec1f2424cb97af, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:10.666588 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c1d31-08a3-410f-ada9-d5e2eea342ae admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:10.680824 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 898/1815] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:10 2022] PUT /identity/v3/projects/b336359bfc9546c3b7669496f778de8d/users/ce18b8611b65448eadec1f2424cb97af/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:06:10.685420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e558a53-7166-4835-a8f7-28200e166f72 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:10.695772 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e558a53-7166-4835-a8f7-28200e166f72 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:10.758882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec0b31-85b2-419f-abb8-f8be57add6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:10.759638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec0b31-85b2-419f-abb8-f8be57add6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:10.759917 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec0b31-85b2-419f-abb8-f8be57add6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:10.760186 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec0b31-85b2-419f-abb8-f8be57add6e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:10.760912 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec0b31-85b2-419f-abb8-f8be57add6e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:10.763080 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec0b31-85b2-419f-abb8-f8be57add6e4 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:10.773561 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 918/1816] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:06:10.778883 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c1d31-08a3-410f-ada9-d5e2eea342ae admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:10.789432 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c1d31-08a3-410f-ada9-d5e2eea342ae admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:10.794054 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e550f92-9fc0-44c5-916f-a9741ff423e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:10.794976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e550f92-9fc0-44c5-916f-a9741ff423e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:10.795262 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e550f92-9fc0-44c5-916f-a9741ff423e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:10.795533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e550f92-9fc0-44c5-916f-a9741ff423e7 admin admin] PATH_INFO: `/v3/projects/b336359bfc9546c3b7669496f778de8d/users/ce18b8611b65448eadec1f2424cb97af/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:10.797545 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e550f92-9fc0-44c5-916f-a9741ff423e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b336359bfc9546c3b7669496f778de8d, user_id=ce18b8611b65448eadec1f2424cb97af, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:10.800215 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e550f92-9fc0-44c5-916f-a9741ff423e7 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:10.811425 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 899/1817] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:10 2022] PUT /identity/v3/projects/b336359bfc9546c3b7669496f778de8d/users/ce18b8611b65448eadec1f2424cb97af/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:10.824313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aa811-b074-4b11-9709-6e5192f1eb7c None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:10.824595 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aa811-b074-4b11-9709-6e5192f1eb7c None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:10.824872 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aa811-b074-4b11-9709-6e5192f1eb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:10.852395 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-433aa811-b074-4b11-9709-6e5192f1eb7c None None] MFA Rules not processed for user `ce18b8611b65448eadec1f2424cb97af`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:10.853614 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-433aa811-b074-4b11-9709-6e5192f1eb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:10.931157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 919/1818] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:10.943649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e550f92-9fc0-44c5-916f-a9741ff423e7 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:11.007731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e550f92-9fc0-44c5-916f-a9741ff423e7 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:11.015526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d8c62-710a-43b3-a084-100e8da37e62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:11.016173 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d8c62-710a-43b3-a084-100e8da37e62 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:11.016451 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d8c62-710a-43b3-a084-100e8da37e62 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:11.016746 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d8c62-710a-43b3-a084-100e8da37e62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:11.026905 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d8c62-710a-43b3-a084-100e8da37e62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:11.028541 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d8c62-710a-43b3-a084-100e8da37e62 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:11.039993 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 900/1819] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:11.123250 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433aa811-b074-4b11-9709-6e5192f1eb7c None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:11.132736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433aa811-b074-4b11-9709-6e5192f1eb7c None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:11.136977 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ef755-9ec8-4620-8eb8-094649a310f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:11.137632 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ef755-9ec8-4620-8eb8-094649a310f1 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:11.137912 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ef755-9ec8-4620-8eb8-094649a310f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:11.138181 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ef755-9ec8-4620-8eb8-094649a310f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:11.215329 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ef755-9ec8-4620-8eb8-094649a310f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:11.218160 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ef755-9ec8-4620-8eb8-094649a310f1 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:11.232966 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 920/1820] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:13.302351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2232422-cd3d-40e6-a1e7-231538250272 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:13.302880 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2232422-cd3d-40e6-a1e7-231538250272 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:13.302880 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2232422-cd3d-40e6-a1e7-231538250272 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:13.304387 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 901/1821] 10.222.0.73 () {54 vars in 921 bytes} [Fri May 13 15:06:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 15:06:13.316376 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd38a74-acbf-4dbc-8997-a7b08a9ffe85 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:13.316925 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd38a74-acbf-4dbc-8997-a7b08a9ffe85 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:13.317010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd38a74-acbf-4dbc-8997-a7b08a9ffe85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:13.359353 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-3bd38a74-acbf-4dbc-8997-a7b08a9ffe85 None None] MFA Rules not processed for user `52d539202cfb40a48b231713e16a599a`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:13.360730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-3bd38a74-acbf-4dbc-8997-a7b08a9ffe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:13.559535 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 921/1822] 10.222.0.73 () {58 vars in 1018 bytes} [Fri May 13 15:06:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:13.656463 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2232422-cd3d-40e6-a1e7-231538250272 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:13.658919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c2232422-cd3d-40e6-a1e7-231538250272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:13.721817 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2232422-cd3d-40e6-a1e7-231538250272 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:13.736776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497f4dd-efdc-4a0c-af51-48c11002c6af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:13.737931 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497f4dd-efdc-4a0c-af51-48c11002c6af service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:13.738225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497f4dd-efdc-4a0c-af51-48c11002c6af service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:13.738504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497f4dd-efdc-4a0c-af51-48c11002c6af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:13.776036 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497f4dd-efdc-4a0c-af51-48c11002c6af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:13.778257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497f4dd-efdc-4a0c-af51-48c11002c6af service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:13.818039 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 902/1823] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:14.642256 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd38a74-acbf-4dbc-8997-a7b08a9ffe85 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:14.644699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-3bd38a74-acbf-4dbc-8997-a7b08a9ffe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:14.745973 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd38a74-acbf-4dbc-8997-a7b08a9ffe85 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:14.753253 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af9be3-2673-49bf-a1db-ca84c2a9b7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:14.754500 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af9be3-2673-49bf-a1db-ca84c2a9b7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:14.755076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af9be3-2673-49bf-a1db-ca84c2a9b7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:14.755567 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af9be3-2673-49bf-a1db-ca84c2a9b7e9 admin admin] PATH_INFO: `/v3/users/4b33f6327c3f43c29e6bfd726740b869` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:14.757067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af9be3-2673-49bf-a1db-ca84c2a9b7e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b33f6327c3f43c29e6bfd726740b869)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:14.759265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af9be3-2673-49bf-a1db-ca84c2a9b7e9 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:14.878180 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d0af9be3-2673-49bf-a1db-ca84c2a9b7e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b33f6327c3f43c29e6bfd726740b869'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:14.914995 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d0af9be3-2673-49bf-a1db-ca84c2a9b7e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b33f6327c3f43c29e6bfd726740b869'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:14.932431 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d0af9be3-2673-49bf-a1db-ca84c2a9b7e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b33f6327c3f43c29e6bfd726740b869'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:14.936162 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d0af9be3-2673-49bf-a1db-ca84c2a9b7e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b33f6327c3f43c29e6bfd726740b869'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:14.955581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d0af9be3-2673-49bf-a1db-ca84c2a9b7e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b33f6327c3f43c29e6bfd726740b869'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:15.000391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 922/1824] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:14 2022] DELETE /identity/v3/users/4b33f6327c3f43c29e6bfd726740b869 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:15.006864 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55021081-8ce2-4ed1-97b3-4eb7e19a1085 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:15.007366 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55021081-8ce2-4ed1-97b3-4eb7e19a1085 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:15.007440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55021081-8ce2-4ed1-97b3-4eb7e19a1085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:15.044271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-55021081-8ce2-4ed1-97b3-4eb7e19a1085 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:15.046312 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-55021081-8ce2-4ed1-97b3-4eb7e19a1085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:15.211500 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 903/1825] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:15.239265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af9be3-2673-49bf-a1db-ca84c2a9b7e9 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:15.243961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-d0af9be3-2673-49bf-a1db-ca84c2a9b7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:15.365397 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af9be3-2673-49bf-a1db-ca84c2a9b7e9 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:15.371526 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c1fa2-321f-40a3-800d-8bd189ca1560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:15.372889 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c1fa2-321f-40a3-800d-8bd189ca1560 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:15.373374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c1fa2-321f-40a3-800d-8bd189ca1560 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:15.373882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c1fa2-321f-40a3-800d-8bd189ca1560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:15.389145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c1fa2-321f-40a3-800d-8bd189ca1560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:15.391315 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c1fa2-321f-40a3-800d-8bd189ca1560 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:15.407374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 923/1826] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:16.207766 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55021081-8ce2-4ed1-97b3-4eb7e19a1085 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:16.211653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-55021081-8ce2-4ed1-97b3-4eb7e19a1085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:16.251179 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55021081-8ce2-4ed1-97b3-4eb7e19a1085 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:16.262635 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ffd15-b78f-4e6b-bcdb-715c637db67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:16.264301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ffd15-b78f-4e6b-bcdb-715c637db67a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:16.264653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ffd15-b78f-4e6b-bcdb-715c637db67a admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:16.265120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ffd15-b78f-4e6b-bcdb-715c637db67a admin admin] PATH_INFO: `/v3/projects/b18d74013d9046839354b379b5dab1b8` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:16.268416 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ffd15-b78f-4e6b-bcdb-715c637db67a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b18d74013d9046839354b379b5dab1b8)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:16.272970 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ffd15-b78f-4e6b-bcdb-715c637db67a admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:16.359576 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-768ffd15-b78f-4e6b-bcdb-715c637db67a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b18d74013d9046839354b379b5dab1b8', 'request_id': 'req-768ffd15-b78f-4e6b-bcdb-715c637db67a'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:16.367462 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-768ffd15-b78f-4e6b-bcdb-715c637db67a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b18d74013d9046839354b379b5dab1b8', 'request_id': 'req-768ffd15-b78f-4e6b-bcdb-715c637db67a'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:16.382288 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-768ffd15-b78f-4e6b-bcdb-715c637db67a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b18d74013d9046839354b379b5dab1b8', 'request_id': 'req-768ffd15-b78f-4e6b-bcdb-715c637db67a'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:16.402869 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-768ffd15-b78f-4e6b-bcdb-715c637db67a admin admin] The token cache is being invalidate because project b18d74013d9046839354b379b5dab1b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:16.403786 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-768ffd15-b78f-4e6b-bcdb-715c637db67a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:16.405089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-768ffd15-b78f-4e6b-bcdb-715c637db67a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:16.407780 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 904/1827] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:16 2022] DELETE /identity/v3/projects/b18d74013d9046839354b379b5dab1b8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:16.411934 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c1fa2-321f-40a3-800d-8bd189ca1560 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:16.422621 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c1fa2-321f-40a3-800d-8bd189ca1560 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:16.504840 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50924ada-55de-454f-a4ed-fcd8a6153a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:16.504840 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50924ada-55de-454f-a4ed-fcd8a6153a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:16.504840 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50924ada-55de-454f-a4ed-fcd8a6153a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:16.504840 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50924ada-55de-454f-a4ed-fcd8a6153a06 admin admin] PATH_INFO: `/v3/users/a0a9f51bbac84f7a973bf5ad77a3454b` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:16.505338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50924ada-55de-454f-a4ed-fcd8a6153a06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a9f51bbac84f7a973bf5ad77a3454b)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:16.505338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50924ada-55de-454f-a4ed-fcd8a6153a06 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:16.566780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-50924ada-55de-454f-a4ed-fcd8a6153a06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a9f51bbac84f7a973bf5ad77a3454b'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:16.581125 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-50924ada-55de-454f-a4ed-fcd8a6153a06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a9f51bbac84f7a973bf5ad77a3454b'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:16.583079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-50924ada-55de-454f-a4ed-fcd8a6153a06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a9f51bbac84f7a973bf5ad77a3454b'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:16.583764 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-50924ada-55de-454f-a4ed-fcd8a6153a06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a9f51bbac84f7a973bf5ad77a3454b'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:16.591547 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-50924ada-55de-454f-a4ed-fcd8a6153a06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a9f51bbac84f7a973bf5ad77a3454b'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:16.612412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 924/1828] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:16 2022] DELETE /identity/v3/users/a0a9f51bbac84f7a973bf5ad77a3454b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:17.116210 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ffd15-b78f-4e6b-bcdb-715c637db67a admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:17.117817 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-768ffd15-b78f-4e6b-bcdb-715c637db67a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:17.131745 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ffd15-b78f-4e6b-bcdb-715c637db67a admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:17.210643 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70494c53-1259-45ec-9303-163a87f70b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:17.211560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70494c53-1259-45ec-9303-163a87f70b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:17.211843 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70494c53-1259-45ec-9303-163a87f70b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:17.212115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70494c53-1259-45ec-9303-163a87f70b39 admin admin] PATH_INFO: `/v3/projects/cf55b4edbb104e8088d38f813b3455b6` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:17.213336 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70494c53-1259-45ec-9303-163a87f70b39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf55b4edbb104e8088d38f813b3455b6)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:17.215334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70494c53-1259-45ec-9303-163a87f70b39 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:17.262582 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-70494c53-1259-45ec-9303-163a87f70b39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf55b4edbb104e8088d38f813b3455b6', 'request_id': 'req-70494c53-1259-45ec-9303-163a87f70b39'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:17.268698 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-70494c53-1259-45ec-9303-163a87f70b39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf55b4edbb104e8088d38f813b3455b6', 'request_id': 'req-70494c53-1259-45ec-9303-163a87f70b39'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:17.274042 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-70494c53-1259-45ec-9303-163a87f70b39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf55b4edbb104e8088d38f813b3455b6', 'request_id': 'req-70494c53-1259-45ec-9303-163a87f70b39'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:17.286548 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-70494c53-1259-45ec-9303-163a87f70b39 admin admin] The token cache is being invalidate because project cf55b4edbb104e8088d38f813b3455b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:17.286852 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-70494c53-1259-45ec-9303-163a87f70b39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:17.287490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-70494c53-1259-45ec-9303-163a87f70b39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:17.289043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 905/1829] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:17 2022] DELETE /identity/v3/projects/cf55b4edbb104e8088d38f813b3455b6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:17.294588 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8c973-48ba-497c-9864-489b25b26d69 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:17.294910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8c973-48ba-497c-9864-489b25b26d69 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:17.295190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8c973-48ba-497c-9864-489b25b26d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:17.313561 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-eec8c973-48ba-497c-9864-489b25b26d69 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:17.314781 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-eec8c973-48ba-497c-9864-489b25b26d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:17.374794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 925/1830] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:17.383861 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f9eb5-8278-4309-b41b-7eb91080d49c None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:17.384076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f9eb5-8278-4309-b41b-7eb91080d49c None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:17.384354 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f9eb5-8278-4309-b41b-7eb91080d49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:17.403235 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-0a7f9eb5-8278-4309-b41b-7eb91080d49c None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:17.404551 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-0a7f9eb5-8278-4309-b41b-7eb91080d49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:17.412737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 906/1831] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:17.417688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8c973-48ba-497c-9864-489b25b26d69 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:17.427404 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8c973-48ba-497c-9864-489b25b26d69 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:17.432356 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11674a3c-4dff-4e25-a952-a551454c2703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:17.433587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11674a3c-4dff-4e25-a952-a551454c2703 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:17.433868 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11674a3c-4dff-4e25-a952-a551454c2703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:17.434144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11674a3c-4dff-4e25-a952-a551454c2703 admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:17.434908 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11674a3c-4dff-4e25-a952-a551454c2703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:06:17.435215 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11674a3c-4dff-4e25-a952-a551454c2703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:17.437026 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11674a3c-4dff-4e25-a952-a551454c2703 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:17.450382 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 926/1832] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:06:17.455063 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f9eb5-8278-4309-b41b-7eb91080d49c None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:17.465040 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f9eb5-8278-4309-b41b-7eb91080d49c None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:17.469900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc21774-25db-4486-bab1-1498d2ad4d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:17.470648 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc21774-25db-4486-bab1-1498d2ad4d12 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:17.471034 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc21774-25db-4486-bab1-1498d2ad4d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:17.471408 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc21774-25db-4486-bab1-1498d2ad4d12 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:17.472185 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc21774-25db-4486-bab1-1498d2ad4d12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:17.474181 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc21774-25db-4486-bab1-1498d2ad4d12 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:17.513027 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 907/1833] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:17 2022] POST /identity/v3/projects => generated 391 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:06:17.514291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11674a3c-4dff-4e25-a952-a551454c2703 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:17.524634 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11674a3c-4dff-4e25-a952-a551454c2703 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:17.587823 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba8150-e18e-40a4-ada3-b246df38b308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:17.589588 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba8150-e18e-40a4-ada3-b246df38b308 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:17.589588 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba8150-e18e-40a4-ada3-b246df38b308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:17.589588 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba8150-e18e-40a4-ada3-b246df38b308 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:17.589895 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba8150-e18e-40a4-ada3-b246df38b308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:17.591992 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba8150-e18e-40a4-ada3-b246df38b308 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:17.614865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 927/1834] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:17 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:17.618542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc21774-25db-4486-bab1-1498d2ad4d12 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:17.629567 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc21774-25db-4486-bab1-1498d2ad4d12 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:17.635765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0a4ce-7666-4685-8060-2265c9a07c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:17.637118 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0a4ce-7666-4685-8060-2265c9a07c6e admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:17.637552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0a4ce-7666-4685-8060-2265c9a07c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:17.637970 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0a4ce-7666-4685-8060-2265c9a07c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:17.639169 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0a4ce-7666-4685-8060-2265c9a07c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:17.641287 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0a4ce-7666-4685-8060-2265c9a07c6e admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:17.652159 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 908/1835] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:17.656620 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba8150-e18e-40a4-ada3-b246df38b308 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:17.666594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba8150-e18e-40a4-ada3-b246df38b308 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:17.671836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79308c64-8310-45f3-ab1f-42d4a784892f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:17.672540 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79308c64-8310-45f3-ab1f-42d4a784892f admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:17.672816 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79308c64-8310-45f3-ab1f-42d4a784892f admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:17.673093 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79308c64-8310-45f3-ab1f-42d4a784892f admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:17.673820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79308c64-8310-45f3-ab1f-42d4a784892f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:17.675451 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79308c64-8310-45f3-ab1f-42d4a784892f admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:17.686927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 928/1836] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:17.691041 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0a4ce-7666-4685-8060-2265c9a07c6e admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:17.701896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0a4ce-7666-4685-8060-2265c9a07c6e admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:17.706975 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5845239-9c34-44ee-94c0-1d9d967675f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:17.708319 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5845239-9c34-44ee-94c0-1d9d967675f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:17.708319 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5845239-9c34-44ee-94c0-1d9d967675f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:17.708597 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5845239-9c34-44ee-94c0-1d9d967675f1 admin admin] PATH_INFO: `/v3/projects/75ef4f5141f44370b5c42a39dba324f1/users/b139dd6ca0c1478a8c966d402551782e/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:17.724625 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5845239-9c34-44ee-94c0-1d9d967675f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75ef4f5141f44370b5c42a39dba324f1, user_id=b139dd6ca0c1478a8c966d402551782e, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:17.730768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5845239-9c34-44ee-94c0-1d9d967675f1 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:17.744381 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 909/1837] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:17 2022] PUT /identity/v3/projects/75ef4f5141f44370b5c42a39dba324f1/users/b139dd6ca0c1478a8c966d402551782e/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:17.754780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8215ff-90e0-425b-9b52-50638e6d671d None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:17.755131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8215ff-90e0-425b-9b52-50638e6d671d None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:17.755413 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8215ff-90e0-425b-9b52-50638e6d671d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:17.782881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-db8215ff-90e0-425b-9b52-50638e6d671d None None] MFA Rules not processed for user `b139dd6ca0c1478a8c966d402551782e`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:17.784109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-db8215ff-90e0-425b-9b52-50638e6d671d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:17.852849 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 929/1838] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:17.857917 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5845239-9c34-44ee-94c0-1d9d967675f1 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:17.924477 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5845239-9c34-44ee-94c0-1d9d967675f1 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:17.929275 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95e310-e730-45d6-86d2-1ff77a87d62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:17.930221 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95e310-e730-45d6-86d2-1ff77a87d62c admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:17.930516 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95e310-e730-45d6-86d2-1ff77a87d62c admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:17.930795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95e310-e730-45d6-86d2-1ff77a87d62c admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:17.931612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95e310-e730-45d6-86d2-1ff77a87d62c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:17.933669 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95e310-e730-45d6-86d2-1ff77a87d62c admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:17.962505 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 910/1839] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:17 2022] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:17.966745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8215ff-90e0-425b-9b52-50638e6d671d None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:17.978654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8215ff-90e0-425b-9b52-50638e6d671d None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:18.036782 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a1355-026f-4fab-84f7-6d1c19b4a032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:18.037468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a1355-026f-4fab-84f7-6d1c19b4a032 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:18.037754 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a1355-026f-4fab-84f7-6d1c19b4a032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:18.038033 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a1355-026f-4fab-84f7-6d1c19b4a032 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:18.038726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a1355-026f-4fab-84f7-6d1c19b4a032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:18.040678 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a1355-026f-4fab-84f7-6d1c19b4a032 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:18.064458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 930/1840] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:17 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:18.065692 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95e310-e730-45d6-86d2-1ff77a87d62c admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:18.077275 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95e310-e730-45d6-86d2-1ff77a87d62c admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:18.082263 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec316c-f008-4e35-92f4-b8d7b8248262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:18.082967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec316c-f008-4e35-92f4-b8d7b8248262 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:18.083282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec316c-f008-4e35-92f4-b8d7b8248262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:18.083532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec316c-f008-4e35-92f4-b8d7b8248262 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:18.084277 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec316c-f008-4e35-92f4-b8d7b8248262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:18.085888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec316c-f008-4e35-92f4-b8d7b8248262 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:18.097886 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 911/1841] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:18.102326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a1355-026f-4fab-84f7-6d1c19b4a032 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:18.114164 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a1355-026f-4fab-84f7-6d1c19b4a032 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:18.119631 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df088ae-c30f-4598-81d9-6ed470ba699a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:18.120690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df088ae-c30f-4598-81d9-6ed470ba699a admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:18.121042 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df088ae-c30f-4598-81d9-6ed470ba699a admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:18.121387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df088ae-c30f-4598-81d9-6ed470ba699a admin admin] PATH_INFO: `/v3/projects/55537934373244a7811faa37c4200e8d/users/9465969eccd74b98af13e01f1337790e/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:18.137513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df088ae-c30f-4598-81d9-6ed470ba699a admin admin] RBAC: Authorizing `identity:create_grant(project_id=55537934373244a7811faa37c4200e8d, user_id=9465969eccd74b98af13e01f1337790e, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:18.141011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df088ae-c30f-4598-81d9-6ed470ba699a admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:18.155297 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 931/1842] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:18 2022] PUT /identity/v3/projects/55537934373244a7811faa37c4200e8d/users/9465969eccd74b98af13e01f1337790e/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:18.160147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec316c-f008-4e35-92f4-b8d7b8248262 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:18.178228 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec316c-f008-4e35-92f4-b8d7b8248262 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:18.247256 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031280f-92b7-4732-826e-b757fb081440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:18.248062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031280f-92b7-4732-826e-b757fb081440 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:18.248442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031280f-92b7-4732-826e-b757fb081440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:18.248785 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031280f-92b7-4732-826e-b757fb081440 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:18.249580 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031280f-92b7-4732-826e-b757fb081440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:18.251553 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031280f-92b7-4732-826e-b757fb081440 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:18.266647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 912/1843] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:18.268606 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df088ae-c30f-4598-81d9-6ed470ba699a admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:18.286956 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df088ae-c30f-4598-81d9-6ed470ba699a admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:18.292240 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8a64e-f2f1-4bee-88a4-6351c48f48a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:18.293196 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8a64e-f2f1-4bee-88a4-6351c48f48a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:18.293477 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8a64e-f2f1-4bee-88a4-6351c48f48a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:18.293754 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8a64e-f2f1-4bee-88a4-6351c48f48a2 admin admin] PATH_INFO: `/v3/projects/55537934373244a7811faa37c4200e8d/users/9465969eccd74b98af13e01f1337790e/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:18.295898 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8a64e-f2f1-4bee-88a4-6351c48f48a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55537934373244a7811faa37c4200e8d, user_id=9465969eccd74b98af13e01f1337790e, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:18.298555 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8a64e-f2f1-4bee-88a4-6351c48f48a2 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:18.310085 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 932/1844] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:18 2022] PUT /identity/v3/projects/55537934373244a7811faa37c4200e8d/users/9465969eccd74b98af13e01f1337790e/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:18.321885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636f001-b770-4830-877d-05e1cd8bf4a6 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:18.322399 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636f001-b770-4830-877d-05e1cd8bf4a6 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:18.322678 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636f001-b770-4830-877d-05e1cd8bf4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:18.354460 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-9636f001-b770-4830-877d-05e1cd8bf4a6 None None] MFA Rules not processed for user `9465969eccd74b98af13e01f1337790e`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:18.355711 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-9636f001-b770-4830-877d-05e1cd8bf4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:18.440990 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 913/1845] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:18.452617 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8a64e-f2f1-4bee-88a4-6351c48f48a2 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:18.454361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-d6f8a64e-f2f1-4bee-88a4-6351c48f48a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:18.514379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8a64e-f2f1-4bee-88a4-6351c48f48a2 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:18.520843 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51d2fc-7470-4914-afc9-2641284732f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:18.521501 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51d2fc-7470-4914-afc9-2641284732f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:18.521783 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51d2fc-7470-4914-afc9-2641284732f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:18.522061 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51d2fc-7470-4914-afc9-2641284732f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:18.531752 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51d2fc-7470-4914-afc9-2641284732f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:18.533192 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51d2fc-7470-4914-afc9-2641284732f0 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:18.543053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 933/1846] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:18.600292 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636f001-b770-4830-877d-05e1cd8bf4a6 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:18.601676 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-9636f001-b770-4830-877d-05e1cd8bf4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:18.613249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636f001-b770-4830-877d-05e1cd8bf4a6 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:18.616837 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8dba0-db6d-4fbc-84cb-b0f240e02bc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:18.617474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8dba0-db6d-4fbc-84cb-b0f240e02bc0 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:18.617759 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8dba0-db6d-4fbc-84cb-b0f240e02bc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:18.618035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8dba0-db6d-4fbc-84cb-b0f240e02bc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:18.676546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8dba0-db6d-4fbc-84cb-b0f240e02bc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:18.678160 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8dba0-db6d-4fbc-84cb-b0f240e02bc0 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:18.688893 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 914/1847] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:28.340595 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51d2fc-7470-4914-afc9-2641284732f0 service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:28.342044 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-aa51d2fc-7470-4914-afc9-2641284732f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:28.485523 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51d2fc-7470-4914-afc9-2641284732f0 service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:28.496533 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4e015-857a-4872-94fc-907c3f447fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:28.497656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4e015-857a-4872-94fc-907c3f447fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:28.498091 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4e015-857a-4872-94fc-907c3f447fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:28.498509 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4e015-857a-4872-94fc-907c3f447fbd admin admin] PATH_INFO: `/v3/users/4b60c3609240460dabca0ba6c3428fbf` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:28.500037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4e015-857a-4872-94fc-907c3f447fbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b60c3609240460dabca0ba6c3428fbf)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:28.502690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4e015-857a-4872-94fc-907c3f447fbd admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:28.602159 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7db4e015-857a-4872-94fc-907c3f447fbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b60c3609240460dabca0ba6c3428fbf'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:28.648574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7db4e015-857a-4872-94fc-907c3f447fbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b60c3609240460dabca0ba6c3428fbf'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:28.649746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7db4e015-857a-4872-94fc-907c3f447fbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b60c3609240460dabca0ba6c3428fbf'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:28.654265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7db4e015-857a-4872-94fc-907c3f447fbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b60c3609240460dabca0ba6c3428fbf'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:28.663679 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7db4e015-857a-4872-94fc-907c3f447fbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b60c3609240460dabca0ba6c3428fbf'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:28.680779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 934/1848] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:28 2022] DELETE /identity/v3/users/4b60c3609240460dabca0ba6c3428fbf => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:28.685554 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462530a-e0ba-483c-9dcd-f2ee3131792e None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:28.686316 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462530a-e0ba-483c-9dcd-f2ee3131792e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:28.686316 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462530a-e0ba-483c-9dcd-f2ee3131792e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:28.711877 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-9462530a-e0ba-483c-9dcd-f2ee3131792e None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:28.714982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-9462530a-e0ba-483c-9dcd-f2ee3131792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:28.823269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 915/1849] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:28.830287 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4e015-857a-4872-94fc-907c3f447fbd admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:28.832488 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-7db4e015-857a-4872-94fc-907c3f447fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:28.964692 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4e015-857a-4872-94fc-907c3f447fbd admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:28.973625 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afc155-1738-4141-815c-ba08be18c0b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:28.975040 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afc155-1738-4141-815c-ba08be18c0b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:28.975616 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afc155-1738-4141-815c-ba08be18c0b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:28.976032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afc155-1738-4141-815c-ba08be18c0b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:28.992989 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afc155-1738-4141-815c-ba08be18c0b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:28.996418 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afc155-1738-4141-815c-ba08be18c0b3 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:29.021894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 935/1850] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:29.439180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462530a-e0ba-483c-9dcd-f2ee3131792e None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:29.441322 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-9462530a-e0ba-483c-9dcd-f2ee3131792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:29.464836 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462530a-e0ba-483c-9dcd-f2ee3131792e None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:29.475492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bb261-5a1d-49c9-a7b8-e5ea0edd1253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:29.476835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bb261-5a1d-49c9-a7b8-e5ea0edd1253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:29.477193 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bb261-5a1d-49c9-a7b8-e5ea0edd1253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:29.477495 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bb261-5a1d-49c9-a7b8-e5ea0edd1253 admin admin] PATH_INFO: `/v3/projects/5a1fe4ba99994a92899e2387dc43edcc` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:29.478927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bb261-5a1d-49c9-a7b8-e5ea0edd1253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a1fe4ba99994a92899e2387dc43edcc)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:29.480848 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bb261-5a1d-49c9-a7b8-e5ea0edd1253 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:29.539318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-308bb261-5a1d-49c9-a7b8-e5ea0edd1253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a1fe4ba99994a92899e2387dc43edcc', 'request_id': 'req-308bb261-5a1d-49c9-a7b8-e5ea0edd1253'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:29.550992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-308bb261-5a1d-49c9-a7b8-e5ea0edd1253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a1fe4ba99994a92899e2387dc43edcc', 'request_id': 'req-308bb261-5a1d-49c9-a7b8-e5ea0edd1253'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:29.561664 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-308bb261-5a1d-49c9-a7b8-e5ea0edd1253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a1fe4ba99994a92899e2387dc43edcc', 'request_id': 'req-308bb261-5a1d-49c9-a7b8-e5ea0edd1253'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:29.578532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-308bb261-5a1d-49c9-a7b8-e5ea0edd1253 admin admin] The token cache is being invalidate because project 5a1fe4ba99994a92899e2387dc43edcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:29.578834 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-308bb261-5a1d-49c9-a7b8-e5ea0edd1253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:29.579500 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-308bb261-5a1d-49c9-a7b8-e5ea0edd1253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:29.581084 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 916/1851] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:29 2022] DELETE /identity/v3/projects/5a1fe4ba99994a92899e2387dc43edcc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:29.585365 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afc155-1738-4141-815c-ba08be18c0b3 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:29.596042 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afc155-1738-4141-815c-ba08be18c0b3 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:29.660360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d4afc-c6e5-4427-837b-7d8f213e4114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:29.661319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d4afc-c6e5-4427-837b-7d8f213e4114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:29.661712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d4afc-c6e5-4427-837b-7d8f213e4114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:29.662115 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d4afc-c6e5-4427-837b-7d8f213e4114 admin admin] PATH_INFO: `/v3/users/17c9057e0f404297813e7d4c0e906e0b` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:29.663566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d4afc-c6e5-4427-837b-7d8f213e4114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17c9057e0f404297813e7d4c0e906e0b)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:29.666094 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d4afc-c6e5-4427-837b-7d8f213e4114 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:29.730231 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-978d4afc-c6e5-4427-837b-7d8f213e4114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17c9057e0f404297813e7d4c0e906e0b'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:29.743400 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-978d4afc-c6e5-4427-837b-7d8f213e4114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17c9057e0f404297813e7d4c0e906e0b'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:29.744174 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-978d4afc-c6e5-4427-837b-7d8f213e4114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17c9057e0f404297813e7d4c0e906e0b'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:29.744824 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-978d4afc-c6e5-4427-837b-7d8f213e4114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17c9057e0f404297813e7d4c0e906e0b'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:29.753759 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-978d4afc-c6e5-4427-837b-7d8f213e4114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17c9057e0f404297813e7d4c0e906e0b'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:29.769959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 936/1852] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:29 2022] DELETE /identity/v3/users/17c9057e0f404297813e7d4c0e906e0b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:30.153981 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bb261-5a1d-49c9-a7b8-e5ea0edd1253 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:30.155582 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-308bb261-5a1d-49c9-a7b8-e5ea0edd1253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:30.283338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bb261-5a1d-49c9-a7b8-e5ea0edd1253 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:30.349393 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6e2c6-1ed0-4bb8-9505-4dec28b93fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:30.350276 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6e2c6-1ed0-4bb8-9505-4dec28b93fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:30.350560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6e2c6-1ed0-4bb8-9505-4dec28b93fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:30.350880 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6e2c6-1ed0-4bb8-9505-4dec28b93fbc admin admin] PATH_INFO: `/v3/projects/371a12f2996040779fc633a49d998df1` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:30.352126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6e2c6-1ed0-4bb8-9505-4dec28b93fbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=371a12f2996040779fc633a49d998df1)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:30.354622 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6e2c6-1ed0-4bb8-9505-4dec28b93fbc admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:30.405813 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9cf6e2c6-1ed0-4bb8-9505-4dec28b93fbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '371a12f2996040779fc633a49d998df1', 'request_id': 'req-9cf6e2c6-1ed0-4bb8-9505-4dec28b93fbc'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:30.412920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9cf6e2c6-1ed0-4bb8-9505-4dec28b93fbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '371a12f2996040779fc633a49d998df1', 'request_id': 'req-9cf6e2c6-1ed0-4bb8-9505-4dec28b93fbc'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:30.419537 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9cf6e2c6-1ed0-4bb8-9505-4dec28b93fbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '371a12f2996040779fc633a49d998df1', 'request_id': 'req-9cf6e2c6-1ed0-4bb8-9505-4dec28b93fbc'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:30.434135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9cf6e2c6-1ed0-4bb8-9505-4dec28b93fbc admin admin] The token cache is being invalidate because project 371a12f2996040779fc633a49d998df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:30.434427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9cf6e2c6-1ed0-4bb8-9505-4dec28b93fbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:30.435109 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9cf6e2c6-1ed0-4bb8-9505-4dec28b93fbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:30.436707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 917/1853] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:30 2022] DELETE /identity/v3/projects/371a12f2996040779fc633a49d998df1 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:30.442256 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75be47-d68e-4085-8986-2efdcb3dcba9 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:30.442579 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75be47-d68e-4085-8986-2efdcb3dcba9 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:30.442961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75be47-d68e-4085-8986-2efdcb3dcba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:30.502802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-4d75be47-d68e-4085-8986-2efdcb3dcba9 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:30.504427 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-4d75be47-d68e-4085-8986-2efdcb3dcba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:30.588809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 937/1854] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:30.596577 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0f327-85b8-4d54-8e40-236aceca472e None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:30.596843 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0f327-85b8-4d54-8e40-236aceca472e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:30.597119 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0f327-85b8-4d54-8e40-236aceca472e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:30.616883 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-1ea0f327-85b8-4d54-8e40-236aceca472e None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:30.618105 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-1ea0f327-85b8-4d54-8e40-236aceca472e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:30.628870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 918/1855] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:30.634275 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75be47-d68e-4085-8986-2efdcb3dcba9 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:30.645544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75be47-d68e-4085-8986-2efdcb3dcba9 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:30.650515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255e79b-93cc-4433-87ed-eb06bef7462d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:30.651353 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255e79b-93cc-4433-87ed-eb06bef7462d admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:30.651653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255e79b-93cc-4433-87ed-eb06bef7462d admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:30.651934 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255e79b-93cc-4433-87ed-eb06bef7462d admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:30.652711 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255e79b-93cc-4433-87ed-eb06bef7462d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:06:30.653022 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255e79b-93cc-4433-87ed-eb06bef7462d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:30.654722 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255e79b-93cc-4433-87ed-eb06bef7462d admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:30.673934 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 938/1856] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:06:30.675287 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0f327-85b8-4d54-8e40-236aceca472e None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:30.686308 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0f327-85b8-4d54-8e40-236aceca472e None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:30.691486 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83a2fd-65c2-401a-a742-3515bed88ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:30.692163 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83a2fd-65c2-401a-a742-3515bed88ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:30.692447 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83a2fd-65c2-401a-a742-3515bed88ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:30.692935 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83a2fd-65c2-401a-a742-3515bed88ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:30.693664 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83a2fd-65c2-401a-a742-3515bed88ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:30.696389 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83a2fd-65c2-401a-a742-3515bed88ef6 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:30.726739 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 919/1857] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:30 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:06:30.731509 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255e79b-93cc-4433-87ed-eb06bef7462d admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:30.742515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255e79b-93cc-4433-87ed-eb06bef7462d admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:30.805769 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57193fa0-04a5-4618-999a-779049af97d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:30.806459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57193fa0-04a5-4618-999a-779049af97d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:30.806751 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57193fa0-04a5-4618-999a-779049af97d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:30.807663 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57193fa0-04a5-4618-999a-779049af97d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:30.808382 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57193fa0-04a5-4618-999a-779049af97d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:30.810343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57193fa0-04a5-4618-999a-779049af97d2 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:30.833043 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 939/1858] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:30 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:30.837729 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83a2fd-65c2-401a-a742-3515bed88ef6 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:30.848789 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83a2fd-65c2-401a-a742-3515bed88ef6 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:30.853537 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58127fac-1671-49c0-9150-c7df90758dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:30.854851 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58127fac-1671-49c0-9150-c7df90758dfe admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:30.855190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58127fac-1671-49c0-9150-c7df90758dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:30.855503 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58127fac-1671-49c0-9150-c7df90758dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:30.856279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58127fac-1671-49c0-9150-c7df90758dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:30.857975 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58127fac-1671-49c0-9150-c7df90758dfe admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:30.874062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 920/1859] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:30.879331 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57193fa0-04a5-4618-999a-779049af97d2 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:30.903505 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57193fa0-04a5-4618-999a-779049af97d2 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:30.910786 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2aacdc-63ab-485a-bd94-042f48b3c188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:30.911628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aacdc-63ab-485a-bd94-042f48b3c188 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:30.912018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aacdc-63ab-485a-bd94-042f48b3c188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:30.912397 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aacdc-63ab-485a-bd94-042f48b3c188 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:30.913252 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2aacdc-63ab-485a-bd94-042f48b3c188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:30.915970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2aacdc-63ab-485a-bd94-042f48b3c188 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:30.935145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 940/1860] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:30.940684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58127fac-1671-49c0-9150-c7df90758dfe admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:30.965269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58127fac-1671-49c0-9150-c7df90758dfe admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:30.971291 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7ad55-c5d2-49e8-b77a-51de96343a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:30.972447 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7ad55-c5d2-49e8-b77a-51de96343a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:30.972858 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7ad55-c5d2-49e8-b77a-51de96343a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:30.973239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7ad55-c5d2-49e8-b77a-51de96343a5e admin admin] PATH_INFO: `/v3/projects/f637d5e978a14c91b7a399e28d338ec6/users/2e9ce73e3aa746bf9550046f53c7b770/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:30.993955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7ad55-c5d2-49e8-b77a-51de96343a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f637d5e978a14c91b7a399e28d338ec6, user_id=2e9ce73e3aa746bf9550046f53c7b770, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:30.999726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7ad55-c5d2-49e8-b77a-51de96343a5e admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:31.024165 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 921/1861] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:30 2022] PUT /identity/v3/projects/f637d5e978a14c91b7a399e28d338ec6/users/2e9ce73e3aa746bf9550046f53c7b770/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:31.037221 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c342f0-899a-477a-bf42-d8ea78a01b0c None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:31.037494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c342f0-899a-477a-bf42-d8ea78a01b0c None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:31.037777 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c342f0-899a-477a-bf42-d8ea78a01b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:31.070614 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-74c342f0-899a-477a-bf42-d8ea78a01b0c None None] MFA Rules not processed for user `2e9ce73e3aa746bf9550046f53c7b770`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:31.072953 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-74c342f0-899a-477a-bf42-d8ea78a01b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:31.185728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 941/1862] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:31.216260 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7ad55-c5d2-49e8-b77a-51de96343a5e admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:31.218173 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-a8d7ad55-c5d2-49e8-b77a-51de96343a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:31.312656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7ad55-c5d2-49e8-b77a-51de96343a5e admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:31.316624 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3387ad0-6324-4ada-a147-fccd0b7f2a9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:31.317355 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3387ad0-6324-4ada-a147-fccd0b7f2a9c service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:31.317645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3387ad0-6324-4ada-a147-fccd0b7f2a9c service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:31.317924 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3387ad0-6324-4ada-a147-fccd0b7f2a9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:31.327974 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3387ad0-6324-4ada-a147-fccd0b7f2a9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:31.329400 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3387ad0-6324-4ada-a147-fccd0b7f2a9c service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:31.340057 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 922/1863] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:34.874623 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c342f0-899a-477a-bf42-d8ea78a01b0c None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:34.876926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-74c342f0-899a-477a-bf42-d8ea78a01b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:35.151965 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c342f0-899a-477a-bf42-d8ea78a01b0c None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:35.175707 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b7785-bfa7-464e-b504-b016148cea9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:35.177253 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b7785-bfa7-464e-b504-b016148cea9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:35.177765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b7785-bfa7-464e-b504-b016148cea9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:35.178272 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b7785-bfa7-464e-b504-b016148cea9b admin admin] PATH_INFO: `/v3/users/b139dd6ca0c1478a8c966d402551782e` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:35.183036 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b7785-bfa7-464e-b504-b016148cea9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b139dd6ca0c1478a8c966d402551782e)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:35.186992 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b7785-bfa7-464e-b504-b016148cea9b admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:35.333468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ba1b7785-bfa7-464e-b504-b016148cea9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b139dd6ca0c1478a8c966d402551782e'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:35.427969 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ba1b7785-bfa7-464e-b504-b016148cea9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b139dd6ca0c1478a8c966d402551782e'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:35.433163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ba1b7785-bfa7-464e-b504-b016148cea9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b139dd6ca0c1478a8c966d402551782e'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:35.443372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ba1b7785-bfa7-464e-b504-b016148cea9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b139dd6ca0c1478a8c966d402551782e'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:35.484655 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ba1b7785-bfa7-464e-b504-b016148cea9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b139dd6ca0c1478a8c966d402551782e'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:35.513247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 942/1864] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:34 2022] DELETE /identity/v3/users/b139dd6ca0c1478a8c966d402551782e => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:06:35.515087 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e94331-2300-463f-96e4-b8329d080609 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:35.515529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e94331-2300-463f-96e4-b8329d080609 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:35.515639 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e94331-2300-463f-96e4-b8329d080609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:35.561763 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-94e94331-2300-463f-96e4-b8329d080609 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:35.564130 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-94e94331-2300-463f-96e4-b8329d080609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:35.677476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 923/1865] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:35.692436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b7785-bfa7-464e-b504-b016148cea9b admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:35.694503 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ba1b7785-bfa7-464e-b504-b016148cea9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:35.836353 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b7785-bfa7-464e-b504-b016148cea9b admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:35.845494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3db71-ae28-48c3-886c-b44f91002058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:35.847377 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3db71-ae28-48c3-886c-b44f91002058 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:35.847945 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3db71-ae28-48c3-886c-b44f91002058 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:35.848434 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3db71-ae28-48c3-886c-b44f91002058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:35.862300 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3db71-ae28-48c3-886c-b44f91002058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:35.864256 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3db71-ae28-48c3-886c-b44f91002058 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:35.879273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 943/1866] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:36.276593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50e974-b33f-41d9-9e7b-2d210b39f013 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:36.277501 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50e974-b33f-41d9-9e7b-2d210b39f013 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:36.278357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50e974-b33f-41d9-9e7b-2d210b39f013 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:36.282462 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 924/1867] 10.222.0.73 () {54 vars in 921 bytes} [Fri May 13 15:06:36 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 15:06:36.310090 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2806d6-554f-4ff5-bb8b-8c8bd1395158 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:36.310381 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2806d6-554f-4ff5-bb8b-8c8bd1395158 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:36.310664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2806d6-554f-4ff5-bb8b-8c8bd1395158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:36.383381 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-ad2806d6-554f-4ff5-bb8b-8c8bd1395158 None None] MFA Rules not processed for user `52d539202cfb40a48b231713e16a599a`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:36.386885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ad2806d6-554f-4ff5-bb8b-8c8bd1395158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:36.579720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 944/1868] 10.222.0.73 () {58 vars in 1018 bytes} [Fri May 13 15:06:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:36.788635 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50e974-b33f-41d9-9e7b-2d210b39f013 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:36.791986 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-9f50e974-b33f-41d9-9e7b-2d210b39f013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:36.814380 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50e974-b33f-41d9-9e7b-2d210b39f013 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:36.825319 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707eb4a-547e-403c-9b87-2c991abd418d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:36.826282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707eb4a-547e-403c-9b87-2c991abd418d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:36.827088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707eb4a-547e-403c-9b87-2c991abd418d admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:36.827783 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707eb4a-547e-403c-9b87-2c991abd418d admin admin] PATH_INFO: `/v3/projects/75ef4f5141f44370b5c42a39dba324f1` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:36.832507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707eb4a-547e-403c-9b87-2c991abd418d admin admin] RBAC: Authorizing `identity:delete_project(project_id=75ef4f5141f44370b5c42a39dba324f1)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:36.837744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707eb4a-547e-403c-9b87-2c991abd418d admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:36.873965 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2806d6-554f-4ff5-bb8b-8c8bd1395158 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:36.877221 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ad2806d6-554f-4ff5-bb8b-8c8bd1395158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:36.905254 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2806d6-554f-4ff5-bb8b-8c8bd1395158 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:36.924852 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e7a22-5f35-41cd-8ecb-ce38471aa853 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:36.925737 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e7a22-5f35-41cd-8ecb-ce38471aa853 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:36.926146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e7a22-5f35-41cd-8ecb-ce38471aa853 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:36.926669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e7a22-5f35-41cd-8ecb-ce38471aa853 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:36.947406 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e7a22-5f35-41cd-8ecb-ce38471aa853 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:36.954353 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e7a22-5f35-41cd-8ecb-ce38471aa853 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:36.963034 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4707eb4a-547e-403c-9b87-2c991abd418d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75ef4f5141f44370b5c42a39dba324f1', 'request_id': 'req-4707eb4a-547e-403c-9b87-2c991abd418d'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:36.978165 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4707eb4a-547e-403c-9b87-2c991abd418d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75ef4f5141f44370b5c42a39dba324f1', 'request_id': 'req-4707eb4a-547e-403c-9b87-2c991abd418d'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:36.983025 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 945/1869] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:36.993809 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4707eb4a-547e-403c-9b87-2c991abd418d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75ef4f5141f44370b5c42a39dba324f1', 'request_id': 'req-4707eb4a-547e-403c-9b87-2c991abd418d'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:37.025800 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4707eb4a-547e-403c-9b87-2c991abd418d admin admin] The token cache is being invalidate because project 75ef4f5141f44370b5c42a39dba324f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:37.026093 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4707eb4a-547e-403c-9b87-2c991abd418d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:37.027414 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4707eb4a-547e-403c-9b87-2c991abd418d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:37.032279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 925/1870] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:36 2022] DELETE /identity/v3/projects/75ef4f5141f44370b5c42a39dba324f1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:37.033451 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e7a22-5f35-41cd-8ecb-ce38471aa853 service nova] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:37.050602 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e7a22-5f35-41cd-8ecb-ce38471aa853 service nova] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:37.146581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b49b8-8312-4ddf-9e36-359a365e3bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:37.148056 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b49b8-8312-4ddf-9e36-359a365e3bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:37.148504 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b49b8-8312-4ddf-9e36-359a365e3bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:37.148945 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b49b8-8312-4ddf-9e36-359a365e3bd4 admin admin] PATH_INFO: `/v3/users/9465969eccd74b98af13e01f1337790e` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:37.151215 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b49b8-8312-4ddf-9e36-359a365e3bd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9465969eccd74b98af13e01f1337790e)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:37.154380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b49b8-8312-4ddf-9e36-359a365e3bd4 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:37.219816 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2c2b49b8-8312-4ddf-9e36-359a365e3bd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9465969eccd74b98af13e01f1337790e'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:37.234208 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2c2b49b8-8312-4ddf-9e36-359a365e3bd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9465969eccd74b98af13e01f1337790e'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:37.234921 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2c2b49b8-8312-4ddf-9e36-359a365e3bd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9465969eccd74b98af13e01f1337790e'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:37.235539 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2c2b49b8-8312-4ddf-9e36-359a365e3bd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9465969eccd74b98af13e01f1337790e'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:37.243680 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2c2b49b8-8312-4ddf-9e36-359a365e3bd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9465969eccd74b98af13e01f1337790e'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:37.263801 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 946/1871] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:37 2022] DELETE /identity/v3/users/9465969eccd74b98af13e01f1337790e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:37.494210 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707eb4a-547e-403c-9b87-2c991abd418d admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:37.496154 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-4707eb4a-547e-403c-9b87-2c991abd418d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:37.514374 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707eb4a-547e-403c-9b87-2c991abd418d admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:37.595537 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c3119-856b-4a6b-900a-ebcfc1f12fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:37.595537 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c3119-856b-4a6b-900a-ebcfc1f12fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:37.595537 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c3119-856b-4a6b-900a-ebcfc1f12fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:37.595537 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c3119-856b-4a6b-900a-ebcfc1f12fa2 admin admin] PATH_INFO: `/v3/users/2e9ce73e3aa746bf9550046f53c7b770` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:37.596179 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c3119-856b-4a6b-900a-ebcfc1f12fa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9ce73e3aa746bf9550046f53c7b770)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:37.597687 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c3119-856b-4a6b-900a-ebcfc1f12fa2 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:37.677172 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-366c3119-856b-4a6b-900a-ebcfc1f12fa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9ce73e3aa746bf9550046f53c7b770'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:37.689640 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-366c3119-856b-4a6b-900a-ebcfc1f12fa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9ce73e3aa746bf9550046f53c7b770'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:37.716328 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-366c3119-856b-4a6b-900a-ebcfc1f12fa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9ce73e3aa746bf9550046f53c7b770'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:37.717143 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-366c3119-856b-4a6b-900a-ebcfc1f12fa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9ce73e3aa746bf9550046f53c7b770'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:37.726190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-366c3119-856b-4a6b-900a-ebcfc1f12fa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9ce73e3aa746bf9550046f53c7b770'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:37.746217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 926/1872] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:37 2022] DELETE /identity/v3/users/2e9ce73e3aa746bf9550046f53c7b770 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:37.747474 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b49b8-8312-4ddf-9e36-359a365e3bd4 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:37.748317 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad9d11-f6b9-4bbe-82a3-7e690808034d None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:37.748662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad9d11-f6b9-4bbe-82a3-7e690808034d None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:37.748880 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad9d11-f6b9-4bbe-82a3-7e690808034d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:37.750202 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-2c2b49b8-8312-4ddf-9e36-359a365e3bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:37.776267 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b49b8-8312-4ddf-9e36-359a365e3bd4 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:37.780316 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-6bad9d11-f6b9-4bbe-82a3-7e690808034d None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:37.783800 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6bad9d11-f6b9-4bbe-82a3-7e690808034d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:37.873719 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d79ae-f8a2-4fb7-8216-2bde1b00e6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:37.875950 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d79ae-f8a2-4fb7-8216-2bde1b00e6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:37.876401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d79ae-f8a2-4fb7-8216-2bde1b00e6de admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:37.876883 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d79ae-f8a2-4fb7-8216-2bde1b00e6de admin admin] PATH_INFO: `/v3/projects/55537934373244a7811faa37c4200e8d` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:37.879133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d79ae-f8a2-4fb7-8216-2bde1b00e6de admin admin] RBAC: Authorizing `identity:delete_project(project_id=55537934373244a7811faa37c4200e8d)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:37.883035 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d79ae-f8a2-4fb7-8216-2bde1b00e6de admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:37.907226 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 927/1873] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:37.916835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad9d11-f6b9-4bbe-82a3-7e690808034d None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:37.919965 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6bad9d11-f6b9-4bbe-82a3-7e690808034d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:37.949231 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-831d79ae-f8a2-4fb7-8216-2bde1b00e6de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55537934373244a7811faa37c4200e8d', 'request_id': 'req-831d79ae-f8a2-4fb7-8216-2bde1b00e6de'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:37.956312 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-831d79ae-f8a2-4fb7-8216-2bde1b00e6de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55537934373244a7811faa37c4200e8d', 'request_id': 'req-831d79ae-f8a2-4fb7-8216-2bde1b00e6de'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:37.967380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-831d79ae-f8a2-4fb7-8216-2bde1b00e6de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55537934373244a7811faa37c4200e8d', 'request_id': 'req-831d79ae-f8a2-4fb7-8216-2bde1b00e6de'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:37.981315 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-831d79ae-f8a2-4fb7-8216-2bde1b00e6de admin admin] The token cache is being invalidate because project 55537934373244a7811faa37c4200e8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:37.981315 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-831d79ae-f8a2-4fb7-8216-2bde1b00e6de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:37.982165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-831d79ae-f8a2-4fb7-8216-2bde1b00e6de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:37.984700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 947/1874] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:37 2022] DELETE /identity/v3/projects/55537934373244a7811faa37c4200e8d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:37.991085 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828a91e-ffa9-4e1d-ab98-4d479fac510f None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:37.991432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828a91e-ffa9-4e1d-ab98-4d479fac510f None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:37.991789 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828a91e-ffa9-4e1d-ab98-4d479fac510f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:38.009073 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad9d11-f6b9-4bbe-82a3-7e690808034d None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:38.016182 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-e828a91e-ffa9-4e1d-ab98-4d479fac510f None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:38.017348 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e828a91e-ffa9-4e1d-ab98-4d479fac510f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:38.084114 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6eb75-4580-4cb3-ad26-c15b085152f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:38.085008 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6eb75-4580-4cb3-ad26-c15b085152f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:38.085594 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6eb75-4580-4cb3-ad26-c15b085152f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:38.086132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6eb75-4580-4cb3-ad26-c15b085152f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:38.088961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-85f6eb75-4580-4cb3-ad26-c15b085152f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:38.092172 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 948/1875] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:38.100981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850a7f9-1827-4c81-987f-36336a75ea4c None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:38.101268 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850a7f9-1827-4c81-987f-36336a75ea4c None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:38.101666 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850a7f9-1827-4c81-987f-36336a75ea4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:38.114957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6eb75-4580-4cb3-ad26-c15b085152f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:38.117889 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6eb75-4580-4cb3-ad26-c15b085152f7 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:38.122863 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-7850a7f9-1827-4c81-987f-36336a75ea4c None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:38.124137 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-7850a7f9-1827-4c81-987f-36336a75ea4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:38.134161 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 949/1876] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:38.139012 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850a7f9-1827-4c81-987f-36336a75ea4c None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:38.139310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 928/1877] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:06:38.149590 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850a7f9-1827-4c81-987f-36336a75ea4c None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:38.155579 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dd63a-9baf-4fc2-be9e-fdcb50a9a8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:38.156090 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dd63a-9baf-4fc2-be9e-fdcb50a9a8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:38.156584 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dd63a-9baf-4fc2-be9e-fdcb50a9a8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:38.156877 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dd63a-9baf-4fc2-be9e-fdcb50a9a8f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:38.157609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650dd63a-9baf-4fc2-be9e-fdcb50a9a8f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:06:38.158187 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650dd63a-9baf-4fc2-be9e-fdcb50a9a8f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:38.160199 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650dd63a-9baf-4fc2-be9e-fdcb50a9a8f9 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:38.179020 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 950/1878] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:06:38.186575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6eb75-4580-4cb3-ad26-c15b085152f7 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:38.208098 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6eb75-4580-4cb3-ad26-c15b085152f7 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:38.216299 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65051be-4ac2-42fc-82b0-a33da80ab63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:38.217559 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65051be-4ac2-42fc-82b0-a33da80ab63f admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:38.217942 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65051be-4ac2-42fc-82b0-a33da80ab63f admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:38.218850 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65051be-4ac2-42fc-82b0-a33da80ab63f admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:38.220583 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65051be-4ac2-42fc-82b0-a33da80ab63f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:38.224859 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65051be-4ac2-42fc-82b0-a33da80ab63f admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:38.303427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 929/1879] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:38 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:38.310635 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dd63a-9baf-4fc2-be9e-fdcb50a9a8f9 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:38.347740 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dd63a-9baf-4fc2-be9e-fdcb50a9a8f9 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:38.464210 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5b7d3-3075-46ba-a14e-4899e3285a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:38.465078 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5b7d3-3075-46ba-a14e-4899e3285a4c admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:38.465423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5b7d3-3075-46ba-a14e-4899e3285a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:38.465710 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5b7d3-3075-46ba-a14e-4899e3285a4c admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:38.466517 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5b7d3-3075-46ba-a14e-4899e3285a4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:38.469316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5b7d3-3075-46ba-a14e-4899e3285a4c admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:38.504199 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 951/1880] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:38 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:06:38.506131 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65051be-4ac2-42fc-82b0-a33da80ab63f admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:38.524191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65051be-4ac2-42fc-82b0-a33da80ab63f admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:38.533205 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79011db4-7320-4cf2-ad12-623cf2c73742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:38.534404 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79011db4-7320-4cf2-ad12-623cf2c73742 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:38.534977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79011db4-7320-4cf2-ad12-623cf2c73742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:38.535504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79011db4-7320-4cf2-ad12-623cf2c73742 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:38.536920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79011db4-7320-4cf2-ad12-623cf2c73742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:38.540196 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79011db4-7320-4cf2-ad12-623cf2c73742 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:38.562235 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 930/1881] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:06:38.567654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5b7d3-3075-46ba-a14e-4899e3285a4c admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:38.582657 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5b7d3-3075-46ba-a14e-4899e3285a4c admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:38.589605 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d853d-6329-4f2b-bdd4-21583dd55c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:38.590264 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d853d-6329-4f2b-bdd4-21583dd55c7e admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:38.591055 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d853d-6329-4f2b-bdd4-21583dd55c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:38.591212 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d853d-6329-4f2b-bdd4-21583dd55c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:38.596237 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d853d-6329-4f2b-bdd4-21583dd55c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:38.596237 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d853d-6329-4f2b-bdd4-21583dd55c7e admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:38.597743 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79011db4-7320-4cf2-ad12-623cf2c73742 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:38.605047 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-79011db4-7320-4cf2-ad12-623cf2c73742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:38.619609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 952/1882] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:06:38.621302 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d853d-6329-4f2b-bdd4-21583dd55c7e admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:38.641808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d853d-6329-4f2b-bdd4-21583dd55c7e admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:38.651018 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79011db4-7320-4cf2-ad12-623cf2c73742 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:38.651932 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda16211-8cbb-46bd-8347-ff00d73c9612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:38.652872 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda16211-8cbb-46bd-8347-ff00d73c9612 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:38.653134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda16211-8cbb-46bd-8347-ff00d73c9612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:38.653445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda16211-8cbb-46bd-8347-ff00d73c9612 admin admin] PATH_INFO: `/v3/projects/4764db5846c741d99dfe6aeafec0acc6/users/30f90b1bba914528b327488af88432e7/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:38.656802 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65523161-e63c-4af8-88e0-dc2c9be1f770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:38.657734 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65523161-e63c-4af8-88e0-dc2c9be1f770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:38.657948 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65523161-e63c-4af8-88e0-dc2c9be1f770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:38.658221 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65523161-e63c-4af8-88e0-dc2c9be1f770 admin admin] PATH_INFO: `/v3/projects/f637d5e978a14c91b7a399e28d338ec6` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:38.659773 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65523161-e63c-4af8-88e0-dc2c9be1f770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f637d5e978a14c91b7a399e28d338ec6)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:38.663387 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65523161-e63c-4af8-88e0-dc2c9be1f770 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:38.677975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda16211-8cbb-46bd-8347-ff00d73c9612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4764db5846c741d99dfe6aeafec0acc6, user_id=30f90b1bba914528b327488af88432e7, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:38.682364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda16211-8cbb-46bd-8347-ff00d73c9612 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:38.698191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 953/1883] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:38 2022] PUT /identity/v3/projects/4764db5846c741d99dfe6aeafec0acc6/users/30f90b1bba914528b327488af88432e7/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:38.709413 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7147903-16bd-4d59-a16a-073719ebab1f None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:38.709820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7147903-16bd-4d59-a16a-073719ebab1f None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:38.710172 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7147903-16bd-4d59-a16a-073719ebab1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:38.738761 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-65523161-e63c-4af8-88e0-dc2c9be1f770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f637d5e978a14c91b7a399e28d338ec6', 'request_id': 'req-65523161-e63c-4af8-88e0-dc2c9be1f770'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:38.743423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-b7147903-16bd-4d59-a16a-073719ebab1f None None] MFA Rules not processed for user `30f90b1bba914528b327488af88432e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:38.744744 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-b7147903-16bd-4d59-a16a-073719ebab1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:38.746403 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-65523161-e63c-4af8-88e0-dc2c9be1f770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f637d5e978a14c91b7a399e28d338ec6', 'request_id': 'req-65523161-e63c-4af8-88e0-dc2c9be1f770'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:38.753981 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-65523161-e63c-4af8-88e0-dc2c9be1f770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f637d5e978a14c91b7a399e28d338ec6', 'request_id': 'req-65523161-e63c-4af8-88e0-dc2c9be1f770'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:38.784437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-65523161-e63c-4af8-88e0-dc2c9be1f770 admin admin] The token cache is being invalidate because project f637d5e978a14c91b7a399e28d338ec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:38.785120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-65523161-e63c-4af8-88e0-dc2c9be1f770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:38.785828 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-65523161-e63c-4af8-88e0-dc2c9be1f770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:38.787758 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 931/1884] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:38 2022] DELETE /identity/v3/projects/f637d5e978a14c91b7a399e28d338ec6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:38.796054 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4df183-57e7-42e8-a208-24655bf724f0 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:38.796422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4df183-57e7-42e8-a208-24655bf724f0 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:38.796762 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4df183-57e7-42e8-a208-24655bf724f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:38.840075 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-4f4df183-57e7-42e8-a208-24655bf724f0 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:38.842222 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-4f4df183-57e7-42e8-a208-24655bf724f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:38.864666 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 954/1885] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:38.880626 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7147903-16bd-4d59-a16a-073719ebab1f None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:38.882942 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-b7147903-16bd-4d59-a16a-073719ebab1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:38.935430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 932/1886] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:38.952142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50811b2-79f1-456a-b18b-4f204c07c04e None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:38.952498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50811b2-79f1-456a-b18b-4f204c07c04e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:38.952847 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50811b2-79f1-456a-b18b-4f204c07c04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:38.960247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7147903-16bd-4d59-a16a-073719ebab1f None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:38.964328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55d76d-8949-46a4-b2d7-a0ed5571c5e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:38.965085 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55d76d-8949-46a4-b2d7-a0ed5571c5e2 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:38.965427 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55d76d-8949-46a4-b2d7-a0ed5571c5e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:38.965766 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55d76d-8949-46a4-b2d7-a0ed5571c5e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:38.975413 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55d76d-8949-46a4-b2d7-a0ed5571c5e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:38.976957 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55d76d-8949-46a4-b2d7-a0ed5571c5e2 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:38.977921 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-a50811b2-79f1-456a-b18b-4f204c07c04e None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:38.979227 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-a50811b2-79f1-456a-b18b-4f204c07c04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:38.987537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 955/1887] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:38.990744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 933/1888] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:38.998677 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55d76d-8949-46a4-b2d7-a0ed5571c5e2 service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:39.013070 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50811b2-79f1-456a-b18b-4f204c07c04e None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:39.013841 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55d76d-8949-46a4-b2d7-a0ed5571c5e2 service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:39.015366 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-a50811b2-79f1-456a-b18b-4f204c07c04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:39.023380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f572a-da8c-4177-98cf-ae34db2739a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:39.024245 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f572a-da8c-4177-98cf-ae34db2739a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:39.024522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f572a-da8c-4177-98cf-ae34db2739a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:39.024793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f572a-da8c-4177-98cf-ae34db2739a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:39.025566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f572a-da8c-4177-98cf-ae34db2739a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:06:39.025871 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f572a-da8c-4177-98cf-ae34db2739a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:39.027627 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f572a-da8c-4177-98cf-ae34db2739a3 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:39.030534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50811b2-79f1-456a-b18b-4f204c07c04e None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:39.036165 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243662e-cea7-456a-8880-30f625a53ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:39.037135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243662e-cea7-456a-8880-30f625a53ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:39.037490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243662e-cea7-456a-8880-30f625a53ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:39.038284 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243662e-cea7-456a-8880-30f625a53ff9 admin admin] PATH_INFO: `/v3/users/30f90b1bba914528b327488af88432e7` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:39.039333 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243662e-cea7-456a-8880-30f625a53ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f90b1bba914528b327488af88432e7)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:39.041867 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243662e-cea7-456a-8880-30f625a53ff9 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:39.042781 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 956/1889] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:06:39.047034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f572a-da8c-4177-98cf-ae34db2739a3 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:39.058430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f572a-da8c-4177-98cf-ae34db2739a3 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:39.063373 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15465236-72a5-4b8c-a6fc-ee9e8c48b4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:39.064187 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15465236-72a5-4b8c-a6fc-ee9e8c48b4f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:39.064463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15465236-72a5-4b8c-a6fc-ee9e8c48b4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:39.064741 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15465236-72a5-4b8c-a6fc-ee9e8c48b4f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:39.065432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15465236-72a5-4b8c-a6fc-ee9e8c48b4f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:39.067405 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15465236-72a5-4b8c-a6fc-ee9e8c48b4f9 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:39.097979 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 957/1890] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:39 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:06:39.102938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15465236-72a5-4b8c-a6fc-ee9e8c48b4f9 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:39.105440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-b243662e-cea7-456a-8880-30f625a53ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f90b1bba914528b327488af88432e7'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:39.114725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-b243662e-cea7-456a-8880-30f625a53ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f90b1bba914528b327488af88432e7'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:39.145952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-b243662e-cea7-456a-8880-30f625a53ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f90b1bba914528b327488af88432e7'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:39.146796 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-b243662e-cea7-456a-8880-30f625a53ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f90b1bba914528b327488af88432e7'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:39.156035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-b243662e-cea7-456a-8880-30f625a53ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f90b1bba914528b327488af88432e7'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:39.164086 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 934/1891] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:39 2022] DELETE /identity/v3/users/30f90b1bba914528b327488af88432e7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:06:39.169480 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9ab9a-23a5-4b57-ae8a-380be16bc83b None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:39.169766 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9ab9a-23a5-4b57-ae8a-380be16bc83b None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:39.170047 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9ab9a-23a5-4b57-ae8a-380be16bc83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:39.192843 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-bbb9ab9a-23a5-4b57-ae8a-380be16bc83b None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:39.194470 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-bbb9ab9a-23a5-4b57-ae8a-380be16bc83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:39.196805 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15465236-72a5-4b8c-a6fc-ee9e8c48b4f9 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:39.283830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 935/1892] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:39.296327 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9ab9a-23a5-4b57-ae8a-380be16bc83b None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:39.298691 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-bbb9ab9a-23a5-4b57-ae8a-380be16bc83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:39.305806 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9aa4a5-39a9-4b98-85c3-e50ba70f4f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:39.309569 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aa4a5-39a9-4b98-85c3-e50ba70f4f09 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:39.309868 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aa4a5-39a9-4b98-85c3-e50ba70f4f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:39.310138 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aa4a5-39a9-4b98-85c3-e50ba70f4f09 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:39.310892 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9aa4a5-39a9-4b98-85c3-e50ba70f4f09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:39.312985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9aa4a5-39a9-4b98-85c3-e50ba70f4f09 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:39.375970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 958/1893] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:39 2022] POST /identity/v3/users => generated 292 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:39.380780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9aa4a5-39a9-4b98-85c3-e50ba70f4f09 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:39.384833 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ac9aa4a5-39a9-4b98-85c3-e50ba70f4f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:39.401586 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9ab9a-23a5-4b57-ae8a-380be16bc83b None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:39.407696 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152988a-c293-4d33-bee3-04708fe0c839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:39.408769 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152988a-c293-4d33-bee3-04708fe0c839 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:39.409161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152988a-c293-4d33-bee3-04708fe0c839 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:39.409776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152988a-c293-4d33-bee3-04708fe0c839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:39.411294 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9aa4a5-39a9-4b98-85c3-e50ba70f4f09 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:39.420334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf860a92-f60f-4669-b8a1-4fe66a2cd8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:39.421560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf860a92-f60f-4669-b8a1-4fe66a2cd8eb admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:39.421927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152988a-c293-4d33-bee3-04708fe0c839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:39.422067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf860a92-f60f-4669-b8a1-4fe66a2cd8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:39.422529 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf860a92-f60f-4669-b8a1-4fe66a2cd8eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:39.423458 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152988a-c293-4d33-bee3-04708fe0c839 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:39.424015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf860a92-f60f-4669-b8a1-4fe66a2cd8eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:39.426879 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf860a92-f60f-4669-b8a1-4fe66a2cd8eb admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:39.436643 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 936/1894] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:06:39.442439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 959/1895] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:39.444162 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152988a-c293-4d33-bee3-04708fe0c839 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:39.454642 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152988a-c293-4d33-bee3-04708fe0c839 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:39.459680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ae625-41c4-4745-a376-3ff3120718b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:39.460318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ae625-41c4-4745-a376-3ff3120718b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:39.460733 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ae625-41c4-4745-a376-3ff3120718b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:39.461025 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ae625-41c4-4745-a376-3ff3120718b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:39.461761 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ae625-41c4-4745-a376-3ff3120718b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:39.464050 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ae625-41c4-4745-a376-3ff3120718b5 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:39.476006 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 937/1896] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:39.479903 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf860a92-f60f-4669-b8a1-4fe66a2cd8eb admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:39.491342 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf860a92-f60f-4669-b8a1-4fe66a2cd8eb admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:39.497164 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82938c-7399-4188-b89e-8297dc4eb07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:39.497974 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82938c-7399-4188-b89e-8297dc4eb07f admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:39.498324 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82938c-7399-4188-b89e-8297dc4eb07f admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:39.498668 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82938c-7399-4188-b89e-8297dc4eb07f admin admin] PATH_INFO: `/v3/projects/c88dda0911b945fb862d8a3599b30140/users/2f6699187b5146ebbaeebc205cf33c60/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:39.516704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82938c-7399-4188-b89e-8297dc4eb07f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c88dda0911b945fb862d8a3599b30140, user_id=2f6699187b5146ebbaeebc205cf33c60, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:39.519782 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82938c-7399-4188-b89e-8297dc4eb07f admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:39.541564 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 960/1897] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:39 2022] PUT /identity/v3/projects/c88dda0911b945fb862d8a3599b30140/users/2f6699187b5146ebbaeebc205cf33c60/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:06:39.557568 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d243249-3b94-4bd8-a715-c31aad37b69d None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:39.558616 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d243249-3b94-4bd8-a715-c31aad37b69d None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:39.559698 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d243249-3b94-4bd8-a715-c31aad37b69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:39.611216 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-1d243249-3b94-4bd8-a715-c31aad37b69d None None] MFA Rules not processed for user `2f6699187b5146ebbaeebc205cf33c60`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:39.614326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-1d243249-3b94-4bd8-a715-c31aad37b69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:39.747441 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 938/1898] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:39.756653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82938c-7399-4188-b89e-8297dc4eb07f admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:39.832671 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82938c-7399-4188-b89e-8297dc4eb07f admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:39.837423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d6b81-8ef3-4df2-89ef-5ed42091f09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:39.838696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d6b81-8ef3-4df2-89ef-5ed42091f09f admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:39.839020 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d6b81-8ef3-4df2-89ef-5ed42091f09f admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:39.839298 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d6b81-8ef3-4df2-89ef-5ed42091f09f admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:39.840018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d6b81-8ef3-4df2-89ef-5ed42091f09f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:39.842097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d6b81-8ef3-4df2-89ef-5ed42091f09f admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:39.879916 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 961/1899] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:39 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:39.882091 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d243249-3b94-4bd8-a715-c31aad37b69d None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:39.899557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d243249-3b94-4bd8-a715-c31aad37b69d None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:39.988556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151705b-6b0d-4bb2-93f8-1b86b2ec052d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:39.989537 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151705b-6b0d-4bb2-93f8-1b86b2ec052d admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:39.989718 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151705b-6b0d-4bb2-93f8-1b86b2ec052d admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:39.989977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151705b-6b0d-4bb2-93f8-1b86b2ec052d admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:39.990699 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151705b-6b0d-4bb2-93f8-1b86b2ec052d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:39.992668 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151705b-6b0d-4bb2-93f8-1b86b2ec052d admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:40.020461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 939/1900] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:39 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:06:40.031315 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d6b81-8ef3-4df2-89ef-5ed42091f09f admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:40.042978 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d6b81-8ef3-4df2-89ef-5ed42091f09f admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:40.047891 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151705b-6b0d-4bb2-93f8-1b86b2ec052d admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:40.050235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5814c6-87ca-4816-b1d7-a2f5aa1588ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:40.050555 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-8151705b-6b0d-4bb2-93f8-1b86b2ec052d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:40.051289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5814c6-87ca-4816-b1d7-a2f5aa1588ee admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:40.051768 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5814c6-87ca-4816-b1d7-a2f5aa1588ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:40.052277 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5814c6-87ca-4816-b1d7-a2f5aa1588ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:40.053190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5814c6-87ca-4816-b1d7-a2f5aa1588ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:40.055448 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5814c6-87ca-4816-b1d7-a2f5aa1588ee admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:40.064294 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151705b-6b0d-4bb2-93f8-1b86b2ec052d admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:40.067819 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 962/1901] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:40.071139 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780b7ac-09a6-4b1b-95d6-2f48bdf0d1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:40.072545 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5814c6-87ca-4816-b1d7-a2f5aa1588ee admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:40.073089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780b7ac-09a6-4b1b-95d6-2f48bdf0d1ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:40.073514 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780b7ac-09a6-4b1b-95d6-2f48bdf0d1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:40.074033 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780b7ac-09a6-4b1b-95d6-2f48bdf0d1ab admin admin] PATH_INFO: `/v3/projects/4764db5846c741d99dfe6aeafec0acc6` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:40.075642 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780b7ac-09a6-4b1b-95d6-2f48bdf0d1ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=4764db5846c741d99dfe6aeafec0acc6)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:40.077854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780b7ac-09a6-4b1b-95d6-2f48bdf0d1ab admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:40.092593 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5814c6-87ca-4816-b1d7-a2f5aa1588ee admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:40.098329 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa8d9d-9fb1-4c4e-8706-71a706c10652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:40.099261 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa8d9d-9fb1-4c4e-8706-71a706c10652 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:40.099545 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa8d9d-9fb1-4c4e-8706-71a706c10652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:40.099812 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa8d9d-9fb1-4c4e-8706-71a706c10652 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:40.100579 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa8d9d-9fb1-4c4e-8706-71a706c10652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:40.102176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa8d9d-9fb1-4c4e-8706-71a706c10652 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:40.115633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 963/1902] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:40.119850 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa8d9d-9fb1-4c4e-8706-71a706c10652 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:40.132813 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa8d9d-9fb1-4c4e-8706-71a706c10652 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:40.133260 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-a780b7ac-09a6-4b1b-95d6-2f48bdf0d1ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4764db5846c741d99dfe6aeafec0acc6', 'request_id': 'req-a780b7ac-09a6-4b1b-95d6-2f48bdf0d1ab'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:40.141497 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-a780b7ac-09a6-4b1b-95d6-2f48bdf0d1ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4764db5846c741d99dfe6aeafec0acc6', 'request_id': 'req-a780b7ac-09a6-4b1b-95d6-2f48bdf0d1ab'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:40.155282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-a780b7ac-09a6-4b1b-95d6-2f48bdf0d1ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4764db5846c741d99dfe6aeafec0acc6', 'request_id': 'req-a780b7ac-09a6-4b1b-95d6-2f48bdf0d1ab'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:40.179714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-a780b7ac-09a6-4b1b-95d6-2f48bdf0d1ab admin admin] The token cache is being invalidate because project 4764db5846c741d99dfe6aeafec0acc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:40.180217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-a780b7ac-09a6-4b1b-95d6-2f48bdf0d1ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:40.181938 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-a780b7ac-09a6-4b1b-95d6-2f48bdf0d1ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:40.185243 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 940/1903] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:40 2022] DELETE /identity/v3/projects/4764db5846c741d99dfe6aeafec0acc6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:06:40.193212 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da790e-a49b-4c62-9e9f-e4ff1c99cbe2 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:40.193753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da790e-a49b-4c62-9e9f-e4ff1c99cbe2 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:40.194236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da790e-a49b-4c62-9e9f-e4ff1c99cbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:40.219014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-e2da790e-a49b-4c62-9e9f-e4ff1c99cbe2 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:40.220294 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-e2da790e-a49b-4c62-9e9f-e4ff1c99cbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:40.222372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d84d4-5a8c-4d9a-9e2a-e48513303ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:40.223466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d84d4-5a8c-4d9a-9e2a-e48513303ff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:40.223821 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d84d4-5a8c-4d9a-9e2a-e48513303ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:40.224243 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d84d4-5a8c-4d9a-9e2a-e48513303ff0 admin admin] PATH_INFO: `/v3/projects/48d12ce0129645c0ac81dd10def2e6e1/users/2940223a013e4d20b80ef38c9ae59883/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:40.229380 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 941/1904] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:40.238555 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ece54e-adca-44d4-8e1e-f0653257a183 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:40.238984 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ece54e-adca-44d4-8e1e-f0653257a183 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:40.239157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ece54e-adca-44d4-8e1e-f0653257a183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:40.246907 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d84d4-5a8c-4d9a-9e2a-e48513303ff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48d12ce0129645c0ac81dd10def2e6e1, user_id=2940223a013e4d20b80ef38c9ae59883, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:40.250146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d84d4-5a8c-4d9a-9e2a-e48513303ff0 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:40.269749 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-c5ece54e-adca-44d4-8e1e-f0653257a183 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:40.270927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c5ece54e-adca-44d4-8e1e-f0653257a183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:40.271609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 964/1905] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:40 2022] PUT /identity/v3/projects/48d12ce0129645c0ac81dd10def2e6e1/users/2940223a013e4d20b80ef38c9ae59883/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:40.290758 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f4df9-9ca2-48c9-a751-00701da6ce43 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:40.291381 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f4df9-9ca2-48c9-a751-00701da6ce43 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:40.291842 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f4df9-9ca2-48c9-a751-00701da6ce43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:40.324329 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-0b8f4df9-9ca2-48c9-a751-00701da6ce43 None None] MFA Rules not processed for user `2940223a013e4d20b80ef38c9ae59883`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:40.325736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-0b8f4df9-9ca2-48c9-a751-00701da6ce43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:40.386331 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 942/1906] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:40.391104 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ece54e-adca-44d4-8e1e-f0653257a183 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:40.408474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ece54e-adca-44d4-8e1e-f0653257a183 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:40.417327 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488ea93-412f-4098-b376-ef2c286bb628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:40.418525 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488ea93-412f-4098-b376-ef2c286bb628 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:40.419157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488ea93-412f-4098-b376-ef2c286bb628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:40.419674 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488ea93-412f-4098-b376-ef2c286bb628 admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:40.421180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488ea93-412f-4098-b376-ef2c286bb628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:06:40.421790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488ea93-412f-4098-b376-ef2c286bb628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:40.424761 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488ea93-412f-4098-b376-ef2c286bb628 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:40.438211 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 965/1907] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:40.445322 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f4df9-9ca2-48c9-a751-00701da6ce43 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:40.447062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 943/1908] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:06:40.447876 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-0b8f4df9-9ca2-48c9-a751-00701da6ce43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:40.452557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488ea93-412f-4098-b376-ef2c286bb628 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:40.471239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488ea93-412f-4098-b376-ef2c286bb628 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:40.472299 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f4df9-9ca2-48c9-a751-00701da6ce43 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:40.478130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d02c3-cfa1-44d6-9905-1406959e0c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:40.479791 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d02c3-cfa1-44d6-9905-1406959e0c23 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:40.480251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d02c3-cfa1-44d6-9905-1406959e0c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:40.480429 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997a807-f0ab-4ebd-a5bd-449b2b724a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:40.480730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d02c3-cfa1-44d6-9905-1406959e0c23 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:40.481562 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997a807-f0ab-4ebd-a5bd-449b2b724a92 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:40.481786 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d02c3-cfa1-44d6-9905-1406959e0c23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:40.482072 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997a807-f0ab-4ebd-a5bd-449b2b724a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:40.482568 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997a807-f0ab-4ebd-a5bd-449b2b724a92 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:40.483923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997a807-f0ab-4ebd-a5bd-449b2b724a92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:40.484531 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d02c3-cfa1-44d6-9905-1406959e0c23 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:40.487741 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997a807-f0ab-4ebd-a5bd-449b2b724a92 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:40.525599 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 966/1909] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:40 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:06:40.525925 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 944/1910] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:40 2022] POST /identity/v3/projects => generated 359 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:06:40.527933 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997a807-f0ab-4ebd-a5bd-449b2b724a92 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:40.528147 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d02c3-cfa1-44d6-9905-1406959e0c23 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:40.603821 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d02c3-cfa1-44d6-9905-1406959e0c23 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:40.609256 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d567889-7d24-4a19-a337-3d9df249b9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:40.610222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d567889-7d24-4a19-a337-3d9df249b9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:40.610513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d567889-7d24-4a19-a337-3d9df249b9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:40.610785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d567889-7d24-4a19-a337-3d9df249b9f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:40.611526 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d567889-7d24-4a19-a337-3d9df249b9f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:40.613879 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d567889-7d24-4a19-a337-3d9df249b9f2 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:40.614738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997a807-f0ab-4ebd-a5bd-449b2b724a92 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:40.620922 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f08ee2-df86-4b59-ba26-71214626857d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:40.621686 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f08ee2-df86-4b59-ba26-71214626857d admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:40.621978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f08ee2-df86-4b59-ba26-71214626857d admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:40.622262 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f08ee2-df86-4b59-ba26-71214626857d admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:40.623080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f08ee2-df86-4b59-ba26-71214626857d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:40.625189 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f08ee2-df86-4b59-ba26-71214626857d admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:40.649046 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 967/1911] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:40 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:06:40.652197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d567889-7d24-4a19-a337-3d9df249b9f2 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:40.670929 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d567889-7d24-4a19-a337-3d9df249b9f2 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:40.671583 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 945/1912] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:40 2022] POST /identity/v3/users => generated 280 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:40.673211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f08ee2-df86-4b59-ba26-71214626857d admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:40.679723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b27f4-02de-4791-8911-77863b11dcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:40.682298 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b27f4-02de-4791-8911-77863b11dcfd admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:40.683019 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b27f4-02de-4791-8911-77863b11dcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:40.683469 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b27f4-02de-4791-8911-77863b11dcfd admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:40.685000 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b27f4-02de-4791-8911-77863b11dcfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:40.689294 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b27f4-02de-4791-8911-77863b11dcfd admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:40.692873 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f08ee2-df86-4b59-ba26-71214626857d admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:40.701685 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ae447-5c96-4183-b73f-42a049075789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:40.703126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ae447-5c96-4183-b73f-42a049075789 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:40.703669 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ae447-5c96-4183-b73f-42a049075789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:40.704335 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ae447-5c96-4183-b73f-42a049075789 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:40.705999 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ae447-5c96-4183-b73f-42a049075789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:40.710706 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 968/1913] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:40.717547 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ae447-5c96-4183-b73f-42a049075789 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:40.718548 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b27f4-02de-4791-8911-77863b11dcfd admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:40.739056 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 946/1914] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:40.741025 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b27f4-02de-4791-8911-77863b11dcfd admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:40.742598 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ae447-5c96-4183-b73f-42a049075789 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:40.749674 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a79f8-228b-4e34-938a-d5f44d30b105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:40.751133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a79f8-228b-4e34-938a-d5f44d30b105 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:40.751538 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a79f8-228b-4e34-938a-d5f44d30b105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:40.752026 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a79f8-228b-4e34-938a-d5f44d30b105 admin admin] PATH_INFO: `/v3/projects/d310cf7a5c144ee99c49e28da571cbdb/users/c00281d3a87d44e2810bfaea4d1d4901/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:40.755123 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ae447-5c96-4183-b73f-42a049075789 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:40.762292 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1d88c-018d-4875-b530-5a92b115e197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:40.763166 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1d88c-018d-4875-b530-5a92b115e197 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:40.763637 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1d88c-018d-4875-b530-5a92b115e197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:40.763930 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1d88c-018d-4875-b530-5a92b115e197 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:40.764694 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1d88c-018d-4875-b530-5a92b115e197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:40.766879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1d88c-018d-4875-b530-5a92b115e197 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:40.788424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a79f8-228b-4e34-938a-d5f44d30b105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d310cf7a5c144ee99c49e28da571cbdb, user_id=c00281d3a87d44e2810bfaea4d1d4901, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:40.793938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a79f8-228b-4e34-938a-d5f44d30b105 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:40.795187 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 947/1915] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:40.802882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1d88c-018d-4875-b530-5a92b115e197 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:40.817187 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 969/1916] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:40 2022] PUT /identity/v3/projects/d310cf7a5c144ee99c49e28da571cbdb/users/c00281d3a87d44e2810bfaea4d1d4901/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:06:40.822425 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a79f8-228b-4e34-938a-d5f44d30b105 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:40.823688 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1d88c-018d-4875-b530-5a92b115e197 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:40.913613 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759448c5-78ca-4f69-aa9e-22cc12015262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:40.914596 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759448c5-78ca-4f69-aa9e-22cc12015262 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:40.914915 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759448c5-78ca-4f69-aa9e-22cc12015262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:40.915201 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759448c5-78ca-4f69-aa9e-22cc12015262 admin admin] PATH_INFO: `/v3/projects/7915a301244a45e28efc4b6e9f50f4c6/users/fcee39b36cb045fc940e1e58aa568663/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:40.938155 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a79f8-228b-4e34-938a-d5f44d30b105 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:40.941148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759448c5-78ca-4f69-aa9e-22cc12015262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7915a301244a45e28efc4b6e9f50f4c6, user_id=fcee39b36cb045fc940e1e58aa568663, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:40.948870 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33292e8-5a05-44e7-845b-4bdfba940b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:40.949941 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33292e8-5a05-44e7-845b-4bdfba940b40 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:40.950414 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33292e8-5a05-44e7-845b-4bdfba940b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:40.962935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33292e8-5a05-44e7-845b-4bdfba940b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:40.963240 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759448c5-78ca-4f69-aa9e-22cc12015262 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:40.963333 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33292e8-5a05-44e7-845b-4bdfba940b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:40.963333 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33292e8-5a05-44e7-845b-4bdfba940b40 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:40.972838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 948/1917] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:40 2022] PUT /identity/v3/projects/7915a301244a45e28efc4b6e9f50f4c6/users/fcee39b36cb045fc940e1e58aa568663/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:06:40.977901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 970/1918] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:06:40.984554 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f65de-9173-4f37-b5ec-358f13715b0c None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:40.985198 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f65de-9173-4f37-b5ec-358f13715b0c None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:40.986073 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f65de-9173-4f37-b5ec-358f13715b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:40.986197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33292e8-5a05-44e7-845b-4bdfba940b40 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:41.011639 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33292e8-5a05-44e7-845b-4bdfba940b40 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:41.028501 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-ef9f65de-9173-4f37-b5ec-358f13715b0c None None] MFA Rules not processed for user `fcee39b36cb045fc940e1e58aa568663`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:41.030231 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ef9f65de-9173-4f37-b5ec-358f13715b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:41.106420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2c36e-4f8d-46cf-8dc2-92d482db9763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:41.107711 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2c36e-4f8d-46cf-8dc2-92d482db9763 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:41.107997 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2c36e-4f8d-46cf-8dc2-92d482db9763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:41.108278 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2c36e-4f8d-46cf-8dc2-92d482db9763 admin admin] PATH_INFO: `/v3/projects/d310cf7a5c144ee99c49e28da571cbdb/users/c00281d3a87d44e2810bfaea4d1d4901/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:41.110719 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2c36e-4f8d-46cf-8dc2-92d482db9763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d310cf7a5c144ee99c49e28da571cbdb, user_id=c00281d3a87d44e2810bfaea4d1d4901, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:41.113961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2c36e-4f8d-46cf-8dc2-92d482db9763 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:41.139443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 971/1919] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:40 2022] PUT /identity/v3/projects/d310cf7a5c144ee99c49e28da571cbdb/users/c00281d3a87d44e2810bfaea4d1d4901/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:41.152117 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4b839-8d9f-4c5f-91ac-48a72715e47c None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:41.152903 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4b839-8d9f-4c5f-91ac-48a72715e47c None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:41.154039 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4b839-8d9f-4c5f-91ac-48a72715e47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:41.173668 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 949/1920] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:40 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:41.190251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-99a4b839-8d9f-4c5f-91ac-48a72715e47c None None] MFA Rules not processed for user `c00281d3a87d44e2810bfaea4d1d4901`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:41.191576 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-99a4b839-8d9f-4c5f-91ac-48a72715e47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:41.211776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f65de-9173-4f37-b5ec-358f13715b0c None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:41.213738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ef9f65de-9173-4f37-b5ec-358f13715b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:41.271906 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 972/1921] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:41.279881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f65de-9173-4f37-b5ec-358f13715b0c None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:41.289172 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4b839-8d9f-4c5f-91ac-48a72715e47c None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:41.291943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-99a4b839-8d9f-4c5f-91ac-48a72715e47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:41.340187 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1763a-bd55-41d6-acac-162726500d56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:41.341264 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1763a-bd55-41d6-acac-162726500d56 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:41.341616 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1763a-bd55-41d6-acac-162726500d56 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:41.341932 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1763a-bd55-41d6-acac-162726500d56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:41.395713 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4b839-8d9f-4c5f-91ac-48a72715e47c None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:41.402582 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa28bec-97e9-40c4-805b-505167e98a6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:41.403616 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa28bec-97e9-40c4-805b-505167e98a6d service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:41.404154 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa28bec-97e9-40c4-805b-505167e98a6d service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:41.404599 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa28bec-97e9-40c4-805b-505167e98a6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:41.407882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-6aa28bec-97e9-40c4-805b-505167e98a6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:41.414560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1763a-bd55-41d6-acac-162726500d56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:41.416270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1763a-bd55-41d6-acac-162726500d56 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:41.429777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 950/1922] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:41 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:06:41.451191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1763a-bd55-41d6-acac-162726500d56 service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:41.511644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa28bec-97e9-40c4-805b-505167e98a6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:41.515031 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa28bec-97e9-40c4-805b-505167e98a6d service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:41.537863 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 973/1923] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:06:41.548765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1763a-bd55-41d6-acac-162726500d56 service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:41.557645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514b741-1e57-43a0-a795-6d8abad76d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:41.559371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514b741-1e57-43a0-a795-6d8abad76d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:41.560161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514b741-1e57-43a0-a795-6d8abad76d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:41.560551 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514b741-1e57-43a0-a795-6d8abad76d12 admin admin] PATH_INFO: `/v3/users/fcee39b36cb045fc940e1e58aa568663` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:41.562997 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514b741-1e57-43a0-a795-6d8abad76d12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcee39b36cb045fc940e1e58aa568663)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:41.567049 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514b741-1e57-43a0-a795-6d8abad76d12 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:41.633704 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-0514b741-1e57-43a0-a795-6d8abad76d12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcee39b36cb045fc940e1e58aa568663'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:41.648666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-0514b741-1e57-43a0-a795-6d8abad76d12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcee39b36cb045fc940e1e58aa568663'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:41.697547 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-0514b741-1e57-43a0-a795-6d8abad76d12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcee39b36cb045fc940e1e58aa568663'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:41.698974 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-0514b741-1e57-43a0-a795-6d8abad76d12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcee39b36cb045fc940e1e58aa568663'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:41.717249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-0514b741-1e57-43a0-a795-6d8abad76d12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcee39b36cb045fc940e1e58aa568663'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:41.729609 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 951/1924] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:41 2022] DELETE /identity/v3/users/fcee39b36cb045fc940e1e58aa568663 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:06:41.736207 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1692f-abe8-450d-b9ed-5c8f17706f38 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:41.737353 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1692f-abe8-450d-b9ed-5c8f17706f38 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:41.737796 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1692f-abe8-450d-b9ed-5c8f17706f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:41.775373 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-93d1692f-abe8-450d-b9ed-5c8f17706f38 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:41.776633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-93d1692f-abe8-450d-b9ed-5c8f17706f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:41.857621 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 974/1925] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:41.867454 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514b741-1e57-43a0-a795-6d8abad76d12 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:41.869515 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-0514b741-1e57-43a0-a795-6d8abad76d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:41.981053 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514b741-1e57-43a0-a795-6d8abad76d12 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:41.984889 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede86edf-6af9-47f7-aa2c-74f3e404e139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:41.985713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede86edf-6af9-47f7-aa2c-74f3e404e139 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:41.986069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede86edf-6af9-47f7-aa2c-74f3e404e139 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:41.986447 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede86edf-6af9-47f7-aa2c-74f3e404e139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:42.001062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede86edf-6af9-47f7-aa2c-74f3e404e139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:42.002693 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede86edf-6af9-47f7-aa2c-74f3e404e139 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:42.024697 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 952/1926] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:06:42.374971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1692f-abe8-450d-b9ed-5c8f17706f38 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:42.378399 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-93d1692f-abe8-450d-b9ed-5c8f17706f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:42.398582 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1692f-abe8-450d-b9ed-5c8f17706f38 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:42.407678 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbe640-f614-46e3-a813-08162d92028d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:42.408879 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbe640-f614-46e3-a813-08162d92028d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:42.409213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbe640-f614-46e3-a813-08162d92028d admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:42.409511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbe640-f614-46e3-a813-08162d92028d admin admin] PATH_INFO: `/v3/projects/7915a301244a45e28efc4b6e9f50f4c6` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:42.410906 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbe640-f614-46e3-a813-08162d92028d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7915a301244a45e28efc4b6e9f50f4c6)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:42.413148 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbe640-f614-46e3-a813-08162d92028d admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:42.489742 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-50bbe640-f614-46e3-a813-08162d92028d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7915a301244a45e28efc4b6e9f50f4c6', 'request_id': 'req-50bbe640-f614-46e3-a813-08162d92028d'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:42.503221 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-50bbe640-f614-46e3-a813-08162d92028d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7915a301244a45e28efc4b6e9f50f4c6', 'request_id': 'req-50bbe640-f614-46e3-a813-08162d92028d'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:42.518485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-50bbe640-f614-46e3-a813-08162d92028d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7915a301244a45e28efc4b6e9f50f4c6', 'request_id': 'req-50bbe640-f614-46e3-a813-08162d92028d'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:42.538526 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-50bbe640-f614-46e3-a813-08162d92028d admin admin] The token cache is being invalidate because project 7915a301244a45e28efc4b6e9f50f4c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:42.539097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-50bbe640-f614-46e3-a813-08162d92028d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:42.540242 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-50bbe640-f614-46e3-a813-08162d92028d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:42.543950 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 975/1927] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:42 2022] DELETE /identity/v3/projects/7915a301244a45e28efc4b6e9f50f4c6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:42.550629 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0817016-ee5e-405e-8840-e3c77cc0badd None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:42.551164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0817016-ee5e-405e-8840-e3c77cc0badd None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:42.551266 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0817016-ee5e-405e-8840-e3c77cc0badd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:42.588305 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-c0817016-ee5e-405e-8840-e3c77cc0badd None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:42.590709 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c0817016-ee5e-405e-8840-e3c77cc0badd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:42.722895 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 953/1928] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:42.727580 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b00a5-d761-4f2a-97d1-58158e7e971b None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:42.727840 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b00a5-d761-4f2a-97d1-58158e7e971b None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:42.728721 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b00a5-d761-4f2a-97d1-58158e7e971b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:42.747869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-cc2b00a5-d761-4f2a-97d1-58158e7e971b None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:42.749111 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-cc2b00a5-d761-4f2a-97d1-58158e7e971b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:42.761605 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 976/1929] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:42.763650 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0817016-ee5e-405e-8840-e3c77cc0badd None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:42.798029 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0817016-ee5e-405e-8840-e3c77cc0badd None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:42.817275 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f165a2-2f27-4c9a-b161-93ba4133f8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:42.818080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f165a2-2f27-4c9a-b161-93ba4133f8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:42.818332 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f165a2-2f27-4c9a-b161-93ba4133f8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:42.818738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f165a2-2f27-4c9a-b161-93ba4133f8f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:42.819536 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f165a2-2f27-4c9a-b161-93ba4133f8f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:06:42.819848 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f165a2-2f27-4c9a-b161-93ba4133f8f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:42.830958 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f165a2-2f27-4c9a-b161-93ba4133f8f6 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:42.854027 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 954/1930] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:06:42.861320 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b00a5-d761-4f2a-97d1-58158e7e971b None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:42.884623 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b00a5-d761-4f2a-97d1-58158e7e971b None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:42.902730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfcf79-51d4-48bd-925c-9da7cf3b8889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:42.918114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfcf79-51d4-48bd-925c-9da7cf3b8889 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:42.920372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfcf79-51d4-48bd-925c-9da7cf3b8889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:42.921208 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfcf79-51d4-48bd-925c-9da7cf3b8889 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:42.924658 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfcf79-51d4-48bd-925c-9da7cf3b8889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:42.936743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfcf79-51d4-48bd-925c-9da7cf3b8889 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:43.018856 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 977/1931] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:42 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:43.019314 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f165a2-2f27-4c9a-b161-93ba4133f8f6 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:43.030901 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f165a2-2f27-4c9a-b161-93ba4133f8f6 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:43.139431 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c56251-268e-40a7-92b8-cbb2995238dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:43.140480 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c56251-268e-40a7-92b8-cbb2995238dc admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:43.140862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c56251-268e-40a7-92b8-cbb2995238dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:43.141235 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c56251-268e-40a7-92b8-cbb2995238dc admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:43.142036 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c56251-268e-40a7-92b8-cbb2995238dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:43.144155 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c56251-268e-40a7-92b8-cbb2995238dc admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:43.207278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 955/1932] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:43 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:43.208606 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfcf79-51d4-48bd-925c-9da7cf3b8889 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:43.231487 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfcf79-51d4-48bd-925c-9da7cf3b8889 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:43.248010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f064ef9-efc2-42b7-9b1f-625bcce717dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:43.248709 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f064ef9-efc2-42b7-9b1f-625bcce717dc admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:43.248991 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f064ef9-efc2-42b7-9b1f-625bcce717dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:43.249263 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f064ef9-efc2-42b7-9b1f-625bcce717dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:43.250007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f064ef9-efc2-42b7-9b1f-625bcce717dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:43.251747 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f064ef9-efc2-42b7-9b1f-625bcce717dc admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:43.286095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 978/1933] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:43.293868 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c56251-268e-40a7-92b8-cbb2995238dc admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:43.325485 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c56251-268e-40a7-92b8-cbb2995238dc admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:43.335458 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278c57f-0629-462e-8f48-51414dfc21b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:43.336981 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278c57f-0629-462e-8f48-51414dfc21b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:43.337977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278c57f-0629-462e-8f48-51414dfc21b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:43.339513 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278c57f-0629-462e-8f48-51414dfc21b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:43.340887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278c57f-0629-462e-8f48-51414dfc21b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:43.352357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278c57f-0629-462e-8f48-51414dfc21b1 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:43.390749 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 956/1934] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:43.391305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f064ef9-efc2-42b7-9b1f-625bcce717dc admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:43.414127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f064ef9-efc2-42b7-9b1f-625bcce717dc admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:43.425165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7281c6-300a-4e86-8ce4-76083db9f45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:43.427024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7281c6-300a-4e86-8ce4-76083db9f45b admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:43.427906 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7281c6-300a-4e86-8ce4-76083db9f45b admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:43.428833 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7281c6-300a-4e86-8ce4-76083db9f45b admin admin] PATH_INFO: `/v3/projects/470d18a8d316433597ca07429953857e/users/35fff7969f0843049263cf5421d08f92/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:43.466614 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7281c6-300a-4e86-8ce4-76083db9f45b admin admin] RBAC: Authorizing `identity:create_grant(project_id=470d18a8d316433597ca07429953857e, user_id=35fff7969f0843049263cf5421d08f92, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:43.469862 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7281c6-300a-4e86-8ce4-76083db9f45b admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:43.492855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 979/1935] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:43 2022] PUT /identity/v3/projects/470d18a8d316433597ca07429953857e/users/35fff7969f0843049263cf5421d08f92/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:06:43.506379 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b3b65-1f75-4656-a34c-6d37be3abccd None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:43.506615 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b3b65-1f75-4656-a34c-6d37be3abccd None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:43.506860 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b3b65-1f75-4656-a34c-6d37be3abccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:43.580722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-cf2b3b65-1f75-4656-a34c-6d37be3abccd None None] MFA Rules not processed for user `35fff7969f0843049263cf5421d08f92`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:43.581988 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-cf2b3b65-1f75-4656-a34c-6d37be3abccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:43.763310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 957/1936] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:43.771411 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7281c6-300a-4e86-8ce4-76083db9f45b admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:43.775871 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-5e7281c6-300a-4e86-8ce4-76083db9f45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:43.926533 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7281c6-300a-4e86-8ce4-76083db9f45b admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:43.951723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73111256-c256-4a67-b7d2-e3c79665cd6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:43.952678 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73111256-c256-4a67-b7d2-e3c79665cd6c service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:43.953132 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73111256-c256-4a67-b7d2-e3c79665cd6c service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:43.953562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73111256-c256-4a67-b7d2-e3c79665cd6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:43.964014 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73111256-c256-4a67-b7d2-e3c79665cd6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:43.965699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73111256-c256-4a67-b7d2-e3c79665cd6c service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:43.987565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 980/1937] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:44.660661 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b3b65-1f75-4656-a34c-6d37be3abccd None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:44.662229 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-cf2b3b65-1f75-4656-a34c-6d37be3abccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:44.675183 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b3b65-1f75-4656-a34c-6d37be3abccd None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:44.680896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390bb58-43ad-47e0-a2e7-4481607d4069 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:44.682325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390bb58-43ad-47e0-a2e7-4481607d4069 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:44.682569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390bb58-43ad-47e0-a2e7-4481607d4069 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:44.682880 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390bb58-43ad-47e0-a2e7-4481607d4069 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:44.684918 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-5390bb58-43ad-47e0-a2e7-4481607d4069 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:44.761968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390bb58-43ad-47e0-a2e7-4481607d4069 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:44.763932 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390bb58-43ad-47e0-a2e7-4481607d4069 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:44.775368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 958/1938] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:06:45.242646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73111256-c256-4a67-b7d2-e3c79665cd6c service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:45.245225 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-73111256-c256-4a67-b7d2-e3c79665cd6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:45.347352 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73111256-c256-4a67-b7d2-e3c79665cd6c service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:45.353486 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91225d1d-a946-4559-8214-73a219e42fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:45.354574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91225d1d-a946-4559-8214-73a219e42fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:45.355002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91225d1d-a946-4559-8214-73a219e42fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:45.355394 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91225d1d-a946-4559-8214-73a219e42fcd admin admin] PATH_INFO: `/v3/users/9501562fc7ca4d0dbdfdbfd476a16fbf` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:45.356833 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91225d1d-a946-4559-8214-73a219e42fcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9501562fc7ca4d0dbdfdbfd476a16fbf)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:45.359107 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91225d1d-a946-4559-8214-73a219e42fcd admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:45.425156 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-91225d1d-a946-4559-8214-73a219e42fcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9501562fc7ca4d0dbdfdbfd476a16fbf'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:45.451779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-91225d1d-a946-4559-8214-73a219e42fcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9501562fc7ca4d0dbdfdbfd476a16fbf'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:45.452567 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-91225d1d-a946-4559-8214-73a219e42fcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9501562fc7ca4d0dbdfdbfd476a16fbf'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:45.453212 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-91225d1d-a946-4559-8214-73a219e42fcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9501562fc7ca4d0dbdfdbfd476a16fbf'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:45.462652 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-91225d1d-a946-4559-8214-73a219e42fcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9501562fc7ca4d0dbdfdbfd476a16fbf'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:45.491863 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 981/1939] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:45 2022] DELETE /identity/v3/users/9501562fc7ca4d0dbdfdbfd476a16fbf => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:45.497623 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5eabc-9a04-4dec-8dac-e4b91b73080e None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:45.498113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5eabc-9a04-4dec-8dac-e4b91b73080e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:45.498555 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5eabc-9a04-4dec-8dac-e4b91b73080e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:45.519448 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-33b5eabc-9a04-4dec-8dac-e4b91b73080e None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:45.521988 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-33b5eabc-9a04-4dec-8dac-e4b91b73080e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:45.620916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 959/1940] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:45.630861 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91225d1d-a946-4559-8214-73a219e42fcd admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:45.632613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-91225d1d-a946-4559-8214-73a219e42fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:45.651625 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5eabc-9a04-4dec-8dac-e4b91b73080e None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:45.653654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-33b5eabc-9a04-4dec-8dac-e4b91b73080e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:45.697863 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91225d1d-a946-4559-8214-73a219e42fcd admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:45.702107 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb47c3-a33f-41bf-a15d-9f3cd15aaee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:45.702770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb47c3-a33f-41bf-a15d-9f3cd15aaee9 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:45.703127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb47c3-a33f-41bf-a15d-9f3cd15aaee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:45.703382 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb47c3-a33f-41bf-a15d-9f3cd15aaee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:45.719505 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5eabc-9a04-4dec-8dac-e4b91b73080e None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:45.720058 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb47c3-a33f-41bf-a15d-9f3cd15aaee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:45.722605 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb47c3-a33f-41bf-a15d-9f3cd15aaee9 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:45.725408 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c46d5-4119-4249-813d-4764c8bccd05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:45.726458 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c46d5-4119-4249-813d-4764c8bccd05 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:45.726957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c46d5-4119-4249-813d-4764c8bccd05 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:45.727397 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c46d5-4119-4249-813d-4764c8bccd05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:45.730331 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-164c46d5-4119-4249-813d-4764c8bccd05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:45.738702 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 982/1941] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:45.803650 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c46d5-4119-4249-813d-4764c8bccd05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:45.805408 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c46d5-4119-4249-813d-4764c8bccd05 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:45.817856 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 960/1942] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:06:46.069790 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb47c3-a33f-41bf-a15d-9f3cd15aaee9 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:46.071251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-32cb47c3-a33f-41bf-a15d-9f3cd15aaee9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:46.108443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb47c3-a33f-41bf-a15d-9f3cd15aaee9 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:46.116400 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4dd37-0b5a-4316-8a46-44ddc58d56b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:46.117676 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4dd37-0b5a-4316-8a46-44ddc58d56b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:46.118032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4dd37-0b5a-4316-8a46-44ddc58d56b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:46.118370 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4dd37-0b5a-4316-8a46-44ddc58d56b5 admin admin] PATH_INFO: `/v3/projects/cb1c74973ff84460b4dcdee41807d2fc` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:46.121208 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4dd37-0b5a-4316-8a46-44ddc58d56b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb1c74973ff84460b4dcdee41807d2fc)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:46.124800 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4dd37-0b5a-4316-8a46-44ddc58d56b5 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:46.197691 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-c8d4dd37-0b5a-4316-8a46-44ddc58d56b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb1c74973ff84460b4dcdee41807d2fc', 'request_id': 'req-c8d4dd37-0b5a-4316-8a46-44ddc58d56b5'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:46.206677 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-c8d4dd37-0b5a-4316-8a46-44ddc58d56b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb1c74973ff84460b4dcdee41807d2fc', 'request_id': 'req-c8d4dd37-0b5a-4316-8a46-44ddc58d56b5'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:46.218622 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-c8d4dd37-0b5a-4316-8a46-44ddc58d56b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb1c74973ff84460b4dcdee41807d2fc', 'request_id': 'req-c8d4dd37-0b5a-4316-8a46-44ddc58d56b5'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:46.233444 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-c8d4dd37-0b5a-4316-8a46-44ddc58d56b5 admin admin] The token cache is being invalidate because project cb1c74973ff84460b4dcdee41807d2fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:46.233895 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-c8d4dd37-0b5a-4316-8a46-44ddc58d56b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:46.234878 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-c8d4dd37-0b5a-4316-8a46-44ddc58d56b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:46.236600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 983/1943] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:46 2022] DELETE /identity/v3/projects/cb1c74973ff84460b4dcdee41807d2fc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:46.241168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c46d5-4119-4249-813d-4764c8bccd05 service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:46.259121 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c46d5-4119-4249-813d-4764c8bccd05 service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:46.330725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0502301-0c81-442f-98d6-c161baebd244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:46.331520 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0502301-0c81-442f-98d6-c161baebd244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:46.331804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0502301-0c81-442f-98d6-c161baebd244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:46.332080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0502301-0c81-442f-98d6-c161baebd244 admin admin] PATH_INFO: `/v3/users/1d68c4155bcc4b1dbb6ee3fb8ae8144c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:46.333310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0502301-0c81-442f-98d6-c161baebd244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d68c4155bcc4b1dbb6ee3fb8ae8144c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:46.335320 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0502301-0c81-442f-98d6-c161baebd244 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:46.389966 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-b0502301-0c81-442f-98d6-c161baebd244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d68c4155bcc4b1dbb6ee3fb8ae8144c'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:46.398350 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-b0502301-0c81-442f-98d6-c161baebd244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d68c4155bcc4b1dbb6ee3fb8ae8144c'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:46.411862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-b0502301-0c81-442f-98d6-c161baebd244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d68c4155bcc4b1dbb6ee3fb8ae8144c'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:46.412589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-b0502301-0c81-442f-98d6-c161baebd244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d68c4155bcc4b1dbb6ee3fb8ae8144c'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:46.421397 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-b0502301-0c81-442f-98d6-c161baebd244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d68c4155bcc4b1dbb6ee3fb8ae8144c'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:46.427419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 961/1944] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:46 2022] DELETE /identity/v3/users/1d68c4155bcc4b1dbb6ee3fb8ae8144c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:06:46.954128 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4dd37-0b5a-4316-8a46-44ddc58d56b5 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:46.956143 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-c8d4dd37-0b5a-4316-8a46-44ddc58d56b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:47.018794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4dd37-0b5a-4316-8a46-44ddc58d56b5 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:47.154896 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad84769-e5bd-461a-8593-5b3e94de68f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:47.156099 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad84769-e5bd-461a-8593-5b3e94de68f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:47.156478 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad84769-e5bd-461a-8593-5b3e94de68f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:47.158437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad84769-e5bd-461a-8593-5b3e94de68f3 admin admin] PATH_INFO: `/v3/projects/5cf4a6d8005b40f2a948032219d06a73` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:47.160431 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad84769-e5bd-461a-8593-5b3e94de68f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cf4a6d8005b40f2a948032219d06a73)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:47.163514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad84769-e5bd-461a-8593-5b3e94de68f3 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:47.235402 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4ad84769-e5bd-461a-8593-5b3e94de68f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cf4a6d8005b40f2a948032219d06a73', 'request_id': 'req-4ad84769-e5bd-461a-8593-5b3e94de68f3'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:47.242679 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4ad84769-e5bd-461a-8593-5b3e94de68f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cf4a6d8005b40f2a948032219d06a73', 'request_id': 'req-4ad84769-e5bd-461a-8593-5b3e94de68f3'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:47.252722 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4ad84769-e5bd-461a-8593-5b3e94de68f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cf4a6d8005b40f2a948032219d06a73', 'request_id': 'req-4ad84769-e5bd-461a-8593-5b3e94de68f3'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:47.265523 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4ad84769-e5bd-461a-8593-5b3e94de68f3 admin admin] The token cache is being invalidate because project 5cf4a6d8005b40f2a948032219d06a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:47.265809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4ad84769-e5bd-461a-8593-5b3e94de68f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:47.266526 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4ad84769-e5bd-461a-8593-5b3e94de68f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:47.268397 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 984/1945] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:46 2022] DELETE /identity/v3/projects/5cf4a6d8005b40f2a948032219d06a73 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:47.273864 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a567b9-8230-4388-833f-17b286dd2edf None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:47.274428 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a567b9-8230-4388-833f-17b286dd2edf None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:47.274428 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a567b9-8230-4388-833f-17b286dd2edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:47.299493 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-17a567b9-8230-4388-833f-17b286dd2edf None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:47.300833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-17a567b9-8230-4388-833f-17b286dd2edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:47.399272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 962/1946] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:47.412805 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929a1b3-7f5a-4ee3-9d17-230d5b3e361d None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:47.413562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929a1b3-7f5a-4ee3-9d17-230d5b3e361d None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:47.414179 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929a1b3-7f5a-4ee3-9d17-230d5b3e361d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:47.447268 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-0929a1b3-7f5a-4ee3-9d17-230d5b3e361d None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:47.449329 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-0929a1b3-7f5a-4ee3-9d17-230d5b3e361d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:47.473819 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 985/1947] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:47.480431 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a567b9-8230-4388-833f-17b286dd2edf None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:47.496610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a567b9-8230-4388-833f-17b286dd2edf None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:47.505984 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cf582-6d0b-4942-abb1-49ae97607214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:47.507196 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cf582-6d0b-4942-abb1-49ae97607214 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:47.507876 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cf582-6d0b-4942-abb1-49ae97607214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:47.508390 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cf582-6d0b-4942-abb1-49ae97607214 admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:47.511061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cf582-6d0b-4942-abb1-49ae97607214 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:06:47.511880 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cf582-6d0b-4942-abb1-49ae97607214 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:47.515134 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cf582-6d0b-4942-abb1-49ae97607214 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:47.539309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 963/1948] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:06:47.544172 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929a1b3-7f5a-4ee3-9d17-230d5b3e361d None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:47.557389 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929a1b3-7f5a-4ee3-9d17-230d5b3e361d None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:47.564734 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce92232-adc1-4db2-8f5e-57359de3bc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:47.565552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce92232-adc1-4db2-8f5e-57359de3bc47 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:47.565776 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce92232-adc1-4db2-8f5e-57359de3bc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:47.566018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce92232-adc1-4db2-8f5e-57359de3bc47 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:47.566717 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce92232-adc1-4db2-8f5e-57359de3bc47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:47.568742 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce92232-adc1-4db2-8f5e-57359de3bc47 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:47.600520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 986/1949] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:47 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:47.604892 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cf582-6d0b-4942-abb1-49ae97607214 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:47.615665 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cf582-6d0b-4942-abb1-49ae97607214 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:47.682657 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dee99d-05a4-4c23-b7e9-de1a82510284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:47.683370 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dee99d-05a4-4c23-b7e9-de1a82510284 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:47.683655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dee99d-05a4-4c23-b7e9-de1a82510284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:47.683930 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dee99d-05a4-4c23-b7e9-de1a82510284 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:47.684634 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dee99d-05a4-4c23-b7e9-de1a82510284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:47.686595 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dee99d-05a4-4c23-b7e9-de1a82510284 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:47.709087 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 964/1950] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:47 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:47.715294 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce92232-adc1-4db2-8f5e-57359de3bc47 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:47.731258 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce92232-adc1-4db2-8f5e-57359de3bc47 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:47.736244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66451c7-3af1-44f1-bed9-d3503e3ad798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:47.737054 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66451c7-3af1-44f1-bed9-d3503e3ad798 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:47.737470 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66451c7-3af1-44f1-bed9-d3503e3ad798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:47.737809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66451c7-3af1-44f1-bed9-d3503e3ad798 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:47.738686 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66451c7-3af1-44f1-bed9-d3503e3ad798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:47.740577 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66451c7-3af1-44f1-bed9-d3503e3ad798 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:47.760495 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 987/1951] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:47.764446 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dee99d-05a4-4c23-b7e9-de1a82510284 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:47.774281 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66451c7-3af1-44f1-bed9-d3503e3ad798 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:47.777202 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a66451c7-3af1-44f1-bed9-d3503e3ad798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:47.783248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dee99d-05a4-4c23-b7e9-de1a82510284 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:47.792759 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494fed7-e6fd-4f55-80d5-3581098cde67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:47.794603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494fed7-e6fd-4f55-80d5-3581098cde67 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:47.794603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494fed7-e6fd-4f55-80d5-3581098cde67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:47.795023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494fed7-e6fd-4f55-80d5-3581098cde67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:47.795919 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66451c7-3af1-44f1-bed9-d3503e3ad798 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:47.796275 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494fed7-e6fd-4f55-80d5-3581098cde67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:47.799342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494fed7-e6fd-4f55-80d5-3581098cde67 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:47.801123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ba3e1-0fea-42ad-a270-faabd0df5ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:47.802032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ba3e1-0fea-42ad-a270-faabd0df5ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:47.802310 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ba3e1-0fea-42ad-a270-faabd0df5ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:47.802589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ba3e1-0fea-42ad-a270-faabd0df5ffb admin admin] PATH_INFO: `/v3/users/ca2250687b8b4d0a82059423f9af7ed0` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:47.804207 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ba3e1-0fea-42ad-a270-faabd0df5ffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca2250687b8b4d0a82059423f9af7ed0)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:47.806734 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ba3e1-0fea-42ad-a270-faabd0df5ffb admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:47.818021 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 965/1952] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:47.825434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494fed7-e6fd-4f55-80d5-3581098cde67 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:47.842014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494fed7-e6fd-4f55-80d5-3581098cde67 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:47.847853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e7158-95bc-4d37-849a-f6a18b12dcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:47.849253 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e7158-95bc-4d37-849a-f6a18b12dcaa admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:47.849587 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e7158-95bc-4d37-849a-f6a18b12dcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:47.850021 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e7158-95bc-4d37-849a-f6a18b12dcaa admin admin] PATH_INFO: `/v3/projects/af65af399a9a40258c465e161645360e/users/0ee02ddd5b574f3da4109d1631df2ddb/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:47.869094 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e09ba3e1-0fea-42ad-a270-faabd0df5ffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca2250687b8b4d0a82059423f9af7ed0'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:47.871367 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e7158-95bc-4d37-849a-f6a18b12dcaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=af65af399a9a40258c465e161645360e, user_id=0ee02ddd5b574f3da4109d1631df2ddb, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:47.874107 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e7158-95bc-4d37-849a-f6a18b12dcaa admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:47.887115 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e09ba3e1-0fea-42ad-a270-faabd0df5ffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca2250687b8b4d0a82059423f9af7ed0'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:47.888777 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e09ba3e1-0fea-42ad-a270-faabd0df5ffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca2250687b8b4d0a82059423f9af7ed0'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:47.889628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e09ba3e1-0fea-42ad-a270-faabd0df5ffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca2250687b8b4d0a82059423f9af7ed0'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:47.892199 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 966/1953] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:47 2022] PUT /identity/v3/projects/af65af399a9a40258c465e161645360e/users/0ee02ddd5b574f3da4109d1631df2ddb/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:06:47.903190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb13bd-c706-479a-aae7-635843de4b4a None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:47.903393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e09ba3e1-0fea-42ad-a270-faabd0df5ffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca2250687b8b4d0a82059423f9af7ed0'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:47.903490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb13bd-c706-479a-aae7-635843de4b4a None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:47.903739 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb13bd-c706-479a-aae7-635843de4b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:47.922216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 988/1954] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:47 2022] DELETE /identity/v3/users/ca2250687b8b4d0a82059423f9af7ed0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:47.926654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd3253-38c9-4461-af85-d970fb53f0c0 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:47.927015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd3253-38c9-4461-af85-d970fb53f0c0 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:47.927247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd3253-38c9-4461-af85-d970fb53f0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:47.938811 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-72fb13bd-c706-479a-aae7-635843de4b4a None None] MFA Rules not processed for user `0ee02ddd5b574f3da4109d1631df2ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:47.940073 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-72fb13bd-c706-479a-aae7-635843de4b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:47.946024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-70fd3253-38c9-4461-af85-d970fb53f0c0 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:47.947893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-70fd3253-38c9-4461-af85-d970fb53f0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:48.026626 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 989/1955] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:48.038509 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd3253-38c9-4461-af85-d970fb53f0c0 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:48.040813 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-70fd3253-38c9-4461-af85-d970fb53f0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:48.063431 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 967/1956] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:48.063431 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb13bd-c706-479a-aae7-635843de4b4a None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:48.063431 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-72fb13bd-c706-479a-aae7-635843de4b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:48.082946 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb13bd-c706-479a-aae7-635843de4b4a None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:48.088017 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad78bd3-ca1c-4dd9-b167-5b0f4d12b3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:48.088917 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad78bd3-ca1c-4dd9-b167-5b0f4d12b3e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:48.089237 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad78bd3-ca1c-4dd9-b167-5b0f4d12b3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:48.089535 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad78bd3-ca1c-4dd9-b167-5b0f4d12b3e8 admin admin] PATH_INFO: `/v3/users/35fff7969f0843049263cf5421d08f92` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:48.091381 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad78bd3-ca1c-4dd9-b167-5b0f4d12b3e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35fff7969f0843049263cf5421d08f92)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:48.094344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad78bd3-ca1c-4dd9-b167-5b0f4d12b3e8 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:48.125302 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd3253-38c9-4461-af85-d970fb53f0c0 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:48.129659 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec108ed-72bd-47a0-baf3-9bbfb3d21bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:48.130333 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec108ed-72bd-47a0-baf3-9bbfb3d21bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:48.130792 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec108ed-72bd-47a0-baf3-9bbfb3d21bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:48.130967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec108ed-72bd-47a0-baf3-9bbfb3d21bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:48.144285 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec108ed-72bd-47a0-baf3-9bbfb3d21bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:48.146224 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec108ed-72bd-47a0-baf3-9bbfb3d21bc4 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:48.157591 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-dad78bd3-ca1c-4dd9-b167-5b0f4d12b3e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35fff7969f0843049263cf5421d08f92'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:48.158441 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 990/1957] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:48.159664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec108ed-72bd-47a0-baf3-9bbfb3d21bc4 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:48.162218 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-bec108ed-72bd-47a0-baf3-9bbfb3d21bc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:48.169284 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-dad78bd3-ca1c-4dd9-b167-5b0f4d12b3e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35fff7969f0843049263cf5421d08f92'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:48.186559 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-dad78bd3-ca1c-4dd9-b167-5b0f4d12b3e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35fff7969f0843049263cf5421d08f92'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:48.187517 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-dad78bd3-ca1c-4dd9-b167-5b0f4d12b3e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35fff7969f0843049263cf5421d08f92'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:48.196107 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-dad78bd3-ca1c-4dd9-b167-5b0f4d12b3e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35fff7969f0843049263cf5421d08f92'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:48.203169 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec108ed-72bd-47a0-baf3-9bbfb3d21bc4 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:48.205063 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 968/1958] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:48 2022] DELETE /identity/v3/users/35fff7969f0843049263cf5421d08f92 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:48.209703 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b614c-a761-47bd-bc2f-adc510605799 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:48.210005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b614c-a761-47bd-bc2f-adc510605799 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:48.210287 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b614c-a761-47bd-bc2f-adc510605799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:48.231254 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-4b3b614c-a761-47bd-bc2f-adc510605799 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:48.232507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-4b3b614c-a761-47bd-bc2f-adc510605799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:48.311889 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 969/1959] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:48.323339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b614c-a761-47bd-bc2f-adc510605799 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:48.323614 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b8e9a-5353-43b8-a66a-cb6882c436e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:48.324257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b8e9a-5353-43b8-a66a-cb6882c436e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:48.324536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b8e9a-5353-43b8-a66a-cb6882c436e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:48.324807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b8e9a-5353-43b8-a66a-cb6882c436e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:48.325507 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b8e9a-5353-43b8-a66a-cb6882c436e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:48.325732 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-4b3b614c-a761-47bd-bc2f-adc510605799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:48.327492 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b8e9a-5353-43b8-a66a-cb6882c436e2 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:48.377788 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 991/1960] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:48 2022] POST /identity/v3/projects => generated 385 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:48.383698 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b8e9a-5353-43b8-a66a-cb6882c436e2 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:48.386898 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-b63b8e9a-5353-43b8-a66a-cb6882c436e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:48.429358 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b614c-a761-47bd-bc2f-adc510605799 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:48.494388 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b8e9a-5353-43b8-a66a-cb6882c436e2 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:48.507411 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06adf8-d6b9-43f5-b071-80cb0710b61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:48.509224 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06adf8-d6b9-43f5-b071-80cb0710b61a admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:48.510111 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06adf8-d6b9-43f5-b071-80cb0710b61a admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:48.511018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06adf8-d6b9-43f5-b071-80cb0710b61a admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:48.512783 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06adf8-d6b9-43f5-b071-80cb0710b61a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:48.517792 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06adf8-d6b9-43f5-b071-80cb0710b61a admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:48.554570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2cf37-2d5d-4194-8c19-ae52af0fe06a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:48.555313 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2cf37-2d5d-4194-8c19-ae52af0fe06a service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:48.555765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2cf37-2d5d-4194-8c19-ae52af0fe06a service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:48.556120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2cf37-2d5d-4194-8c19-ae52af0fe06a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:48.589449 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af2cf37-2d5d-4194-8c19-ae52af0fe06a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:48.595750 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 992/1961] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:48 2022] POST /identity/v3/users => generated 299 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:06:48.599445 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af2cf37-2d5d-4194-8c19-ae52af0fe06a service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:48.601592 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06adf8-d6b9-43f5-b071-80cb0710b61a admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:48.643822 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 970/1962] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:06:48.644695 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06adf8-d6b9-43f5-b071-80cb0710b61a admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:48.667671 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44caca-7787-4ce6-ac4b-58f9b8b2df86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:48.668846 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44caca-7787-4ce6-ac4b-58f9b8b2df86 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:48.669351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44caca-7787-4ce6-ac4b-58f9b8b2df86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:48.669850 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44caca-7787-4ce6-ac4b-58f9b8b2df86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:48.671312 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44caca-7787-4ce6-ac4b-58f9b8b2df86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:48.684653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44caca-7787-4ce6-ac4b-58f9b8b2df86 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:48.719354 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 993/1963] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:48.721612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2cf37-2d5d-4194-8c19-ae52af0fe06a service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:48.757046 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2cf37-2d5d-4194-8c19-ae52af0fe06a service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:48.778118 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b1bd8-06d9-44b2-9089-af6aaf63eb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:48.779557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b1bd8-06d9-44b2-9089-af6aaf63eb70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:48.780083 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b1bd8-06d9-44b2-9089-af6aaf63eb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:48.781150 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b1bd8-06d9-44b2-9089-af6aaf63eb70 admin admin] PATH_INFO: `/v3/projects/337c92200d494b04bf277d5fdda74a1d/users/a5a48eab73054b78aa46960b68257257/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:48.808282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b1bd8-06d9-44b2-9089-af6aaf63eb70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=337c92200d494b04bf277d5fdda74a1d, user_id=a5a48eab73054b78aa46960b68257257, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:48.812141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b1bd8-06d9-44b2-9089-af6aaf63eb70 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:48.845278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 971/1964] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:48 2022] PUT /identity/v3/projects/337c92200d494b04bf277d5fdda74a1d/users/a5a48eab73054b78aa46960b68257257/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:48.848791 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44caca-7787-4ce6-ac4b-58f9b8b2df86 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:48.879326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b1bd8-06d9-44b2-9089-af6aaf63eb70 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:48.881602 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-7d5b1bd8-06d9-44b2-9089-af6aaf63eb70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:48.893345 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44caca-7787-4ce6-ac4b-58f9b8b2df86 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:49.034883 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b1bd8-06d9-44b2-9089-af6aaf63eb70 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:49.047063 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca612a5-e110-445a-aae5-8d7c5e207f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:49.047969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca612a5-e110-445a-aae5-8d7c5e207f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:49.048249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca612a5-e110-445a-aae5-8d7c5e207f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:49.048533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca612a5-e110-445a-aae5-8d7c5e207f44 admin admin] PATH_INFO: `/v3/projects/03ee484d6a4b45d0bdcd1a459204c9e9` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:49.053057 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca612a5-e110-445a-aae5-8d7c5e207f44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03ee484d6a4b45d0bdcd1a459204c9e9)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:49.058085 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca612a5-e110-445a-aae5-8d7c5e207f44 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:49.078920 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ac5d0-948e-467a-a0a7-2e308b30f620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:49.080118 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ac5d0-948e-467a-a0a7-2e308b30f620 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:49.080436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ac5d0-948e-467a-a0a7-2e308b30f620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:49.080887 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ac5d0-948e-467a-a0a7-2e308b30f620 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:49.081982 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ac5d0-948e-467a-a0a7-2e308b30f620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:49.085388 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ac5d0-948e-467a-a0a7-2e308b30f620 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:49.103049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 994/1965] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:06:49.107052 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ac5d0-948e-467a-a0a7-2e308b30f620 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:49.124610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ac5d0-948e-467a-a0a7-2e308b30f620 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:49.131702 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac27d8-aee7-44c8-a4ee-60e0bd1d8f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:49.133101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac27d8-aee7-44c8-a4ee-60e0bd1d8f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:49.133606 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac27d8-aee7-44c8-a4ee-60e0bd1d8f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:49.134638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac27d8-aee7-44c8-a4ee-60e0bd1d8f8b admin admin] PATH_INFO: `/v3/projects/337c92200d494b04bf277d5fdda74a1d/users/a5a48eab73054b78aa46960b68257257/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:49.137559 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac27d8-aee7-44c8-a4ee-60e0bd1d8f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=337c92200d494b04bf277d5fdda74a1d, user_id=a5a48eab73054b78aa46960b68257257, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:49.140560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac27d8-aee7-44c8-a4ee-60e0bd1d8f8b admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:49.157156 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 995/1966] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:49 2022] PUT /identity/v3/projects/337c92200d494b04bf277d5fdda74a1d/users/a5a48eab73054b78aa46960b68257257/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:06:49.191144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259188d1-56a1-4dc8-83b5-5cd6f171bf32 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:49.191144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259188d1-56a1-4dc8-83b5-5cd6f171bf32 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:49.191144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259188d1-56a1-4dc8-83b5-5cd6f171bf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:49.192426 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-3ca612a5-e110-445a-aae5-8d7c5e207f44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ee484d6a4b45d0bdcd1a459204c9e9', 'request_id': 'req-3ca612a5-e110-445a-aae5-8d7c5e207f44'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:49.213151 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-3ca612a5-e110-445a-aae5-8d7c5e207f44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ee484d6a4b45d0bdcd1a459204c9e9', 'request_id': 'req-3ca612a5-e110-445a-aae5-8d7c5e207f44'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:49.225166 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-3ca612a5-e110-445a-aae5-8d7c5e207f44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ee484d6a4b45d0bdcd1a459204c9e9', 'request_id': 'req-3ca612a5-e110-445a-aae5-8d7c5e207f44'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:49.253749 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-3ca612a5-e110-445a-aae5-8d7c5e207f44 admin admin] The token cache is being invalidate because project 03ee484d6a4b45d0bdcd1a459204c9e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:49.254144 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-3ca612a5-e110-445a-aae5-8d7c5e207f44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:49.258722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-3ca612a5-e110-445a-aae5-8d7c5e207f44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:49.268215 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 972/1967] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:48 2022] DELETE /identity/v3/projects/03ee484d6a4b45d0bdcd1a459204c9e9 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:06:49.269975 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca612a5-e110-445a-aae5-8d7c5e207f44 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:49.270863 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-259188d1-56a1-4dc8-83b5-5cd6f171bf32 None None] MFA Rules not processed for user `a5a48eab73054b78aa46960b68257257`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:49.271489 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-3ca612a5-e110-445a-aae5-8d7c5e207f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:49.272943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-259188d1-56a1-4dc8-83b5-5cd6f171bf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:49.457167 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 996/1968] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:49.458562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259188d1-56a1-4dc8-83b5-5cd6f171bf32 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:49.460652 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-259188d1-56a1-4dc8-83b5-5cd6f171bf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:49.485445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259188d1-56a1-4dc8-83b5-5cd6f171bf32 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:49.485618 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca612a5-e110-445a-aae5-8d7c5e207f44 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:49.490403 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38290c33-8981-41e8-8425-317bc6f07936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:49.490584 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4c450-4ba4-4f28-a8a3-b2c6627fd65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:49.491326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38290c33-8981-41e8-8425-317bc6f07936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:49.491436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4c450-4ba4-4f28-a8a3-b2c6627fd65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:49.491598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4c450-4ba4-4f28-a8a3-b2c6627fd65d admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:49.491691 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38290c33-8981-41e8-8425-317bc6f07936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:49.491865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38290c33-8981-41e8-8425-317bc6f07936 admin admin] PATH_INFO: `/v3/users/079ced9e791049c496f1482003a3410c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:49.491980 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4c450-4ba4-4f28-a8a3-b2c6627fd65d admin admin] PATH_INFO: `/v3/projects/470d18a8d316433597ca07429953857e` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:49.493087 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38290c33-8981-41e8-8425-317bc6f07936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=079ced9e791049c496f1482003a3410c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:49.493757 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4c450-4ba4-4f28-a8a3-b2c6627fd65d admin admin] RBAC: Authorizing `identity:delete_project(project_id=470d18a8d316433597ca07429953857e)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:49.495645 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4c450-4ba4-4f28-a8a3-b2c6627fd65d admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:49.495763 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38290c33-8981-41e8-8425-317bc6f07936 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:49.563282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-38290c33-8981-41e8-8425-317bc6f07936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '079ced9e791049c496f1482003a3410c'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:49.568865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-48c4c450-4ba4-4f28-a8a3-b2c6627fd65d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '470d18a8d316433597ca07429953857e', 'request_id': 'req-48c4c450-4ba4-4f28-a8a3-b2c6627fd65d'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:49.579003 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-38290c33-8981-41e8-8425-317bc6f07936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '079ced9e791049c496f1482003a3410c'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:49.591567 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-48c4c450-4ba4-4f28-a8a3-b2c6627fd65d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '470d18a8d316433597ca07429953857e', 'request_id': 'req-48c4c450-4ba4-4f28-a8a3-b2c6627fd65d'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:49.610287 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-48c4c450-4ba4-4f28-a8a3-b2c6627fd65d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '470d18a8d316433597ca07429953857e', 'request_id': 'req-48c4c450-4ba4-4f28-a8a3-b2c6627fd65d'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:49.610653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-38290c33-8981-41e8-8425-317bc6f07936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '079ced9e791049c496f1482003a3410c'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:49.611549 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-38290c33-8981-41e8-8425-317bc6f07936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '079ced9e791049c496f1482003a3410c'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:49.627088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-38290c33-8981-41e8-8425-317bc6f07936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '079ced9e791049c496f1482003a3410c'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:49.641830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 973/1969] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:49 2022] DELETE /identity/v3/users/079ced9e791049c496f1482003a3410c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:49.643486 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38290c33-8981-41e8-8425-317bc6f07936 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:49.649100 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-38290c33-8981-41e8-8425-317bc6f07936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:49.690051 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-48c4c450-4ba4-4f28-a8a3-b2c6627fd65d admin admin] The token cache is being invalidate because project 470d18a8d316433597ca07429953857e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:49.690423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-48c4c450-4ba4-4f28-a8a3-b2c6627fd65d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:49.696962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-48c4c450-4ba4-4f28-a8a3-b2c6627fd65d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:49.698449 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 997/1970] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:49 2022] DELETE /identity/v3/projects/470d18a8d316433597ca07429953857e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:49.704784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f4184-b262-4eff-9c41-eb6b0580eeee None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:49.705195 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f4184-b262-4eff-9c41-eb6b0580eeee None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:49.705480 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f4184-b262-4eff-9c41-eb6b0580eeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:49.760922 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-6f2f4184-b262-4eff-9c41-eb6b0580eeee None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:49.765497 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-6f2f4184-b262-4eff-9c41-eb6b0580eeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:49.801118 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38290c33-8981-41e8-8425-317bc6f07936 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:49.810380 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96478d9d-75dd-4947-a0e7-0569bb80cedd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:49.811767 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96478d9d-75dd-4947-a0e7-0569bb80cedd service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:49.812707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96478d9d-75dd-4947-a0e7-0569bb80cedd service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:49.812843 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96478d9d-75dd-4947-a0e7-0569bb80cedd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:49.817083 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-96478d9d-75dd-4947-a0e7-0569bb80cedd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:49.906658 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 998/1971] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:49.909302 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c154a7-b086-418e-b521-7fafe39fedfa None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:49.909603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c154a7-b086-418e-b521-7fafe39fedfa None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:49.909810 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c154a7-b086-418e-b521-7fafe39fedfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:49.945250 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-34c154a7-b086-418e-b521-7fafe39fedfa None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:49.946635 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-34c154a7-b086-418e-b521-7fafe39fedfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:49.955346 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 999/1972] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:49.959017 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96478d9d-75dd-4947-a0e7-0569bb80cedd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:49.960026 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c154a7-b086-418e-b521-7fafe39fedfa None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:49.962604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96478d9d-75dd-4947-a0e7-0569bb80cedd service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:49.970138 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c154a7-b086-418e-b521-7fafe39fedfa None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:49.975446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db68ca1-6d2b-437c-a3b1-1eaa38ff5a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:49.976362 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db68ca1-6d2b-437c-a3b1-1eaa38ff5a58 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:49.976475 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db68ca1-6d2b-437c-a3b1-1eaa38ff5a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:49.976666 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db68ca1-6d2b-437c-a3b1-1eaa38ff5a58 admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:49.977412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db68ca1-6d2b-437c-a3b1-1eaa38ff5a58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:06:49.978288 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db68ca1-6d2b-437c-a3b1-1eaa38ff5a58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:49.979972 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db68ca1-6d2b-437c-a3b1-1eaa38ff5a58 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:49.995756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 974/1973] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:49.998996 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1000/1974] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:06:50.000402 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96478d9d-75dd-4947-a0e7-0569bb80cedd service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:50.031659 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96478d9d-75dd-4947-a0e7-0569bb80cedd service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:50.038097 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bb656-b68d-46a4-909f-73b20c82097e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:50.038786 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bb656-b68d-46a4-909f-73b20c82097e admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:50.039133 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bb656-b68d-46a4-909f-73b20c82097e admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:50.039559 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bb656-b68d-46a4-909f-73b20c82097e admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:50.040990 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37bb656-b68d-46a4-909f-73b20c82097e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:50.043656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37bb656-b68d-46a4-909f-73b20c82097e admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:50.050865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db68ca1-6d2b-437c-a3b1-1eaa38ff5a58 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:50.053027 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-2db68ca1-6d2b-437c-a3b1-1eaa38ff5a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:50.075471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db68ca1-6d2b-437c-a3b1-1eaa38ff5a58 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:50.088881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef27402-a9e6-47a3-81c8-ebf7996ea13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:50.090737 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef27402-a9e6-47a3-81c8-ebf7996ea13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:50.091060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef27402-a9e6-47a3-81c8-ebf7996ea13c admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:50.091499 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef27402-a9e6-47a3-81c8-ebf7996ea13c admin admin] PATH_INFO: `/v3/users/0ee02ddd5b574f3da4109d1631df2ddb` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:50.096902 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef27402-a9e6-47a3-81c8-ebf7996ea13c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ee02ddd5b574f3da4109d1631df2ddb)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:50.099288 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef27402-a9e6-47a3-81c8-ebf7996ea13c admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:50.125681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 975/1975] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:49 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:50.126709 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bb656-b68d-46a4-909f-73b20c82097e admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:50.209051 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-bef27402-a9e6-47a3-81c8-ebf7996ea13c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ee02ddd5b574f3da4109d1631df2ddb'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:50.242087 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-bef27402-a9e6-47a3-81c8-ebf7996ea13c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ee02ddd5b574f3da4109d1631df2ddb'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:50.243483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-bef27402-a9e6-47a3-81c8-ebf7996ea13c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ee02ddd5b574f3da4109d1631df2ddb'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:50.244193 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-bef27402-a9e6-47a3-81c8-ebf7996ea13c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ee02ddd5b574f3da4109d1631df2ddb'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:50.253565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-bef27402-a9e6-47a3-81c8-ebf7996ea13c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ee02ddd5b574f3da4109d1631df2ddb'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:50.273193 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1001/1976] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:50 2022] DELETE /identity/v3/users/0ee02ddd5b574f3da4109d1631df2ddb => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:50.279788 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abb0e7-7124-45af-8a16-7aab7041f809 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:50.280654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abb0e7-7124-45af-8a16-7aab7041f809 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:50.280654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abb0e7-7124-45af-8a16-7aab7041f809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:50.304227 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-92abb0e7-7124-45af-8a16-7aab7041f809 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:50.305707 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-92abb0e7-7124-45af-8a16-7aab7041f809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:50.306551 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bb656-b68d-46a4-909f-73b20c82097e admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:50.388420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1002/1977] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:50.389393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abb0e7-7124-45af-8a16-7aab7041f809 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:50.391957 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-92abb0e7-7124-45af-8a16-7aab7041f809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:50.410150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abb0e7-7124-45af-8a16-7aab7041f809 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:50.415345 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106d3ac-8d13-4508-960a-2f92428bba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:50.416543 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106d3ac-8d13-4508-960a-2f92428bba8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:50.416761 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106d3ac-8d13-4508-960a-2f92428bba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:50.417038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106d3ac-8d13-4508-960a-2f92428bba8d admin admin] PATH_INFO: `/v3/projects/f9f670a4b97c483eacc9990e4cb882a9` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:50.418480 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106d3ac-8d13-4508-960a-2f92428bba8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9f670a4b97c483eacc9990e4cb882a9)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:50.420501 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106d3ac-8d13-4508-960a-2f92428bba8d admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:50.464461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d97d13-13bb-40ed-b03f-7c83fd1a5b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:50.465655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d97d13-13bb-40ed-b03f-7c83fd1a5b23 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:50.466134 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d97d13-13bb-40ed-b03f-7c83fd1a5b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:50.466651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d97d13-13bb-40ed-b03f-7c83fd1a5b23 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:50.468013 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d97d13-13bb-40ed-b03f-7c83fd1a5b23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:50.474709 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d97d13-13bb-40ed-b03f-7c83fd1a5b23 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:50.488280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-6106d3ac-8d13-4508-960a-2f92428bba8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9f670a4b97c483eacc9990e4cb882a9', 'request_id': 'req-6106d3ac-8d13-4508-960a-2f92428bba8d'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:50.498328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-6106d3ac-8d13-4508-960a-2f92428bba8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9f670a4b97c483eacc9990e4cb882a9', 'request_id': 'req-6106d3ac-8d13-4508-960a-2f92428bba8d'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:50.511616 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-6106d3ac-8d13-4508-960a-2f92428bba8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9f670a4b97c483eacc9990e4cb882a9', 'request_id': 'req-6106d3ac-8d13-4508-960a-2f92428bba8d'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:50.535401 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 976/1978] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:50 2022] POST /identity/v3/users => generated 287 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:50.537929 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d97d13-13bb-40ed-b03f-7c83fd1a5b23 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:50.541161 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-6106d3ac-8d13-4508-960a-2f92428bba8d admin admin] The token cache is being invalidate because project f9f670a4b97c483eacc9990e4cb882a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:50.541485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-6106d3ac-8d13-4508-960a-2f92428bba8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:50.543175 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-6106d3ac-8d13-4508-960a-2f92428bba8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:50.544117 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-b5d97d13-13bb-40ed-b03f-7c83fd1a5b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:50.546290 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1003/1979] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:50 2022] DELETE /identity/v3/projects/f9f670a4b97c483eacc9990e4cb882a9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:50.547190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106d3ac-8d13-4508-960a-2f92428bba8d admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:50.554955 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-6106d3ac-8d13-4508-960a-2f92428bba8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:50.702402 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d97d13-13bb-40ed-b03f-7c83fd1a5b23 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:50.725255 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106d3ac-8d13-4508-960a-2f92428bba8d admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:50.743013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301db494-6659-4851-805e-9e854b9de9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:50.746431 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301db494-6659-4851-805e-9e854b9de9af admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:50.746881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301db494-6659-4851-805e-9e854b9de9af admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:50.747062 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301db494-6659-4851-805e-9e854b9de9af admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:50.747798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301db494-6659-4851-805e-9e854b9de9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:50.750773 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301db494-6659-4851-805e-9e854b9de9af admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:50.777743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1004/1980] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:50.780550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426f8ec-7862-4912-b680-bbfa0892cc8d None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:50.782176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426f8ec-7862-4912-b680-bbfa0892cc8d None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:50.783111 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426f8ec-7862-4912-b680-bbfa0892cc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:50.800363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ff5b1-333a-4e31-8d9d-7897b5ea69f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:50.801223 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ff5b1-333a-4e31-8d9d-7897b5ea69f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:50.801685 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ff5b1-333a-4e31-8d9d-7897b5ea69f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:50.802149 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ff5b1-333a-4e31-8d9d-7897b5ea69f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:50.805226 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-aa6ff5b1-333a-4e31-8d9d-7897b5ea69f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:50.825256 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-7426f8ec-7862-4912-b680-bbfa0892cc8d None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:50.827917 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-7426f8ec-7862-4912-b680-bbfa0892cc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:50.831040 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ff5b1-333a-4e31-8d9d-7897b5ea69f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:50.833773 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ff5b1-333a-4e31-8d9d-7897b5ea69f0 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:50.847449 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 977/1981] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:50.848438 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ff5b1-333a-4e31-8d9d-7897b5ea69f0 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:50.849978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-aa6ff5b1-333a-4e31-8d9d-7897b5ea69f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:50.853972 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1005/1982] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:50.855835 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426f8ec-7862-4912-b680-bbfa0892cc8d None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:50.865227 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ff5b1-333a-4e31-8d9d-7897b5ea69f0 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:50.871327 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d8ab5-edd5-48dd-b318-98c631f67ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:50.872348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d8ab5-edd5-48dd-b318-98c631f67ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:50.872699 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d8ab5-edd5-48dd-b318-98c631f67ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:50.873065 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d8ab5-edd5-48dd-b318-98c631f67ac2 admin admin] PATH_INFO: `/v3/users/2f6699187b5146ebbaeebc205cf33c60` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:50.874520 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d8ab5-edd5-48dd-b318-98c631f67ac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f6699187b5146ebbaeebc205cf33c60)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:50.877223 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d8ab5-edd5-48dd-b318-98c631f67ac2 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:50.880663 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426f8ec-7862-4912-b680-bbfa0892cc8d None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:50.889500 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfabf27-2b2f-4af9-8f51-6b78dff59a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:50.890198 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfabf27-2b2f-4af9-8f51-6b78dff59a8d admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:50.890472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfabf27-2b2f-4af9-8f51-6b78dff59a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:50.890746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfabf27-2b2f-4af9-8f51-6b78dff59a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:50.891658 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfabf27-2b2f-4af9-8f51-6b78dff59a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:50.893302 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfabf27-2b2f-4af9-8f51-6b78dff59a8d admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:50.913100 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1006/1983] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:50.917123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ed24c-8050-4eec-afe4-b4e609c98704 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:50.917432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ed24c-8050-4eec-afe4-b4e609c98704 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:50.917806 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ed24c-8050-4eec-afe4-b4e609c98704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:50.946530 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-851ed24c-8050-4eec-afe4-b4e609c98704 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:50.947616 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-851ed24c-8050-4eec-afe4-b4e609c98704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:50.964092 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1007/1984] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:50.965396 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ed24c-8050-4eec-afe4-b4e609c98704 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:50.980305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ed24c-8050-4eec-afe4-b4e609c98704 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:50.986057 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-8b4d8ab5-edd5-48dd-b318-98c631f67ac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f6699187b5146ebbaeebc205cf33c60'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:50.988380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59ccd-de6b-4aeb-a37e-27252b2e6a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:50.990024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59ccd-de6b-4aeb-a37e-27252b2e6a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:50.990341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59ccd-de6b-4aeb-a37e-27252b2e6a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:50.990728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59ccd-de6b-4aeb-a37e-27252b2e6a98 admin admin] PATH_INFO: `/v3/projects/d9aab6854acf4948876fd083ed6147da/users/d68cb8d2f000498484da3fafe9029a88/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:50.999498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-8b4d8ab5-edd5-48dd-b318-98c631f67ac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f6699187b5146ebbaeebc205cf33c60'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:51.015926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c59ccd-de6b-4aeb-a37e-27252b2e6a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9aab6854acf4948876fd083ed6147da, user_id=d68cb8d2f000498484da3fafe9029a88, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:51.020434 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c59ccd-de6b-4aeb-a37e-27252b2e6a98 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:51.030774 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-8b4d8ab5-edd5-48dd-b318-98c631f67ac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f6699187b5146ebbaeebc205cf33c60'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:51.031809 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-8b4d8ab5-edd5-48dd-b318-98c631f67ac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f6699187b5146ebbaeebc205cf33c60'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:51.046809 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-8b4d8ab5-edd5-48dd-b318-98c631f67ac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f6699187b5146ebbaeebc205cf33c60'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:51.047808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1008/1985] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:50 2022] PUT /identity/v3/projects/d9aab6854acf4948876fd083ed6147da/users/d68cb8d2f000498484da3fafe9029a88/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:51.062101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59ccd-de6b-4aeb-a37e-27252b2e6a98 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:51.066997 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 978/1986] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:50 2022] DELETE /identity/v3/users/2f6699187b5146ebbaeebc205cf33c60 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:51.067175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4ffc3-9866-4686-a62d-9ed978966b7e None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:51.067402 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4ffc3-9866-4686-a62d-9ed978966b7e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:51.068518 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4ffc3-9866-4686-a62d-9ed978966b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:51.068639 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-20c59ccd-de6b-4aeb-a37e-27252b2e6a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:51.103372 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-e9a4ffc3-9866-4686-a62d-9ed978966b7e None None] MFA Rules not processed for user `d68cb8d2f000498484da3fafe9029a88`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:51.104922 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-e9a4ffc3-9866-4686-a62d-9ed978966b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:51.174336 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59ccd-de6b-4aeb-a37e-27252b2e6a98 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:51.194647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 979/1987] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:51.196791 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa6e43-5366-4779-af69-10c69b77bc78 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:51.197579 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa6e43-5366-4779-af69-10c69b77bc78 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:51.197922 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa6e43-5366-4779-af69-10c69b77bc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:51.266615 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-58fa6e43-5366-4779-af69-10c69b77bc78 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:51.269461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-58fa6e43-5366-4779-af69-10c69b77bc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:51.328741 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0aa8f8-1b5c-4086-ab22-888046a9e5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:51.329450 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0aa8f8-1b5c-4086-ab22-888046a9e5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:51.329734 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0aa8f8-1b5c-4086-ab22-888046a9e5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:51.330018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0aa8f8-1b5c-4086-ab22-888046a9e5d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:51.332469 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0aa8f8-1b5c-4086-ab22-888046a9e5d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:06:51.332783 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0aa8f8-1b5c-4086-ab22-888046a9e5d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:51.334795 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0aa8f8-1b5c-4086-ab22-888046a9e5d2 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:51.376034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1009/1988] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:06:51.377405 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0aa8f8-1b5c-4086-ab22-888046a9e5d2 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:51.393070 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ff0aa8f8-1b5c-4086-ab22-888046a9e5d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:51.412703 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 980/1989] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:51.412703 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa6e43-5366-4779-af69-10c69b77bc78 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:51.444627 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa6e43-5366-4779-af69-10c69b77bc78 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:51.458183 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94067595-ba26-4d0c-a8d2-7405dcf19d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:51.459170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94067595-ba26-4d0c-a8d2-7405dcf19d2a admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:51.459463 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94067595-ba26-4d0c-a8d2-7405dcf19d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:51.459789 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94067595-ba26-4d0c-a8d2-7405dcf19d2a admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:51.460669 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94067595-ba26-4d0c-a8d2-7405dcf19d2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:51.463475 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94067595-ba26-4d0c-a8d2-7405dcf19d2a admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:51.521162 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 981/1990] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:51 2022] POST /identity/v3/projects => generated 401 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:51.521162 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94067595-ba26-4d0c-a8d2-7405dcf19d2a admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:51.523019 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-94067595-ba26-4d0c-a8d2-7405dcf19d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:51.532922 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0aa8f8-1b5c-4086-ab22-888046a9e5d2 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:51.614756 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c9906-79cc-4f22-9602-9ba63a7165e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:51.615219 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c9906-79cc-4f22-9602-9ba63a7165e1 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:51.615505 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c9906-79cc-4f22-9602-9ba63a7165e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:51.615783 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c9906-79cc-4f22-9602-9ba63a7165e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:51.655166 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94067595-ba26-4d0c-a8d2-7405dcf19d2a admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:51.661564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4087b-c21f-47b4-84aa-586037748989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:51.662731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4087b-c21f-47b4-84aa-586037748989 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:51.663239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4087b-c21f-47b4-84aa-586037748989 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:51.663607 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4087b-c21f-47b4-84aa-586037748989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:51.741603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c9906-79cc-4f22-9602-9ba63a7165e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:51.744836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c9906-79cc-4f22-9602-9ba63a7165e1 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:51.762040 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1010/1991] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:51.763461 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c9906-79cc-4f22-9602-9ba63a7165e1 service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:51.765574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-995c9906-79cc-4f22-9602-9ba63a7165e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:51.782628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4087b-c21f-47b4-84aa-586037748989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:51.785647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4087b-c21f-47b4-84aa-586037748989 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:51.809116 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 982/1992] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:51.810620 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4087b-c21f-47b4-84aa-586037748989 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:51.828851 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4087b-c21f-47b4-84aa-586037748989 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:51.839010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e88d7-cab2-461f-970e-99c27d13d64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:51.840085 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e88d7-cab2-461f-970e-99c27d13d64c admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:51.840619 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e88d7-cab2-461f-970e-99c27d13d64c admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:51.841071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e88d7-cab2-461f-970e-99c27d13d64c admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:51.842876 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e88d7-cab2-461f-970e-99c27d13d64c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:51.848401 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e88d7-cab2-461f-970e-99c27d13d64c admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:51.891417 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 983/1993] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:51 2022] POST /identity/v3/users => generated 301 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:51.891417 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e88d7-cab2-461f-970e-99c27d13d64c admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:51.896991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-349e88d7-cab2-461f-970e-99c27d13d64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:51.936196 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c9906-79cc-4f22-9602-9ba63a7165e1 service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:51.951349 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e88d7-cab2-461f-970e-99c27d13d64c admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:51.956725 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9320b-75c6-46c1-b1ad-5c1dd8222cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:51.958535 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9320b-75c6-46c1-b1ad-5c1dd8222cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:51.959166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9320b-75c6-46c1-b1ad-5c1dd8222cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:51.959595 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9320b-75c6-46c1-b1ad-5c1dd8222cd0 admin admin] PATH_INFO: `/v3/projects/af65af399a9a40258c465e161645360e` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:51.962798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9320b-75c6-46c1-b1ad-5c1dd8222cd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af65af399a9a40258c465e161645360e)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:51.966625 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9320b-75c6-46c1-b1ad-5c1dd8222cd0 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:51.969895 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e785a-5af7-4118-987b-fc3de1b7101d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:51.971414 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e785a-5af7-4118-987b-fc3de1b7101d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:51.971738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e785a-5af7-4118-987b-fc3de1b7101d admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:51.972177 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e785a-5af7-4118-987b-fc3de1b7101d admin admin] PATH_INFO: `/v3/users/d68cb8d2f000498484da3fafe9029a88` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:51.979079 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e785a-5af7-4118-987b-fc3de1b7101d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d68cb8d2f000498484da3fafe9029a88)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:51.988545 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e785a-5af7-4118-987b-fc3de1b7101d admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:52.066548 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e2f9320b-75c6-46c1-b1ad-5c1dd8222cd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af65af399a9a40258c465e161645360e', 'request_id': 'req-e2f9320b-75c6-46c1-b1ad-5c1dd8222cd0'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:52.077443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e2f9320b-75c6-46c1-b1ad-5c1dd8222cd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af65af399a9a40258c465e161645360e', 'request_id': 'req-e2f9320b-75c6-46c1-b1ad-5c1dd8222cd0'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:52.084069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-007e785a-5af7-4118-987b-fc3de1b7101d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd68cb8d2f000498484da3fafe9029a88'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:52.095098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e2f9320b-75c6-46c1-b1ad-5c1dd8222cd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af65af399a9a40258c465e161645360e', 'request_id': 'req-e2f9320b-75c6-46c1-b1ad-5c1dd8222cd0'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:52.103536 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-007e785a-5af7-4118-987b-fc3de1b7101d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd68cb8d2f000498484da3fafe9029a88'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:52.123812 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e2f9320b-75c6-46c1-b1ad-5c1dd8222cd0 admin admin] The token cache is being invalidate because project af65af399a9a40258c465e161645360e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:52.124314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e2f9320b-75c6-46c1-b1ad-5c1dd8222cd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:52.128497 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e2f9320b-75c6-46c1-b1ad-5c1dd8222cd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:52.131422 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1011/1994] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:51 2022] DELETE /identity/v3/projects/af65af399a9a40258c465e161645360e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:52.132962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9320b-75c6-46c1-b1ad-5c1dd8222cd0 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:52.135282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e2f9320b-75c6-46c1-b1ad-5c1dd8222cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:52.145804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-007e785a-5af7-4118-987b-fc3de1b7101d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd68cb8d2f000498484da3fafe9029a88'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:52.147307 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-007e785a-5af7-4118-987b-fc3de1b7101d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd68cb8d2f000498484da3fafe9029a88'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:52.162641 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-007e785a-5af7-4118-987b-fc3de1b7101d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd68cb8d2f000498484da3fafe9029a88'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:52.176179 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 984/1995] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:51 2022] DELETE /identity/v3/users/d68cb8d2f000498484da3fafe9029a88 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:52.178027 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e785a-5af7-4118-987b-fc3de1b7101d admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:52.181973 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-007e785a-5af7-4118-987b-fc3de1b7101d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:52.257065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9320b-75c6-46c1-b1ad-5c1dd8222cd0 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:52.292896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e785a-5af7-4118-987b-fc3de1b7101d admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:52.300768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32baf5-5469-47ed-bdd2-a882b4354d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:52.302327 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32baf5-5469-47ed-bdd2-a882b4354d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:52.302898 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32baf5-5469-47ed-bdd2-a882b4354d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:52.303385 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32baf5-5469-47ed-bdd2-a882b4354d54 admin admin] PATH_INFO: `/v3/users/a5a48eab73054b78aa46960b68257257` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:52.307129 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32baf5-5469-47ed-bdd2-a882b4354d54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5a48eab73054b78aa46960b68257257)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:52.311008 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32baf5-5469-47ed-bdd2-a882b4354d54 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:52.348720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e6cf8-4d8c-485b-baeb-75c9e3985ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:52.349620 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e6cf8-4d8c-485b-baeb-75c9e3985ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:52.349905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e6cf8-4d8c-485b-baeb-75c9e3985ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:52.350180 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e6cf8-4d8c-485b-baeb-75c9e3985ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:52.351011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e6cf8-4d8c-485b-baeb-75c9e3985ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:52.352740 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e6cf8-4d8c-485b-baeb-75c9e3985ce5 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:52.369288 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1012/1996] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:52.370793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0392f-e262-49c0-88c7-95ba2842950a None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:52.371117 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0392f-e262-49c0-88c7-95ba2842950a None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:52.371488 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0392f-e262-49c0-88c7-95ba2842950a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:52.392421 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-f5c0392f-e262-49c0-88c7-95ba2842950a None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:52.393710 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-f5c0392f-e262-49c0-88c7-95ba2842950a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:52.402251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1013/1997] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:52.403185 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0392f-e262-49c0-88c7-95ba2842950a None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:52.406801 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4f32baf5-5469-47ed-bdd2-a882b4354d54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5a48eab73054b78aa46960b68257257'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:52.413734 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-f5c0392f-e262-49c0-88c7-95ba2842950a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:52.420095 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4f32baf5-5469-47ed-bdd2-a882b4354d54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5a48eab73054b78aa46960b68257257'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:52.437891 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0392f-e262-49c0-88c7-95ba2842950a None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:52.438940 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4f32baf5-5469-47ed-bdd2-a882b4354d54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5a48eab73054b78aa46960b68257257'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:52.440163 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4f32baf5-5469-47ed-bdd2-a882b4354d54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5a48eab73054b78aa46960b68257257'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:52.446378 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d53f0-ad42-47df-bfb1-12219a4045ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:52.448153 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d53f0-ad42-47df-bfb1-12219a4045ea admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:52.448551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d53f0-ad42-47df-bfb1-12219a4045ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:52.449030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d53f0-ad42-47df-bfb1-12219a4045ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:52.450490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d53f0-ad42-47df-bfb1-12219a4045ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:52.451009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4f32baf5-5469-47ed-bdd2-a882b4354d54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5a48eab73054b78aa46960b68257257'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:52.453649 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d53f0-ad42-47df-bfb1-12219a4045ea admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:52.458167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 985/1998] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:52 2022] DELETE /identity/v3/users/a5a48eab73054b78aa46960b68257257 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:52.458760 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32baf5-5469-47ed-bdd2-a882b4354d54 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:52.460176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-4f32baf5-5469-47ed-bdd2-a882b4354d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:52.482927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1014/1999] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:52.489166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d53f0-ad42-47df-bfb1-12219a4045ea admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:52.493873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-b76d53f0-ad42-47df-bfb1-12219a4045ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:52.520530 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d53f0-ad42-47df-bfb1-12219a4045ea admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:52.552150 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32baf5-5469-47ed-bdd2-a882b4354d54 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:52.559825 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ecfa7-0015-40a7-8257-d72531223641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:52.560968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ecfa7-0015-40a7-8257-d72531223641 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:52.562245 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ecfa7-0015-40a7-8257-d72531223641 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:52.564492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ecfa7-0015-40a7-8257-d72531223641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:52.573057 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c26ecfa7-0015-40a7-8257-d72531223641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:52.669679 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc6f0c-738d-4743-a72f-9057282ecf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:52.671469 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc6f0c-738d-4743-a72f-9057282ecf0e admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:52.672031 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc6f0c-738d-4743-a72f-9057282ecf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:52.672544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc6f0c-738d-4743-a72f-9057282ecf0e admin admin] PATH_INFO: `/v3/projects/409178c7d3be48b197cca9038cf46e47/users/d74443f9ad6b44f3acfeb2e1556cf800/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:52.719519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ecfa7-0015-40a7-8257-d72531223641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:52.721196 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc6f0c-738d-4743-a72f-9057282ecf0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=409178c7d3be48b197cca9038cf46e47, user_id=d74443f9ad6b44f3acfeb2e1556cf800, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:52.721380 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ecfa7-0015-40a7-8257-d72531223641 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:52.728183 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc6f0c-738d-4743-a72f-9057282ecf0e admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:52.738543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 986/2000] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:52.740851 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ecfa7-0015-40a7-8257-d72531223641 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:52.760069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c26ecfa7-0015-40a7-8257-d72531223641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:52.764770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1015/2001] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:52 2022] PUT /identity/v3/projects/409178c7d3be48b197cca9038cf46e47/users/d74443f9ad6b44f3acfeb2e1556cf800/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:52.784337 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c591a2c-52de-49f7-a671-6c206a03f33e None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:52.786493 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ecfa7-0015-40a7-8257-d72531223641 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:52.786974 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c591a2c-52de-49f7-a671-6c206a03f33e None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:52.787909 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c591a2c-52de-49f7-a671-6c206a03f33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:52.871570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-1c591a2c-52de-49f7-a671-6c206a03f33e None None] MFA Rules not processed for user `d74443f9ad6b44f3acfeb2e1556cf800`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:52.873525 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-1c591a2c-52de-49f7-a671-6c206a03f33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:52.968490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61997f2-437f-4ac5-9ef6-0a5c4daeaacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:52.970981 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61997f2-437f-4ac5-9ef6-0a5c4daeaacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:52.972142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61997f2-437f-4ac5-9ef6-0a5c4daeaacf admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:52.972142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61997f2-437f-4ac5-9ef6-0a5c4daeaacf admin admin] PATH_INFO: `/v3/projects/c88dda0911b945fb862d8a3599b30140` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:52.975160 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61997f2-437f-4ac5-9ef6-0a5c4daeaacf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c88dda0911b945fb862d8a3599b30140)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:52.981110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61997f2-437f-4ac5-9ef6-0a5c4daeaacf admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:53.021959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1016/2002] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:53.022805 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c591a2c-52de-49f7-a671-6c206a03f33e None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:53.051455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c591a2c-52de-49f7-a671-6c206a03f33e None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:53.093025 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ab28b-de44-4b07-83eb-5fcac547d3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:53.095865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ab28b-de44-4b07-83eb-5fcac547d3f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:53.096775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ab28b-de44-4b07-83eb-5fcac547d3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:53.099716 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ab28b-de44-4b07-83eb-5fcac547d3f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:53.101533 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ab28b-de44-4b07-83eb-5fcac547d3f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:53.111597 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ab28b-de44-4b07-83eb-5fcac547d3f9 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:53.125092 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c61997f2-437f-4ac5-9ef6-0a5c4daeaacf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c88dda0911b945fb862d8a3599b30140', 'request_id': 'req-c61997f2-437f-4ac5-9ef6-0a5c4daeaacf'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:53.145274 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c61997f2-437f-4ac5-9ef6-0a5c4daeaacf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c88dda0911b945fb862d8a3599b30140', 'request_id': 'req-c61997f2-437f-4ac5-9ef6-0a5c4daeaacf'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:53.159701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c61997f2-437f-4ac5-9ef6-0a5c4daeaacf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c88dda0911b945fb862d8a3599b30140', 'request_id': 'req-c61997f2-437f-4ac5-9ef6-0a5c4daeaacf'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:53.192728 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c61997f2-437f-4ac5-9ef6-0a5c4daeaacf admin admin] The token cache is being invalidate because project c88dda0911b945fb862d8a3599b30140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:53.193220 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c61997f2-437f-4ac5-9ef6-0a5c4daeaacf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:53.194576 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c61997f2-437f-4ac5-9ef6-0a5c4daeaacf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:53.208599 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1017/2003] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:53 2022] POST /identity/v3/projects => generated 399 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:53.208599 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ab28b-de44-4b07-83eb-5fcac547d3f9 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:53.208599 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-202ab28b-de44-4b07-83eb-5fcac547d3f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:53.215665 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 987/2004] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:52 2022] DELETE /identity/v3/projects/c88dda0911b945fb862d8a3599b30140 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:53.217310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61997f2-437f-4ac5-9ef6-0a5c4daeaacf admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:53.224359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c61997f2-437f-4ac5-9ef6-0a5c4daeaacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:53.318682 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ab28b-de44-4b07-83eb-5fcac547d3f9 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:53.326147 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74648718-bd66-4cdb-b542-f2678e12b9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:53.327561 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74648718-bd66-4cdb-b542-f2678e12b9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:53.328002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74648718-bd66-4cdb-b542-f2678e12b9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:53.328473 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74648718-bd66-4cdb-b542-f2678e12b9b8 admin admin] PATH_INFO: `/v3/projects/337c92200d494b04bf277d5fdda74a1d` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:53.331915 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74648718-bd66-4cdb-b542-f2678e12b9b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=337c92200d494b04bf277d5fdda74a1d)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:53.334419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74648718-bd66-4cdb-b542-f2678e12b9b8 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:53.335814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61997f2-437f-4ac5-9ef6-0a5c4daeaacf admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:53.342329 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e5eea-d226-49b2-99c3-0cb6fe4ad397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:53.343242 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e5eea-d226-49b2-99c3-0cb6fe4ad397 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:53.343531 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e5eea-d226-49b2-99c3-0cb6fe4ad397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:53.343808 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e5eea-d226-49b2-99c3-0cb6fe4ad397 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:53.344508 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e5eea-d226-49b2-99c3-0cb6fe4ad397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:53.346981 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e5eea-d226-49b2-99c3-0cb6fe4ad397 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:53.373784 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 988/2005] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:53 2022] POST /identity/v3/users => generated 306 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:53.374519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e5eea-d226-49b2-99c3-0cb6fe4ad397 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:53.380939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6e8e5eea-d226-49b2-99c3-0cb6fe4ad397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:53.396635 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e5eea-d226-49b2-99c3-0cb6fe4ad397 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:53.406854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b6594-c503-46fd-aa94-d7a36016a797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:53.407773 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b6594-c503-46fd-aa94-d7a36016a797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:53.408059 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b6594-c503-46fd-aa94-d7a36016a797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:53.408336 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b6594-c503-46fd-aa94-d7a36016a797 admin admin] PATH_INFO: `/v3/users/2940223a013e4d20b80ef38c9ae59883` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:53.409575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b6594-c503-46fd-aa94-d7a36016a797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2940223a013e4d20b80ef38c9ae59883)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:53.411745 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b6594-c503-46fd-aa94-d7a36016a797 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:53.429567 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-74648718-bd66-4cdb-b542-f2678e12b9b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '337c92200d494b04bf277d5fdda74a1d', 'request_id': 'req-74648718-bd66-4cdb-b542-f2678e12b9b8'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:53.437239 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-74648718-bd66-4cdb-b542-f2678e12b9b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '337c92200d494b04bf277d5fdda74a1d', 'request_id': 'req-74648718-bd66-4cdb-b542-f2678e12b9b8'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:53.449306 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-74648718-bd66-4cdb-b542-f2678e12b9b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '337c92200d494b04bf277d5fdda74a1d', 'request_id': 'req-74648718-bd66-4cdb-b542-f2678e12b9b8'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:53.461753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-74648718-bd66-4cdb-b542-f2678e12b9b8 admin admin] The token cache is being invalidate because project 337c92200d494b04bf277d5fdda74a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:53.462607 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-74648718-bd66-4cdb-b542-f2678e12b9b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:53.463291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-74648718-bd66-4cdb-b542-f2678e12b9b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:53.464916 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1018/2006] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:53 2022] DELETE /identity/v3/projects/337c92200d494b04bf277d5fdda74a1d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:53.467988 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74648718-bd66-4cdb-b542-f2678e12b9b8 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:53.469614 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-74648718-bd66-4cdb-b542-f2678e12b9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:53.479640 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-765b6594-c503-46fd-aa94-d7a36016a797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2940223a013e4d20b80ef38c9ae59883'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:53.488980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-765b6594-c503-46fd-aa94-d7a36016a797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2940223a013e4d20b80ef38c9ae59883'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:53.506925 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-765b6594-c503-46fd-aa94-d7a36016a797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2940223a013e4d20b80ef38c9ae59883'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:53.507859 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-765b6594-c503-46fd-aa94-d7a36016a797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2940223a013e4d20b80ef38c9ae59883'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:53.519603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-765b6594-c503-46fd-aa94-d7a36016a797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2940223a013e4d20b80ef38c9ae59883'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:53.529998 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 989/2007] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:53 2022] DELETE /identity/v3/users/2940223a013e4d20b80ef38c9ae59883 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:53.531053 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b6594-c503-46fd-aa94-d7a36016a797 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:53.532517 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-765b6594-c503-46fd-aa94-d7a36016a797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:53.559738 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74648718-bd66-4cdb-b542-f2678e12b9b8 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:53.630409 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b6594-c503-46fd-aa94-d7a36016a797 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:53.640764 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7ad65-9b7a-4ae0-b40a-ebb80db622eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:53.641839 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7ad65-9b7a-4ae0-b40a-ebb80db622eb admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:53.642244 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7ad65-9b7a-4ae0-b40a-ebb80db622eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:53.642632 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7ad65-9b7a-4ae0-b40a-ebb80db622eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:53.644616 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7ad65-9b7a-4ae0-b40a-ebb80db622eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:53.647699 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7ad65-9b7a-4ae0-b40a-ebb80db622eb admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:53.654899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a48348-0e03-428c-8c42-a4443ebad8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:53.656293 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a48348-0e03-428c-8c42-a4443ebad8ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:53.656577 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a48348-0e03-428c-8c42-a4443ebad8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:53.656852 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a48348-0e03-428c-8c42-a4443ebad8ed admin admin] PATH_INFO: `/v3/projects/d9aab6854acf4948876fd083ed6147da` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:53.658426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a48348-0e03-428c-8c42-a4443ebad8ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9aab6854acf4948876fd083ed6147da)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:53.662091 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a48348-0e03-428c-8c42-a4443ebad8ed admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:53.664363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 990/2008] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:53.666689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a7a89-f079-4368-ba42-898db7e8c1d8 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:53.667207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a7a89-f079-4368-ba42-898db7e8c1d8 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:53.667900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a7a89-f079-4368-ba42-898db7e8c1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:53.752713 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-05a48348-0e03-428c-8c42-a4443ebad8ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9aab6854acf4948876fd083ed6147da', 'request_id': 'req-05a48348-0e03-428c-8c42-a4443ebad8ed'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:53.761924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-05a48348-0e03-428c-8c42-a4443ebad8ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9aab6854acf4948876fd083ed6147da', 'request_id': 'req-05a48348-0e03-428c-8c42-a4443ebad8ed'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:53.771697 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-05a48348-0e03-428c-8c42-a4443ebad8ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9aab6854acf4948876fd083ed6147da', 'request_id': 'req-05a48348-0e03-428c-8c42-a4443ebad8ed'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:53.785104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-05a48348-0e03-428c-8c42-a4443ebad8ed admin admin] The token cache is being invalidate because project d9aab6854acf4948876fd083ed6147da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:53.785478 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-05a48348-0e03-428c-8c42-a4443ebad8ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:53.786098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-05a48348-0e03-428c-8c42-a4443ebad8ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:53.788339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1019/2009] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:53 2022] DELETE /identity/v3/projects/d9aab6854acf4948876fd083ed6147da => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:53.789083 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a48348-0e03-428c-8c42-a4443ebad8ed admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:53.790697 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-05a48348-0e03-428c-8c42-a4443ebad8ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:53.835612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-141a7a89-f079-4368-ba42-898db7e8c1d8 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:53.838941 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-141a7a89-f079-4368-ba42-898db7e8c1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:53.870197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a48348-0e03-428c-8c42-a4443ebad8ed admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:53.876134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b6c3c-0e39-4bd0-862c-35d9ae1e5666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:53.877041 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b6c3c-0e39-4bd0-862c-35d9ae1e5666 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:53.877334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b6c3c-0e39-4bd0-862c-35d9ae1e5666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:53.877589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b6c3c-0e39-4bd0-862c-35d9ae1e5666 admin admin] PATH_INFO: `/v3/projects/ab84656c68c84055b0fa4cbf32fed0cc/users/834980ee93174bd1929578207679888f/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:53.902768 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b6c3c-0e39-4bd0-862c-35d9ae1e5666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab84656c68c84055b0fa4cbf32fed0cc, user_id=834980ee93174bd1929578207679888f, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:53.908463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b6c3c-0e39-4bd0-862c-35d9ae1e5666 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:53.912711 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 991/2010] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:53.914181 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e96e01-2b24-4ec4-9843-bfb5c72af512 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:53.914480 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e96e01-2b24-4ec4-9843-bfb5c72af512 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:53.914747 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e96e01-2b24-4ec4-9843-bfb5c72af512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:53.945928 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1020/2011] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:53 2022] PUT /identity/v3/projects/ab84656c68c84055b0fa4cbf32fed0cc/users/834980ee93174bd1929578207679888f/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:53.948955 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35decb-e1d4-41bb-a481-be2f350382d9 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:53.949494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35decb-e1d4-41bb-a481-be2f350382d9 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:53.950027 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35decb-e1d4-41bb-a481-be2f350382d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:53.952571 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-99e96e01-2b24-4ec4-9843-bfb5c72af512 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:53.953911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-99e96e01-2b24-4ec4-9843-bfb5c72af512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:53.976274 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-3f35decb-e1d4-41bb-a481-be2f350382d9 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:53.977439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-3f35decb-e1d4-41bb-a481-be2f350382d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:54.035759 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 992/2012] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:54.036739 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e96e01-2b24-4ec4-9843-bfb5c72af512 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:54.047087 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e96e01-2b24-4ec4-9843-bfb5c72af512 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:54.052302 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f03c7b-05d4-4636-9dff-cbb74ab1d5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:54.052999 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f03c7b-05d4-4636-9dff-cbb74ab1d5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:54.053290 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f03c7b-05d4-4636-9dff-cbb74ab1d5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:54.053564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f03c7b-05d4-4636-9dff-cbb74ab1d5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:54.054723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f03c7b-05d4-4636-9dff-cbb74ab1d5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:54.057105 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f03c7b-05d4-4636-9dff-cbb74ab1d5d1 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:54.067801 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 993/2013] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:54.069074 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f03c7b-05d4-4636-9dff-cbb74ab1d5d1 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:54.070910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-96f03c7b-05d4-4636-9dff-cbb74ab1d5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:54.084459 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f03c7b-05d4-4636-9dff-cbb74ab1d5d1 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:54.085710 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1021/2014] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:54.088148 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139fc7b-53d0-4add-aed3-f4bd01521779 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:54.088662 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139fc7b-53d0-4add-aed3-f4bd01521779 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:54.089175 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139fc7b-53d0-4add-aed3-f4bd01521779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:54.093849 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e0cbe-4836-4bc3-9881-4b762b2ff62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:54.095098 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e0cbe-4836-4bc3-9881-4b762b2ff62c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:54.095480 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e0cbe-4836-4bc3-9881-4b762b2ff62c admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:54.095877 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e0cbe-4836-4bc3-9881-4b762b2ff62c admin admin] PATH_INFO: `/v3/projects/48d12ce0129645c0ac81dd10def2e6e1` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:54.097225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e0cbe-4836-4bc3-9881-4b762b2ff62c admin admin] RBAC: Authorizing `identity:delete_project(project_id=48d12ce0129645c0ac81dd10def2e6e1)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:54.099530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e0cbe-4836-4bc3-9881-4b762b2ff62c admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:54.124471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-f139fc7b-53d0-4add-aed3-f4bd01521779 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:54.126660 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-f139fc7b-53d0-4add-aed3-f4bd01521779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:54.141203 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1022/2015] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:54.142579 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139fc7b-53d0-4add-aed3-f4bd01521779 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:54.166715 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-835e0cbe-4836-4bc3-9881-4b762b2ff62c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48d12ce0129645c0ac81dd10def2e6e1', 'request_id': 'req-835e0cbe-4836-4bc3-9881-4b762b2ff62c'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:54.175520 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-835e0cbe-4836-4bc3-9881-4b762b2ff62c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48d12ce0129645c0ac81dd10def2e6e1', 'request_id': 'req-835e0cbe-4836-4bc3-9881-4b762b2ff62c'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:54.182652 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139fc7b-53d0-4add-aed3-f4bd01521779 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:54.190312 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-835e0cbe-4836-4bc3-9881-4b762b2ff62c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48d12ce0129645c0ac81dd10def2e6e1', 'request_id': 'req-835e0cbe-4836-4bc3-9881-4b762b2ff62c'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:54.216976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-835e0cbe-4836-4bc3-9881-4b762b2ff62c admin admin] The token cache is being invalidate because project 48d12ce0129645c0ac81dd10def2e6e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:54.217489 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-835e0cbe-4836-4bc3-9881-4b762b2ff62c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:54.218756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-835e0cbe-4836-4bc3-9881-4b762b2ff62c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:54.223483 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 994/2016] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:54 2022] DELETE /identity/v3/projects/48d12ce0129645c0ac81dd10def2e6e1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:54.228063 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e0cbe-4836-4bc3-9881-4b762b2ff62c admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:54.229131 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-835e0cbe-4836-4bc3-9881-4b762b2ff62c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:54.285158 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c39f1-838a-4793-9832-ffcc83ff5fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:54.287152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c39f1-838a-4793-9832-ffcc83ff5fc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:54.292728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c39f1-838a-4793-9832-ffcc83ff5fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:54.292728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c39f1-838a-4793-9832-ffcc83ff5fc2 admin admin] PATH_INFO: `/v3/projects/ab84656c68c84055b0fa4cbf32fed0cc/users/834980ee93174bd1929578207679888f/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:54.292728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c39f1-838a-4793-9832-ffcc83ff5fc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab84656c68c84055b0fa4cbf32fed0cc, user_id=834980ee93174bd1929578207679888f, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:54.295087 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c39f1-838a-4793-9832-ffcc83ff5fc2 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:54.314515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1023/2017] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:54 2022] PUT /identity/v3/projects/ab84656c68c84055b0fa4cbf32fed0cc/users/834980ee93174bd1929578207679888f/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:54.323096 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c39f1-838a-4793-9832-ffcc83ff5fc2 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:54.333242 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-639c39f1-838a-4793-9832-ffcc83ff5fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:54.356202 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e0cbe-4836-4bc3-9881-4b762b2ff62c admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:54.432039 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd4a8b-983f-4485-98dc-485c5e318124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:54.432870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd4a8b-983f-4485-98dc-485c5e318124 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:54.433152 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd4a8b-983f-4485-98dc-485c5e318124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:54.433406 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd4a8b-983f-4485-98dc-485c5e318124 admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:54.434136 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd4a8b-983f-4485-98dc-485c5e318124 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:06:54.434439 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd4a8b-983f-4485-98dc-485c5e318124 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:54.438867 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd4a8b-983f-4485-98dc-485c5e318124 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:54.454169 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 995/2018] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:06:54.455880 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd4a8b-983f-4485-98dc-485c5e318124 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:54.456015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c39f1-838a-4793-9832-ffcc83ff5fc2 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:54.459531 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c1dd4a8b-983f-4485-98dc-485c5e318124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:54.462701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91d8d3-c5c2-4296-be8a-9cef04b7d8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:54.463431 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91d8d3-c5c2-4296-be8a-9cef04b7d8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:54.463713 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91d8d3-c5c2-4296-be8a-9cef04b7d8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:54.463988 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91d8d3-c5c2-4296-be8a-9cef04b7d8f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:54.464761 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91d8d3-c5c2-4296-be8a-9cef04b7d8f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:06:54.465069 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91d8d3-c5c2-4296-be8a-9cef04b7d8f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:54.466663 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91d8d3-c5c2-4296-be8a-9cef04b7d8f6 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:54.472842 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd4a8b-983f-4485-98dc-485c5e318124 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:54.478201 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147875fc-cca0-495c-84b8-321d27b8ccf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:54.479204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147875fc-cca0-495c-84b8-321d27b8ccf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:54.479614 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147875fc-cca0-495c-84b8-321d27b8ccf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:54.479891 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147875fc-cca0-495c-84b8-321d27b8ccf7 admin admin] PATH_INFO: `/v3/users/c00281d3a87d44e2810bfaea4d1d4901` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:54.481132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147875fc-cca0-495c-84b8-321d27b8ccf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c00281d3a87d44e2810bfaea4d1d4901)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:54.482134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1024/2019] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:06:54.484360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147875fc-cca0-495c-84b8-321d27b8ccf7 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:54.485554 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f4b42-721e-43d1-af73-7986b666274f None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:54.485845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f4b42-721e-43d1-af73-7986b666274f None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:54.486123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f4b42-721e-43d1-af73-7986b666274f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:54.518106 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-f87f4b42-721e-43d1-af73-7986b666274f None None] MFA Rules not processed for user `834980ee93174bd1929578207679888f`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:54.519379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-f87f4b42-721e-43d1-af73-7986b666274f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:54.538843 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-147875fc-cca0-495c-84b8-321d27b8ccf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c00281d3a87d44e2810bfaea4d1d4901'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:54.547422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-147875fc-cca0-495c-84b8-321d27b8ccf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c00281d3a87d44e2810bfaea4d1d4901'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:54.561408 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-147875fc-cca0-495c-84b8-321d27b8ccf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c00281d3a87d44e2810bfaea4d1d4901'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:54.562186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-147875fc-cca0-495c-84b8-321d27b8ccf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c00281d3a87d44e2810bfaea4d1d4901'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:54.569438 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-147875fc-cca0-495c-84b8-321d27b8ccf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c00281d3a87d44e2810bfaea4d1d4901'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:54.578635 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 996/2020] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:06:54 2022] DELETE /identity/v3/users/c00281d3a87d44e2810bfaea4d1d4901 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:54.580427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147875fc-cca0-495c-84b8-321d27b8ccf7 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:54.582668 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-147875fc-cca0-495c-84b8-321d27b8ccf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:54.595462 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1025/2021] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:54 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:54.601117 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f4b42-721e-43d1-af73-7986b666274f None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:54.603013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-f87f4b42-721e-43d1-af73-7986b666274f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:54.620403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f4b42-721e-43d1-af73-7986b666274f None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:54.700441 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e708b-9d0c-4c64-8632-28c17dd73e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:54.701027 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e708b-9d0c-4c64-8632-28c17dd73e5a admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:54.701319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e708b-9d0c-4c64-8632-28c17dd73e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:54.701547 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e708b-9d0c-4c64-8632-28c17dd73e5a admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:54.702365 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e708b-9d0c-4c64-8632-28c17dd73e5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:54.704392 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e708b-9d0c-4c64-8632-28c17dd73e5a admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:54.709900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147875fc-cca0-495c-84b8-321d27b8ccf7 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:54.719051 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beba81a-77e1-4404-9189-9871ea1854fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:54.720207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beba81a-77e1-4404-9189-9871ea1854fb admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:54.720707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beba81a-77e1-4404-9189-9871ea1854fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:54.721326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beba81a-77e1-4404-9189-9871ea1854fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:54.723373 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beba81a-77e1-4404-9189-9871ea1854fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:54.728785 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beba81a-77e1-4404-9189-9871ea1854fb admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:54.735392 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1026/2022] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:54 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:54.736178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e708b-9d0c-4c64-8632-28c17dd73e5a admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:54.737878 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-794e708b-9d0c-4c64-8632-28c17dd73e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:54.767601 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 997/2023] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:54 2022] POST /identity/v3/projects => generated 407 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:54.768697 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beba81a-77e1-4404-9189-9871ea1854fb admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:54.827067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e708b-9d0c-4c64-8632-28c17dd73e5a admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:54.846412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beba81a-77e1-4404-9189-9871ea1854fb admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:54.851670 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07459c9-8d3f-4b0c-baf0-080f726af15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:54.852923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07459c9-8d3f-4b0c-baf0-080f726af15b admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:54.853209 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07459c9-8d3f-4b0c-baf0-080f726af15b admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:54.853662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07459c9-8d3f-4b0c-baf0-080f726af15b admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:54.854225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07459c9-8d3f-4b0c-baf0-080f726af15b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:54.856531 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07459c9-8d3f-4b0c-baf0-080f726af15b admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:54.881338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 998/2024] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:54 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:54.882279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07459c9-8d3f-4b0c-baf0-080f726af15b admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:54.892769 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07459c9-8d3f-4b0c-baf0-080f726af15b admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:54.898310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d450dd9-960c-45bb-b55e-2163ba902ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:54.899033 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d450dd9-960c-45bb-b55e-2163ba902ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:54.899492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d450dd9-960c-45bb-b55e-2163ba902ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:54.899910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d450dd9-960c-45bb-b55e-2163ba902ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:54.900681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d450dd9-960c-45bb-b55e-2163ba902ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:54.902757 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d450dd9-960c-45bb-b55e-2163ba902ce3 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:54.909563 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcae26-586e-4c83-b6e9-cb8c1c1b509a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:54.910739 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcae26-586e-4c83-b6e9-cb8c1c1b509a service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:54.911335 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcae26-586e-4c83-b6e9-cb8c1c1b509a service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:54.911526 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcae26-586e-4c83-b6e9-cb8c1c1b509a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:54.941622 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 999/2025] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:54 2022] POST /identity/v3/users => generated 304 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:54.943383 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d450dd9-960c-45bb-b55e-2163ba902ce3 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:54.961635 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d450dd9-960c-45bb-b55e-2163ba902ce3 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:54.970084 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989a014-0e34-4dc1-9570-dc078ef38623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:54.971403 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989a014-0e34-4dc1-9570-dc078ef38623 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:54.971886 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989a014-0e34-4dc1-9570-dc078ef38623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:54.973232 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989a014-0e34-4dc1-9570-dc078ef38623 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:54.974584 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989a014-0e34-4dc1-9570-dc078ef38623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:54.978173 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989a014-0e34-4dc1-9570-dc078ef38623 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:54.998556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1000/2026] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:55.000104 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989a014-0e34-4dc1-9570-dc078ef38623 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:55.015041 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcae26-586e-4c83-b6e9-cb8c1c1b509a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:55.016511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcae26-586e-4c83-b6e9-cb8c1c1b509a service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:55.017621 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989a014-0e34-4dc1-9570-dc078ef38623 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:55.028086 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee521ac-ca99-46f0-8cac-d37c34dcf323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:55.029017 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee521ac-ca99-46f0-8cac-d37c34dcf323 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:55.029464 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee521ac-ca99-46f0-8cac-d37c34dcf323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:55.029979 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee521ac-ca99-46f0-8cac-d37c34dcf323 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:55.031480 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee521ac-ca99-46f0-8cac-d37c34dcf323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:55.033969 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1027/2027] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:54 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:55.034323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee521ac-ca99-46f0-8cac-d37c34dcf323 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:55.036511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcae26-586e-4c83-b6e9-cb8c1c1b509a service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:55.057138 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1001/2028] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:55.058717 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee521ac-ca99-46f0-8cac-d37c34dcf323 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:55.065578 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcae26-586e-4c83-b6e9-cb8c1c1b509a service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:55.073852 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241a2f7-57d8-4d06-8c7f-940e4ba0f319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:55.074889 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241a2f7-57d8-4d06-8c7f-940e4ba0f319 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:55.075201 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241a2f7-57d8-4d06-8c7f-940e4ba0f319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:55.075549 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241a2f7-57d8-4d06-8c7f-940e4ba0f319 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:55.076908 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241a2f7-57d8-4d06-8c7f-940e4ba0f319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:55.080572 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-1ee521ac-ca99-46f0-8cac-d37c34dcf323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:55.080760 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241a2f7-57d8-4d06-8c7f-940e4ba0f319 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:55.101066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1028/2029] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:55.105930 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee521ac-ca99-46f0-8cac-d37c34dcf323 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:55.107173 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241a2f7-57d8-4d06-8c7f-940e4ba0f319 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:55.116768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecc476-cb42-4d86-b8d8-a720e282a359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:55.119089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecc476-cb42-4d86-b8d8-a720e282a359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:55.119612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecc476-cb42-4d86-b8d8-a720e282a359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:55.120107 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecc476-cb42-4d86-b8d8-a720e282a359 admin admin] PATH_INFO: `/v3/projects/d310cf7a5c144ee99c49e28da571cbdb` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:55.122461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ecc476-cb42-4d86-b8d8-a720e282a359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d310cf7a5c144ee99c49e28da571cbdb)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:55.125011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241a2f7-57d8-4d06-8c7f-940e4ba0f319 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:55.127015 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ecc476-cb42-4d86-b8d8-a720e282a359 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:55.133141 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e412ff8-664f-474e-a9c9-280edecd9c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:55.134747 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e412ff8-664f-474e-a9c9-280edecd9c3e admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:55.135452 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e412ff8-664f-474e-a9c9-280edecd9c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:55.136103 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e412ff8-664f-474e-a9c9-280edecd9c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:55.137634 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e412ff8-664f-474e-a9c9-280edecd9c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:55.140474 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e412ff8-664f-474e-a9c9-280edecd9c3e admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:55.157684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1029/2030] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:55.157684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e412ff8-664f-474e-a9c9-280edecd9c3e admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:55.172001 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e412ff8-664f-474e-a9c9-280edecd9c3e admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:55.186362 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79fc95-e613-4ee1-b957-3a1b76977438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:55.188821 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79fc95-e613-4ee1-b957-3a1b76977438 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:55.189759 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79fc95-e613-4ee1-b957-3a1b76977438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:55.190516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79fc95-e613-4ee1-b957-3a1b76977438 admin admin] PATH_INFO: `/v3/projects/b42e0def324642089afe8b25a29e2817/users/1ad47d91fb074164abff84205fe5e9c6/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:55.202324 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-14ecc476-cb42-4d86-b8d8-a720e282a359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd310cf7a5c144ee99c49e28da571cbdb', 'request_id': 'req-14ecc476-cb42-4d86-b8d8-a720e282a359'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:55.210523 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-14ecc476-cb42-4d86-b8d8-a720e282a359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd310cf7a5c144ee99c49e28da571cbdb', 'request_id': 'req-14ecc476-cb42-4d86-b8d8-a720e282a359'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:55.218024 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-14ecc476-cb42-4d86-b8d8-a720e282a359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd310cf7a5c144ee99c49e28da571cbdb', 'request_id': 'req-14ecc476-cb42-4d86-b8d8-a720e282a359'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:55.228243 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79fc95-e613-4ee1-b957-3a1b76977438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b42e0def324642089afe8b25a29e2817, user_id=1ad47d91fb074164abff84205fe5e9c6, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:55.234018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79fc95-e613-4ee1-b957-3a1b76977438 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:55.238664 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-14ecc476-cb42-4d86-b8d8-a720e282a359 admin admin] The token cache is being invalidate because project d310cf7a5c144ee99c49e28da571cbdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:06:55.239260 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-14ecc476-cb42-4d86-b8d8-a720e282a359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:55.241428 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-14ecc476-cb42-4d86-b8d8-a720e282a359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:06:55.248093 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1002/2031] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:06:55 2022] DELETE /identity/v3/projects/d310cf7a5c144ee99c49e28da571cbdb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:55.248093 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecc476-cb42-4d86-b8d8-a720e282a359 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:55.248960 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-14ecc476-cb42-4d86-b8d8-a720e282a359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:55.257859 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1030/2032] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:55 2022] PUT /identity/v3/projects/b42e0def324642089afe8b25a29e2817/users/1ad47d91fb074164abff84205fe5e9c6/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:55.259689 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79fc95-e613-4ee1-b957-3a1b76977438 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:55.263512 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-db79fc95-e613-4ee1-b957-3a1b76977438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:55.376245 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79fc95-e613-4ee1-b957-3a1b76977438 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:55.377318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecc476-cb42-4d86-b8d8-a720e282a359 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:55.382111 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780811a-2b7b-4065-b0a3-2027daeead43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:55.383201 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780811a-2b7b-4065-b0a3-2027daeead43 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:55.383745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780811a-2b7b-4065-b0a3-2027daeead43 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:55.384361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780811a-2b7b-4065-b0a3-2027daeead43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:55.386670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e780811a-2b7b-4065-b0a3-2027daeead43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:55.479674 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef54b36-dd6d-4b85-889a-11abbb1b9076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:55.480044 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780811a-2b7b-4065-b0a3-2027daeead43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:55.480571 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef54b36-dd6d-4b85-889a-11abbb1b9076 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:55.480848 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef54b36-dd6d-4b85-889a-11abbb1b9076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:55.481121 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef54b36-dd6d-4b85-889a-11abbb1b9076 admin admin] PATH_INFO: `/v3/projects/31fd316967834ffa8efcad3e5684dbbb/users/7ee8d0f931e94032958eaebb81960893/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:55.481975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780811a-2b7b-4065-b0a3-2027daeead43 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:55.497061 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1031/2033] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:55.498720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70051fc2-46c0-456d-bb52-414cdb70b121 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:55.500101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70051fc2-46c0-456d-bb52-414cdb70b121 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:55.500381 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70051fc2-46c0-456d-bb52-414cdb70b121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:55.505909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef54b36-dd6d-4b85-889a-11abbb1b9076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31fd316967834ffa8efcad3e5684dbbb, user_id=7ee8d0f931e94032958eaebb81960893, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:55.508759 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef54b36-dd6d-4b85-889a-11abbb1b9076 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:55.528682 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1003/2034] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:55 2022] PUT /identity/v3/projects/31fd316967834ffa8efcad3e5684dbbb/users/7ee8d0f931e94032958eaebb81960893/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:55.530031 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a6412-a905-457e-bb40-28f71b41d792 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:55.530324 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a6412-a905-457e-bb40-28f71b41d792 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:55.530601 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a6412-a905-457e-bb40-28f71b41d792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:55.552695 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-70051fc2-46c0-456d-bb52-414cdb70b121 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:55.554598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-70051fc2-46c0-456d-bb52-414cdb70b121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:55.561676 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-ab5a6412-a905-457e-bb40-28f71b41d792 None None] MFA Rules not processed for user `1ad47d91fb074164abff84205fe5e9c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:55.562961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ab5a6412-a905-457e-bb40-28f71b41d792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:55.653931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1032/2035] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:55.653931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d665e01-d7f9-4d0c-bbc6-eb43dc6de651 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:55.653931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d665e01-d7f9-4d0c-bbc6-eb43dc6de651 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:55.653931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d665e01-d7f9-4d0c-bbc6-eb43dc6de651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:55.667394 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1004/2036] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:55.670098 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850a23c-8d66-455a-af5f-0c52adf44990 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:55.681821 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850a23c-8d66-455a-af5f-0c52adf44990 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:55.682806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850a23c-8d66-455a-af5f-0c52adf44990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:55.690989 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-6d665e01-d7f9-4d0c-bbc6-eb43dc6de651 None None] MFA Rules not processed for user `7ee8d0f931e94032958eaebb81960893`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:55.692490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-6d665e01-d7f9-4d0c-bbc6-eb43dc6de651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:55.723094 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-5850a23c-8d66-455a-af5f-0c52adf44990 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:55.726508 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-5850a23c-8d66-455a-af5f-0c52adf44990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:55.763750 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1005/2037] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:55.766152 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850a23c-8d66-455a-af5f-0c52adf44990 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:55.770797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-5850a23c-8d66-455a-af5f-0c52adf44990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:55.817187 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1033/2038] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:55 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:55.819267 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d665e01-d7f9-4d0c-bbc6-eb43dc6de651 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:55.838443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d665e01-d7f9-4d0c-bbc6-eb43dc6de651 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:55.845078 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f424a-00f9-466e-a3bf-a7c865ae109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:55.845927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f424a-00f9-466e-a3bf-a7c865ae109d admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:55.846259 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f424a-00f9-466e-a3bf-a7c865ae109d admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:55.846555 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f424a-00f9-466e-a3bf-a7c865ae109d admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:55.847360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f424a-00f9-466e-a3bf-a7c865ae109d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:06:55.847647 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f424a-00f9-466e-a3bf-a7c865ae109d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:55.849463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f424a-00f9-466e-a3bf-a7c865ae109d admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:55.878958 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850a23c-8d66-455a-af5f-0c52adf44990 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:55.886501 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036be39-83c1-40b5-b6d4-0ea38a8f9a54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:55.887673 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036be39-83c1-40b5-b6d4-0ea38a8f9a54 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:55.888164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036be39-83c1-40b5-b6d4-0ea38a8f9a54 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:55.888549 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036be39-83c1-40b5-b6d4-0ea38a8f9a54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:55.894349 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1034/2039] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:06:55.895234 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f424a-00f9-466e-a3bf-a7c865ae109d admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:55.900935 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036be39-83c1-40b5-b6d4-0ea38a8f9a54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:55.902853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036be39-83c1-40b5-b6d4-0ea38a8f9a54 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:55.911077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f424a-00f9-466e-a3bf-a7c865ae109d admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:55.917339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1006/2040] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:55.918406 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036be39-83c1-40b5-b6d4-0ea38a8f9a54 service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:55.929356 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3919a-e19a-4b1a-9e99-f56f4ccee76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:55.929882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3919a-e19a-4b1a-9e99-f56f4ccee76f admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:55.930146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3919a-e19a-4b1a-9e99-f56f4ccee76f admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:55.930497 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3919a-e19a-4b1a-9e99-f56f4ccee76f admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:55.930497 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3919a-e19a-4b1a-9e99-f56f4ccee76f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:55.933881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3919a-e19a-4b1a-9e99-f56f4ccee76f admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:55.939449 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036be39-83c1-40b5-b6d4-0ea38a8f9a54 service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:55.954247 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d67742-c030-4507-b656-1d73b5beadfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:55.956293 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d67742-c030-4507-b656-1d73b5beadfe admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:55.956803 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d67742-c030-4507-b656-1d73b5beadfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:55.957482 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d67742-c030-4507-b656-1d73b5beadfe admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:55.958652 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d67742-c030-4507-b656-1d73b5beadfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:55.962553 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d67742-c030-4507-b656-1d73b5beadfe admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:56.000397 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1035/2041] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:55 2022] POST /identity/v3/projects => generated 409 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:56.005949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3919a-e19a-4b1a-9e99-f56f4ccee76f admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:56.013200 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1007/2042] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:06:55 2022] POST /identity/v3/projects => generated 369 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:56.021139 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d67742-c030-4507-b656-1d73b5beadfe admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:56.158397 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3919a-e19a-4b1a-9e99-f56f4ccee76f admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:56.208958 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d67742-c030-4507-b656-1d73b5beadfe admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:56.222111 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e16dde-23af-43f7-a34d-80d918683356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:56.222111 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e16dde-23af-43f7-a34d-80d918683356 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:56.222111 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e16dde-23af-43f7-a34d-80d918683356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:56.222494 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e16dde-23af-43f7-a34d-80d918683356 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:56.224570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e16dde-23af-43f7-a34d-80d918683356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:56.229715 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e16dde-23af-43f7-a34d-80d918683356 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:56.233009 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1df7b3-c21d-43a6-b1c7-4789f2b29431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:56.233759 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1df7b3-c21d-43a6-b1c7-4789f2b29431 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:56.234039 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1df7b3-c21d-43a6-b1c7-4789f2b29431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:56.234314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1df7b3-c21d-43a6-b1c7-4789f2b29431 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:56.235265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1df7b3-c21d-43a6-b1c7-4789f2b29431 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:56.237311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1df7b3-c21d-43a6-b1c7-4789f2b29431 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:56.260507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1008/2043] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:56 2022] POST /identity/v3/users => generated 285 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:06:56.264873 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e16dde-23af-43f7-a34d-80d918683356 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:56.270862 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1036/2044] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:06:56 2022] POST /identity/v3/users => generated 311 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:06:56.276956 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1df7b3-c21d-43a6-b1c7-4789f2b29431 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:56.280297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e16dde-23af-43f7-a34d-80d918683356 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:56.290598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1df7b3-c21d-43a6-b1c7-4789f2b29431 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:56.292840 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66544c-8b3e-449a-a253-0e7a4051ef96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:56.293521 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66544c-8b3e-449a-a253-0e7a4051ef96 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:56.293798 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66544c-8b3e-449a-a253-0e7a4051ef96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:56.294065 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66544c-8b3e-449a-a253-0e7a4051ef96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:56.294878 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66544c-8b3e-449a-a253-0e7a4051ef96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:56.296649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66544c-8b3e-449a-a253-0e7a4051ef96 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:56.307658 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c1f0a-3627-48e5-988b-e55c19e5554d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:56.308763 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c1f0a-3627-48e5-988b-e55c19e5554d admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:56.308905 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1009/2045] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:06:56.308989 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c1f0a-3627-48e5-988b-e55c19e5554d admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:56.308989 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c1f0a-3627-48e5-988b-e55c19e5554d admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:56.317430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c1f0a-3627-48e5-988b-e55c19e5554d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:56.317430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c1f0a-3627-48e5-988b-e55c19e5554d admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:56.319787 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66544c-8b3e-449a-a253-0e7a4051ef96 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:56.331394 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1037/2046] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:06:56.336235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c1f0a-3627-48e5-988b-e55c19e5554d admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:56.342233 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66544c-8b3e-449a-a253-0e7a4051ef96 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:56.353038 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0ea58-a722-47d3-a451-66736b0aaa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:56.354358 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0ea58-a722-47d3-a451-66736b0aaa4d admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:56.355518 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0ea58-a722-47d3-a451-66736b0aaa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:56.355995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0ea58-a722-47d3-a451-66736b0aaa4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:56.357536 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0ea58-a722-47d3-a451-66736b0aaa4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:56.361214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0ea58-a722-47d3-a451-66736b0aaa4d admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:56.361378 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c1f0a-3627-48e5-988b-e55c19e5554d admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:56.376977 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb37fca-8be8-49cb-b23f-856c0ba7b6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:56.379368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb37fca-8be8-49cb-b23f-856c0ba7b6b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:56.380004 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb37fca-8be8-49cb-b23f-856c0ba7b6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:56.380296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb37fca-8be8-49cb-b23f-856c0ba7b6b1 admin admin] PATH_INFO: `/v3/projects/d642e3ad34ad454784a362b1662ed6a5/users/5473aa57ce2b4e9e90a5667980f8a84a/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:56.387785 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1010/2047] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:06:56.390483 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0ea58-a722-47d3-a451-66736b0aaa4d admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:56.405613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb37fca-8be8-49cb-b23f-856c0ba7b6b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d642e3ad34ad454784a362b1662ed6a5, user_id=5473aa57ce2b4e9e90a5667980f8a84a, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:56.407293 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0ea58-a722-47d3-a451-66736b0aaa4d admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:56.409101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb37fca-8be8-49cb-b23f-856c0ba7b6b1 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:56.417013 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffec5f5-d08b-4d0a-aee1-a417840b8228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:56.418120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffec5f5-d08b-4d0a-aee1-a417840b8228 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:56.418468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffec5f5-d08b-4d0a-aee1-a417840b8228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:56.418808 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffec5f5-d08b-4d0a-aee1-a417840b8228 admin admin] PATH_INFO: `/v3/projects/9f120d52dd5b4fbf9c5226f1fa7a26ea/users/1a01e9f4844940af9d8b112eb8d9efdc/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:56.427404 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1038/2048] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:56 2022] PUT /identity/v3/projects/d642e3ad34ad454784a362b1662ed6a5/users/5473aa57ce2b4e9e90a5667980f8a84a/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:56.432015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb37fca-8be8-49cb-b23f-856c0ba7b6b1 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:56.443514 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffec5f5-d08b-4d0a-aee1-a417840b8228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f120d52dd5b4fbf9c5226f1fa7a26ea, user_id=1a01e9f4844940af9d8b112eb8d9efdc, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:56.446727 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffec5f5-d08b-4d0a-aee1-a417840b8228 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:56.462626 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1011/2049] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:56 2022] PUT /identity/v3/projects/9f120d52dd5b4fbf9c5226f1fa7a26ea/users/1a01e9f4844940af9d8b112eb8d9efdc/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:06:56.468529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bd1c5-7aa8-4e73-8a5d-b24b31d38917 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:56.468998 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bd1c5-7aa8-4e73-8a5d-b24b31d38917 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:56.469430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bd1c5-7aa8-4e73-8a5d-b24b31d38917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:56.493574 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-a88bd1c5-7aa8-4e73-8a5d-b24b31d38917 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:56.497466 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-a88bd1c5-7aa8-4e73-8a5d-b24b31d38917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:56.521120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb37fca-8be8-49cb-b23f-856c0ba7b6b1 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:56.584163 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1012/2050] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:56.601288 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bd1c5-7aa8-4e73-8a5d-b24b31d38917 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:56.604243 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-a88bd1c5-7aa8-4e73-8a5d-b24b31d38917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:56.659710 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7d6e0-46c3-454a-9c69-b4ded4587cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:56.660482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7d6e0-46c3-454a-9c69-b4ded4587cbf admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:56.660762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7d6e0-46c3-454a-9c69-b4ded4587cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:56.661047 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7d6e0-46c3-454a-9c69-b4ded4587cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:56.664745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7d6e0-46c3-454a-9c69-b4ded4587cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:56.666426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7d6e0-46c3-454a-9c69-b4ded4587cbf admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:56.679820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1039/2051] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:06:56.684703 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7d6e0-46c3-454a-9c69-b4ded4587cbf admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:56.698148 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7d6e0-46c3-454a-9c69-b4ded4587cbf admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:56.707528 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d60aed-ef1b-4bb0-8e17-3aa5c0efe656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:56.708760 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d60aed-ef1b-4bb0-8e17-3aa5c0efe656 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:56.709191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d60aed-ef1b-4bb0-8e17-3aa5c0efe656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:56.709739 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d60aed-ef1b-4bb0-8e17-3aa5c0efe656 admin admin] PATH_INFO: `/v3/projects/d642e3ad34ad454784a362b1662ed6a5/users/5473aa57ce2b4e9e90a5667980f8a84a/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:56.713568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d60aed-ef1b-4bb0-8e17-3aa5c0efe656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d642e3ad34ad454784a362b1662ed6a5, user_id=5473aa57ce2b4e9e90a5667980f8a84a, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:56.717055 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d60aed-ef1b-4bb0-8e17-3aa5c0efe656 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:56.730960 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1040/2052] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:06:56 2022] PUT /identity/v3/projects/d642e3ad34ad454784a362b1662ed6a5/users/5473aa57ce2b4e9e90a5667980f8a84a/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:06:56.742934 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02be1cc-b04a-4c0f-b892-f064aa891055 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:56.743377 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02be1cc-b04a-4c0f-b892-f064aa891055 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:56.743690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02be1cc-b04a-4c0f-b892-f064aa891055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:56.751180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bd1c5-7aa8-4e73-8a5d-b24b31d38917 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:56.773732 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-c02be1cc-b04a-4c0f-b892-f064aa891055 None None] MFA Rules not processed for user `5473aa57ce2b4e9e90a5667980f8a84a`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:56.775997 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-c02be1cc-b04a-4c0f-b892-f064aa891055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:56.831270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad527e1-9ad6-4377-b805-9e907dca57f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:56.831795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad527e1-9ad6-4377-b805-9e907dca57f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:56.832147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad527e1-9ad6-4377-b805-9e907dca57f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:56.832555 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad527e1-9ad6-4377-b805-9e907dca57f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:56.863367 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1041/2053] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:56 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:06:56.875092 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02be1cc-b04a-4c0f-b892-f064aa891055 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:56.917445 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad527e1-9ad6-4377-b805-9e907dca57f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:56.920732 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad527e1-9ad6-4377-b805-9e907dca57f3 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:56.936380 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1013/2054] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:56.966264 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02be1cc-b04a-4c0f-b892-f064aa891055 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:56.973923 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac577556-ee3c-43de-98a4-26b7076635a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:56.975521 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac577556-ee3c-43de-98a4-26b7076635a5 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:56.975835 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac577556-ee3c-43de-98a4-26b7076635a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:56.976254 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac577556-ee3c-43de-98a4-26b7076635a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:56.995150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac577556-ee3c-43de-98a4-26b7076635a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:56.996720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac577556-ee3c-43de-98a4-26b7076635a5 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:57.007655 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1042/2055] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:56 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:06:57.231186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad527e1-9ad6-4377-b805-9e907dca57f3 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:57.240789 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad527e1-9ad6-4377-b805-9e907dca57f3 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:57.244700 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a347e0-a2fe-4fa0-bbc9-4c2d44619e71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:57.245370 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a347e0-a2fe-4fa0-bbc9-4c2d44619e71 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:57.245811 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a347e0-a2fe-4fa0-bbc9-4c2d44619e71 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:57.246099 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a347e0-a2fe-4fa0-bbc9-4c2d44619e71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:57.311651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a347e0-a2fe-4fa0-bbc9-4c2d44619e71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:57.313146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a347e0-a2fe-4fa0-bbc9-4c2d44619e71 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:57.324237 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1014/2056] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:57 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:06:57.807755 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c5aab-03c9-4bf1-b4d7-aae4a71639fc None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:57.808295 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c5aab-03c9-4bf1-b4d7-aae4a71639fc None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:57.808513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c5aab-03c9-4bf1-b4d7-aae4a71639fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:57.846729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-298c5aab-03c9-4bf1-b4d7-aae4a71639fc None None] MFA Rules not processed for user `1a01e9f4844940af9d8b112eb8d9efdc`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:06:57.848128 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-298c5aab-03c9-4bf1-b4d7-aae4a71639fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:06:57.935713 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1043/2057] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:06:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:06:57.946855 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a347e0-a2fe-4fa0-bbc9-4c2d44619e71 service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:06:57.956816 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a347e0-a2fe-4fa0-bbc9-4c2d44619e71 service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:06:57.960663 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d35457-96ac-428f-8b6b-f7adcc09ed78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:06:57.961328 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d35457-96ac-428f-8b6b-f7adcc09ed78 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:06:57.961651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d35457-96ac-428f-8b6b-f7adcc09ed78 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:06:57.961933 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d35457-96ac-428f-8b6b-f7adcc09ed78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:06:57.972129 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d35457-96ac-428f-8b6b-f7adcc09ed78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:06:57.973701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d35457-96ac-428f-8b6b-f7adcc09ed78 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:06:57.984666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1015/2058] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:06:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:03.807417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b4df1-d2c7-4210-91ca-ae621fc9342a None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:03.808037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b4df1-d2c7-4210-91ca-ae621fc9342a None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:03.808037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b4df1-d2c7-4210-91ca-ae621fc9342a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:03.827155 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-915b4df1-d2c7-4210-91ca-ae621fc9342a None None] MFA Rules not processed for user `1a01e9f4844940af9d8b112eb8d9efdc`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:03.828382 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-915b4df1-d2c7-4210-91ca-ae621fc9342a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:03.836292 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1044/2059] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:10.396126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d35457-96ac-428f-8b6b-f7adcc09ed78 service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:10.397620 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-f1d35457-96ac-428f-8b6b-f7adcc09ed78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:10.423841 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d35457-96ac-428f-8b6b-f7adcc09ed78 service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:10.434838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d62f5-51d9-4631-99af-231a4f5a0059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:10.436153 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d62f5-51d9-4631-99af-231a4f5a0059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:10.436519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d62f5-51d9-4631-99af-231a4f5a0059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:10.436939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d62f5-51d9-4631-99af-231a4f5a0059 admin admin] PATH_INFO: `/v3/users/d74443f9ad6b44f3acfeb2e1556cf800` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:10.445452 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d62f5-51d9-4631-99af-231a4f5a0059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d74443f9ad6b44f3acfeb2e1556cf800)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:10.449093 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d62f5-51d9-4631-99af-231a4f5a0059 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:10.546314 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-661d62f5-51d9-4631-99af-231a4f5a0059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd74443f9ad6b44f3acfeb2e1556cf800'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:10.564003 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-661d62f5-51d9-4631-99af-231a4f5a0059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd74443f9ad6b44f3acfeb2e1556cf800'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:10.591709 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-661d62f5-51d9-4631-99af-231a4f5a0059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd74443f9ad6b44f3acfeb2e1556cf800'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:10.592513 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-661d62f5-51d9-4631-99af-231a4f5a0059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd74443f9ad6b44f3acfeb2e1556cf800'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:10.604493 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-661d62f5-51d9-4631-99af-231a4f5a0059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd74443f9ad6b44f3acfeb2e1556cf800'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:10.615088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1016/2060] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:10 2022] DELETE /identity/v3/users/d74443f9ad6b44f3acfeb2e1556cf800 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:10.621835 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6472a9-80f1-40c7-b5a6-a9983c737dd1 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:10.622380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6472a9-80f1-40c7-b5a6-a9983c737dd1 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:10.622855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6472a9-80f1-40c7-b5a6-a9983c737dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:10.652541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-2c6472a9-80f1-40c7-b5a6-a9983c737dd1 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:10.655165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-2c6472a9-80f1-40c7-b5a6-a9983c737dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:10.793869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1045/2061] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:10.800725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d62f5-51d9-4631-99af-231a4f5a0059 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:10.802401 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-661d62f5-51d9-4631-99af-231a4f5a0059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:10.886879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d62f5-51d9-4631-99af-231a4f5a0059 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:10.898295 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328dbce-41b3-4a41-9999-2e420815c9fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:10.900171 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328dbce-41b3-4a41-9999-2e420815c9fc service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:10.900992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328dbce-41b3-4a41-9999-2e420815c9fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:10.901282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328dbce-41b3-4a41-9999-2e420815c9fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:10.916109 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328dbce-41b3-4a41-9999-2e420815c9fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:10.922493 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328dbce-41b3-4a41-9999-2e420815c9fc service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:10.941828 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1017/2062] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:11.332262 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6472a9-80f1-40c7-b5a6-a9983c737dd1 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:11.335742 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-2c6472a9-80f1-40c7-b5a6-a9983c737dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:11.368419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6472a9-80f1-40c7-b5a6-a9983c737dd1 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:11.374619 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a2c86-d79b-48b3-86f9-7d4e263a6c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:11.376860 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a2c86-d79b-48b3-86f9-7d4e263a6c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:11.377386 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a2c86-d79b-48b3-86f9-7d4e263a6c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:11.377855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a2c86-d79b-48b3-86f9-7d4e263a6c62 admin admin] PATH_INFO: `/v3/projects/409178c7d3be48b197cca9038cf46e47` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:11.379624 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a2c86-d79b-48b3-86f9-7d4e263a6c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=409178c7d3be48b197cca9038cf46e47)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:11.381812 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a2c86-d79b-48b3-86f9-7d4e263a6c62 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:11.468249 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-489a2c86-d79b-48b3-86f9-7d4e263a6c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '409178c7d3be48b197cca9038cf46e47', 'request_id': 'req-489a2c86-d79b-48b3-86f9-7d4e263a6c62'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:11.482531 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-489a2c86-d79b-48b3-86f9-7d4e263a6c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '409178c7d3be48b197cca9038cf46e47', 'request_id': 'req-489a2c86-d79b-48b3-86f9-7d4e263a6c62'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:11.496544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-489a2c86-d79b-48b3-86f9-7d4e263a6c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '409178c7d3be48b197cca9038cf46e47', 'request_id': 'req-489a2c86-d79b-48b3-86f9-7d4e263a6c62'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:11.518045 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-489a2c86-d79b-48b3-86f9-7d4e263a6c62 admin admin] The token cache is being invalidate because project 409178c7d3be48b197cca9038cf46e47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:11.518515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-489a2c86-d79b-48b3-86f9-7d4e263a6c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:11.519592 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-489a2c86-d79b-48b3-86f9-7d4e263a6c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:11.522731 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1046/2063] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:11 2022] DELETE /identity/v3/projects/409178c7d3be48b197cca9038cf46e47 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:11.527510 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328dbce-41b3-4a41-9999-2e420815c9fc service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:11.545483 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328dbce-41b3-4a41-9999-2e420815c9fc service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:11.650878 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0068cf-2119-4009-a2c1-2ea618284989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:11.652798 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0068cf-2119-4009-a2c1-2ea618284989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:11.653234 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0068cf-2119-4009-a2c1-2ea618284989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:11.653525 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0068cf-2119-4009-a2c1-2ea618284989 admin admin] PATH_INFO: `/v3/users/834980ee93174bd1929578207679888f` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:11.658633 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0068cf-2119-4009-a2c1-2ea618284989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=834980ee93174bd1929578207679888f)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:11.662403 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0068cf-2119-4009-a2c1-2ea618284989 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:11.763002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-5d0068cf-2119-4009-a2c1-2ea618284989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '834980ee93174bd1929578207679888f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:11.774134 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-5d0068cf-2119-4009-a2c1-2ea618284989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '834980ee93174bd1929578207679888f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:11.793179 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-5d0068cf-2119-4009-a2c1-2ea618284989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '834980ee93174bd1929578207679888f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:11.793929 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-5d0068cf-2119-4009-a2c1-2ea618284989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '834980ee93174bd1929578207679888f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:11.807457 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-5d0068cf-2119-4009-a2c1-2ea618284989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '834980ee93174bd1929578207679888f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:11.816753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1018/2064] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:11 2022] DELETE /identity/v3/users/834980ee93174bd1929578207679888f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:12.234298 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a2c86-d79b-48b3-86f9-7d4e263a6c62 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:12.236378 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-489a2c86-d79b-48b3-86f9-7d4e263a6c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:12.252635 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a2c86-d79b-48b3-86f9-7d4e263a6c62 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:12.340667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188c696-43a4-49e2-b17a-3483f1c41e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:12.342084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188c696-43a4-49e2-b17a-3483f1c41e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:12.342508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188c696-43a4-49e2-b17a-3483f1c41e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:12.342997 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188c696-43a4-49e2-b17a-3483f1c41e22 admin admin] PATH_INFO: `/v3/projects/ab84656c68c84055b0fa4cbf32fed0cc` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:12.350080 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188c696-43a4-49e2-b17a-3483f1c41e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab84656c68c84055b0fa4cbf32fed0cc)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:12.353320 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188c696-43a4-49e2-b17a-3483f1c41e22 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:12.435557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2188c696-43a4-49e2-b17a-3483f1c41e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab84656c68c84055b0fa4cbf32fed0cc', 'request_id': 'req-2188c696-43a4-49e2-b17a-3483f1c41e22'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:12.444237 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2188c696-43a4-49e2-b17a-3483f1c41e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab84656c68c84055b0fa4cbf32fed0cc', 'request_id': 'req-2188c696-43a4-49e2-b17a-3483f1c41e22'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:12.457643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2188c696-43a4-49e2-b17a-3483f1c41e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab84656c68c84055b0fa4cbf32fed0cc', 'request_id': 'req-2188c696-43a4-49e2-b17a-3483f1c41e22'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:12.474034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2188c696-43a4-49e2-b17a-3483f1c41e22 admin admin] The token cache is being invalidate because project ab84656c68c84055b0fa4cbf32fed0cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:12.474331 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2188c696-43a4-49e2-b17a-3483f1c41e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:12.478880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2188c696-43a4-49e2-b17a-3483f1c41e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:12.483886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1047/2065] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:12 2022] DELETE /identity/v3/projects/ab84656c68c84055b0fa4cbf32fed0cc => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:12.489789 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3944a3-70d1-4956-9ee7-80c567acb00a None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:12.490011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3944a3-70d1-4956-9ee7-80c567acb00a None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:12.490288 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3944a3-70d1-4956-9ee7-80c567acb00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:12.510059 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-2b3944a3-70d1-4956-9ee7-80c567acb00a None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:12.511445 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-2b3944a3-70d1-4956-9ee7-80c567acb00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:12.587944 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1019/2066] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:07:12.591132 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537cc1c-7a0f-47f3-991d-4053b8bab8b0 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:12.591420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537cc1c-7a0f-47f3-991d-4053b8bab8b0 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:12.591703 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537cc1c-7a0f-47f3-991d-4053b8bab8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:12.635654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-7537cc1c-7a0f-47f3-991d-4053b8bab8b0 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:12.635654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-7537cc1c-7a0f-47f3-991d-4053b8bab8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:12.642040 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1048/2067] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:12.647020 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3944a3-70d1-4956-9ee7-80c567acb00a None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:12.660085 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3944a3-70d1-4956-9ee7-80c567acb00a None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:12.665082 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddd5c0-3283-45ba-81f3-f4990a0f3a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:12.665844 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddd5c0-3283-45ba-81f3-f4990a0f3a7e admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:12.666308 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddd5c0-3283-45ba-81f3-f4990a0f3a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:12.666721 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddd5c0-3283-45ba-81f3-f4990a0f3a7e admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:12.668202 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddd5c0-3283-45ba-81f3-f4990a0f3a7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:07:12.668594 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddd5c0-3283-45ba-81f3-f4990a0f3a7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:12.670381 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddd5c0-3283-45ba-81f3-f4990a0f3a7e admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:12.686552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1020/2068] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 15:07:12.691103 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537cc1c-7a0f-47f3-991d-4053b8bab8b0 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:12.702988 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537cc1c-7a0f-47f3-991d-4053b8bab8b0 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:12.709918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ed305-0220-4913-ae23-05b5f0b739cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:12.711248 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ed305-0220-4913-ae23-05b5f0b739cb admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:12.711527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ed305-0220-4913-ae23-05b5f0b739cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:12.711803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ed305-0220-4913-ae23-05b5f0b739cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:12.714653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ed305-0220-4913-ae23-05b5f0b739cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:12.718024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ed305-0220-4913-ae23-05b5f0b739cb admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:12.755067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1049/2069] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:07:12 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:12.756573 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddd5c0-3283-45ba-81f3-f4990a0f3a7e admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:12.769750 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddd5c0-3283-45ba-81f3-f4990a0f3a7e admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:12.846591 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb51db-a85d-4078-a8a9-32e6397c1f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:12.847568 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb51db-a85d-4078-a8a9-32e6397c1f4c admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:12.847853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb51db-a85d-4078-a8a9-32e6397c1f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:12.848143 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb51db-a85d-4078-a8a9-32e6397c1f4c admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:12.848853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb51db-a85d-4078-a8a9-32e6397c1f4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:12.861590 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb51db-a85d-4078-a8a9-32e6397c1f4c admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:12.864570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ed305-0220-4913-ae23-05b5f0b739cb admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:12.866403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-9c9ed305-0220-4913-ae23-05b5f0b739cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:12.880588 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1021/2070] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:07:12 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:07:12.883388 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ed305-0220-4913-ae23-05b5f0b739cb admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:12.888903 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ae593-bac4-4fb0-82af-f50a5bc91b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:12.889712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb51db-a85d-4078-a8a9-32e6397c1f4c admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:12.890219 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ae593-bac4-4fb0-82af-f50a5bc91b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:12.890653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ae593-bac4-4fb0-82af-f50a5bc91b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:12.891107 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ae593-bac4-4fb0-82af-f50a5bc91b98 admin admin] PATH_INFO: `/v3/users/7ee8d0f931e94032958eaebb81960893` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:12.892522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ae593-bac4-4fb0-82af-f50a5bc91b98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ee8d0f931e94032958eaebb81960893)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:12.894789 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ae593-bac4-4fb0-82af-f50a5bc91b98 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:12.901063 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb51db-a85d-4078-a8a9-32e6397c1f4c admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:12.906126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfeea1-b958-4868-b0bb-6ad103c41439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:12.906812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfeea1-b958-4868-b0bb-6ad103c41439 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:12.907267 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfeea1-b958-4868-b0bb-6ad103c41439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:12.907556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfeea1-b958-4868-b0bb-6ad103c41439 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:12.908290 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfeea1-b958-4868-b0bb-6ad103c41439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:12.910074 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfeea1-b958-4868-b0bb-6ad103c41439 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:12.929799 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1022/2071] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:12.933759 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfeea1-b958-4868-b0bb-6ad103c41439 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:12.950208 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfeea1-b958-4868-b0bb-6ad103c41439 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:12.956787 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a7bc5-ebeb-4f61-b582-b635e91bc358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:12.959439 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a7bc5-ebeb-4f61-b582-b635e91bc358 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:12.959827 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a7bc5-ebeb-4f61-b582-b635e91bc358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:12.960184 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a7bc5-ebeb-4f61-b582-b635e91bc358 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:12.961794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a7bc5-ebeb-4f61-b582-b635e91bc358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:12.963565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a7bc5-ebeb-4f61-b582-b635e91bc358 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:12.971133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-855ae593-bac4-4fb0-82af-f50a5bc91b98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ee8d0f931e94032958eaebb81960893'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:12.983613 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1023/2072] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:12.985963 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a7bc5-ebeb-4f61-b582-b635e91bc358 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:12.986543 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-855ae593-bac4-4fb0-82af-f50a5bc91b98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ee8d0f931e94032958eaebb81960893'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:12.987522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-855ae593-bac4-4fb0-82af-f50a5bc91b98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ee8d0f931e94032958eaebb81960893'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:12.988698 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-855ae593-bac4-4fb0-82af-f50a5bc91b98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ee8d0f931e94032958eaebb81960893'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:12.989142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-522a7bc5-ebeb-4f61-b582-b635e91bc358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:13.000791 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-855ae593-bac4-4fb0-82af-f50a5bc91b98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ee8d0f931e94032958eaebb81960893'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:13.017434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a7bc5-ebeb-4f61-b582-b635e91bc358 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:13.027457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1050/2073] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:12 2022] DELETE /identity/v3/users/7ee8d0f931e94032958eaebb81960893 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:13.032406 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d713e-76e7-42a6-abc4-e70b604b78cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:13.033323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d713e-76e7-42a6-abc4-e70b604b78cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:13.033542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4924b4-b69d-4a2f-ac30-e35f4fcb8843 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:13.033662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d713e-76e7-42a6-abc4-e70b604b78cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:13.033878 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d713e-76e7-42a6-abc4-e70b604b78cd admin admin] PATH_INFO: `/v3/projects/d5b810dbf78440c28fbbec80d9324a49/users/5b3a2bfb080744e18e2d1d8411fd1ef2/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:13.034083 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4924b4-b69d-4a2f-ac30-e35f4fcb8843 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:13.034532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4924b4-b69d-4a2f-ac30-e35f4fcb8843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:13.056572 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-3c4924b4-b69d-4a2f-ac30-e35f4fcb8843 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:13.061055 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d713e-76e7-42a6-abc4-e70b604b78cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b810dbf78440c28fbbec80d9324a49, user_id=5b3a2bfb080744e18e2d1d8411fd1ef2, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:13.061493 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-3c4924b4-b69d-4a2f-ac30-e35f4fcb8843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:13.061581 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d713e-76e7-42a6-abc4-e70b604b78cd admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:13.093851 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1024/2074] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:12 2022] PUT /identity/v3/projects/d5b810dbf78440c28fbbec80d9324a49/users/5b3a2bfb080744e18e2d1d8411fd1ef2/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:13.115024 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324054b-1f97-4465-825b-b064ac254b3e None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:13.115426 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324054b-1f97-4465-825b-b064ac254b3e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:13.115803 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324054b-1f97-4465-825b-b064ac254b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:13.147889 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-e324054b-1f97-4465-825b-b064ac254b3e None None] MFA Rules not processed for user `5b3a2bfb080744e18e2d1d8411fd1ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:13.149986 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-e324054b-1f97-4465-825b-b064ac254b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:13.170812 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1051/2075] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:07:13.190116 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4924b4-b69d-4a2f-ac30-e35f4fcb8843 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:13.192720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-3c4924b4-b69d-4a2f-ac30-e35f4fcb8843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:13.293470 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1025/2076] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:13.300968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324054b-1f97-4465-825b-b064ac254b3e None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:13.303485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4924b4-b69d-4a2f-ac30-e35f4fcb8843 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:13.383913 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab40fda-7a41-4d24-90e5-3090f2f6f641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:13.384926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab40fda-7a41-4d24-90e5-3090f2f6f641 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:13.385432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab40fda-7a41-4d24-90e5-3090f2f6f641 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:13.385933 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab40fda-7a41-4d24-90e5-3090f2f6f641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:13.403108 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab40fda-7a41-4d24-90e5-3090f2f6f641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:13.403504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324054b-1f97-4465-825b-b064ac254b3e None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:13.405917 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab40fda-7a41-4d24-90e5-3090f2f6f641 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:13.411173 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31949282-7596-42c9-8dc0-56abd7ee30ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:13.412212 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31949282-7596-42c9-8dc0-56abd7ee30ef admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:13.412727 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31949282-7596-42c9-8dc0-56abd7ee30ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:13.413391 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31949282-7596-42c9-8dc0-56abd7ee30ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:13.415188 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31949282-7596-42c9-8dc0-56abd7ee30ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:13.418766 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31949282-7596-42c9-8dc0-56abd7ee30ef admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:13.424681 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1052/2077] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:13.468121 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1026/2078] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:07:13 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:07:13.470892 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab40fda-7a41-4d24-90e5-3090f2f6f641 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:13.497665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab40fda-7a41-4d24-90e5-3090f2f6f641 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:13.591356 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179eacc-eeba-456d-9278-8eee4a074863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:13.592381 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179eacc-eeba-456d-9278-8eee4a074863 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:13.592576 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179eacc-eeba-456d-9278-8eee4a074863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:13.592939 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179eacc-eeba-456d-9278-8eee4a074863 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:13.593624 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179eacc-eeba-456d-9278-8eee4a074863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:13.595844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179eacc-eeba-456d-9278-8eee4a074863 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:13.634990 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1053/2079] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:07:13 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:13.638188 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31949282-7596-42c9-8dc0-56abd7ee30ef admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:13.652061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31949282-7596-42c9-8dc0-56abd7ee30ef admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:13.660186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6182fd-0217-4f9b-adbc-f4527230832c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:13.662280 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6182fd-0217-4f9b-adbc-f4527230832c admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:13.662942 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6182fd-0217-4f9b-adbc-f4527230832c admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:13.664397 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6182fd-0217-4f9b-adbc-f4527230832c admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:13.666627 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6182fd-0217-4f9b-adbc-f4527230832c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:13.670754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6182fd-0217-4f9b-adbc-f4527230832c admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:13.705455 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1027/2080] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:13.710196 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179eacc-eeba-456d-9278-8eee4a074863 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:13.733184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179eacc-eeba-456d-9278-8eee4a074863 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:13.738754 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82720945-6c9d-459c-8669-7d231b065956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:13.739815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82720945-6c9d-459c-8669-7d231b065956 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:13.739981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82720945-6c9d-459c-8669-7d231b065956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:13.740415 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82720945-6c9d-459c-8669-7d231b065956 admin admin] PATH_INFO: `/v3/projects/4fec83e7285f45e19aff1c48f24945fe/users/4147fb6afd8e460da3f74fa0f0833ce4/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:13.772645 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82720945-6c9d-459c-8669-7d231b065956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fec83e7285f45e19aff1c48f24945fe, user_id=4147fb6afd8e460da3f74fa0f0833ce4, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:13.777238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82720945-6c9d-459c-8669-7d231b065956 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:13.798426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1054/2081] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:13 2022] PUT /identity/v3/projects/4fec83e7285f45e19aff1c48f24945fe/users/4147fb6afd8e460da3f74fa0f0833ce4/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:13.804918 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6182fd-0217-4f9b-adbc-f4527230832c admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:13.820938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82720945-6c9d-459c-8669-7d231b065956 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:13.823949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-82720945-6c9d-459c-8669-7d231b065956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:13.853272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6182fd-0217-4f9b-adbc-f4527230832c admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:13.921256 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82720945-6c9d-459c-8669-7d231b065956 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:13.928776 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c4c8a-d3c6-471f-875c-91cebf722c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:13.930228 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c4c8a-d3c6-471f-875c-91cebf722c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:13.930507 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c4c8a-d3c6-471f-875c-91cebf722c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:13.930767 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c4c8a-d3c6-471f-875c-91cebf722c9d admin admin] PATH_INFO: `/v3/projects/31fd316967834ffa8efcad3e5684dbbb` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:13.932254 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c4c8a-d3c6-471f-875c-91cebf722c9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=31fd316967834ffa8efcad3e5684dbbb)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:13.934362 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c4c8a-d3c6-471f-875c-91cebf722c9d admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:13.947963 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ea4cc-addd-4a1d-9ace-0380a42239e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:13.948646 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ea4cc-addd-4a1d-9ace-0380a42239e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:13.948924 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ea4cc-addd-4a1d-9ace-0380a42239e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:13.949200 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ea4cc-addd-4a1d-9ace-0380a42239e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:13.949948 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ea4cc-addd-4a1d-9ace-0380a42239e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:13.951603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ea4cc-addd-4a1d-9ace-0380a42239e5 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:13.962482 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1028/2082] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:13.967288 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ea4cc-addd-4a1d-9ace-0380a42239e5 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:13.978455 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ea4cc-addd-4a1d-9ace-0380a42239e5 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:13.989923 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1a5c4c8a-d3c6-471f-875c-91cebf722c9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31fd316967834ffa8efcad3e5684dbbb', 'request_id': 'req-1a5c4c8a-d3c6-471f-875c-91cebf722c9d'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:13.996356 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1a5c4c8a-d3c6-471f-875c-91cebf722c9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31fd316967834ffa8efcad3e5684dbbb', 'request_id': 'req-1a5c4c8a-d3c6-471f-875c-91cebf722c9d'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:14.007396 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1a5c4c8a-d3c6-471f-875c-91cebf722c9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31fd316967834ffa8efcad3e5684dbbb', 'request_id': 'req-1a5c4c8a-d3c6-471f-875c-91cebf722c9d'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:14.019694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1a5c4c8a-d3c6-471f-875c-91cebf722c9d admin admin] The token cache is being invalidate because project 31fd316967834ffa8efcad3e5684dbbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:14.019982 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1a5c4c8a-d3c6-471f-875c-91cebf722c9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:14.020687 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1a5c4c8a-d3c6-471f-875c-91cebf722c9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:14.022288 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1055/2083] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:13 2022] DELETE /identity/v3/projects/31fd316967834ffa8efcad3e5684dbbb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:14.027032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c4c8a-d3c6-471f-875c-91cebf722c9d admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:14.029541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-1a5c4c8a-d3c6-471f-875c-91cebf722c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:14.039353 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c01c44-ae20-4bfe-8558-3d42d6d2be03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:14.040458 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c01c44-ae20-4bfe-8558-3d42d6d2be03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:14.040912 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c01c44-ae20-4bfe-8558-3d42d6d2be03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:14.041338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c01c44-ae20-4bfe-8558-3d42d6d2be03 admin admin] PATH_INFO: `/v3/projects/4fec83e7285f45e19aff1c48f24945fe/users/4147fb6afd8e460da3f74fa0f0833ce4/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:14.043477 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c01c44-ae20-4bfe-8558-3d42d6d2be03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fec83e7285f45e19aff1c48f24945fe, user_id=4147fb6afd8e460da3f74fa0f0833ce4, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:14.046152 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c01c44-ae20-4bfe-8558-3d42d6d2be03 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:14.057497 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1029/2084] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:13 2022] PUT /identity/v3/projects/4fec83e7285f45e19aff1c48f24945fe/users/4147fb6afd8e460da3f74fa0f0833ce4/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:14.068052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75d1fa-a367-4dff-853d-08f58d5d2daf None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:14.068476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75d1fa-a367-4dff-853d-08f58d5d2daf None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:14.068765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75d1fa-a367-4dff-853d-08f58d5d2daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:14.100135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-2b75d1fa-a367-4dff-853d-08f58d5d2daf None None] MFA Rules not processed for user `4147fb6afd8e460da3f74fa0f0833ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:14.102520 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-2b75d1fa-a367-4dff-853d-08f58d5d2daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:14.105144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c4c8a-d3c6-471f-875c-91cebf722c9d admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:14.167483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7552cd-6859-4a6b-912c-87b8f978760e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:14.168385 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7552cd-6859-4a6b-912c-87b8f978760e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:14.168660 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7552cd-6859-4a6b-912c-87b8f978760e admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:14.168925 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7552cd-6859-4a6b-912c-87b8f978760e admin admin] PATH_INFO: `/v3/users/5473aa57ce2b4e9e90a5667980f8a84a` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:14.170133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7552cd-6859-4a6b-912c-87b8f978760e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5473aa57ce2b4e9e90a5667980f8a84a)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:14.172096 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7552cd-6859-4a6b-912c-87b8f978760e admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:14.189117 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1030/2085] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:07:14.203376 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75d1fa-a367-4dff-853d-08f58d5d2daf None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:14.205544 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-2b75d1fa-a367-4dff-853d-08f58d5d2daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:14.233144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ab7552cd-6859-4a6b-912c-87b8f978760e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5473aa57ce2b4e9e90a5667980f8a84a'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:14.251653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ab7552cd-6859-4a6b-912c-87b8f978760e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5473aa57ce2b4e9e90a5667980f8a84a'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:14.252847 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ab7552cd-6859-4a6b-912c-87b8f978760e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5473aa57ce2b4e9e90a5667980f8a84a'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:14.253891 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ab7552cd-6859-4a6b-912c-87b8f978760e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5473aa57ce2b4e9e90a5667980f8a84a'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:14.264444 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ab7552cd-6859-4a6b-912c-87b8f978760e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5473aa57ce2b4e9e90a5667980f8a84a'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:14.280669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1056/2086] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:14 2022] DELETE /identity/v3/users/5473aa57ce2b4e9e90a5667980f8a84a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:14.298231 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75d1fa-a367-4dff-853d-08f58d5d2daf None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:14.391142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a37e2-23ac-4ea6-9b04-19b10af4a224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:14.391821 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a37e2-23ac-4ea6-9b04-19b10af4a224 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:14.392102 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a37e2-23ac-4ea6-9b04-19b10af4a224 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:14.394178 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a37e2-23ac-4ea6-9b04-19b10af4a224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:14.396553 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-646a37e2-23ac-4ea6-9b04-19b10af4a224 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:14.480235 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a37e2-23ac-4ea6-9b04-19b10af4a224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:14.482863 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a37e2-23ac-4ea6-9b04-19b10af4a224 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:14.494748 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1031/2087] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:07:14.709069 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7552cd-6859-4a6b-912c-87b8f978760e admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:14.711126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ab7552cd-6859-4a6b-912c-87b8f978760e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:14.822245 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7552cd-6859-4a6b-912c-87b8f978760e admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:14.828410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba691b8-dbe2-4956-b7e3-c42644537ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:14.829483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba691b8-dbe2-4956-b7e3-c42644537ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:14.829853 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba691b8-dbe2-4956-b7e3-c42644537ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:14.830316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba691b8-dbe2-4956-b7e3-c42644537ed3 admin admin] PATH_INFO: `/v3/projects/d642e3ad34ad454784a362b1662ed6a5` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:14.831871 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba691b8-dbe2-4956-b7e3-c42644537ed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d642e3ad34ad454784a362b1662ed6a5)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:14.834161 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba691b8-dbe2-4956-b7e3-c42644537ed3 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:14.905633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1ba691b8-dbe2-4956-b7e3-c42644537ed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd642e3ad34ad454784a362b1662ed6a5', 'request_id': 'req-1ba691b8-dbe2-4956-b7e3-c42644537ed3'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:14.926124 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1ba691b8-dbe2-4956-b7e3-c42644537ed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd642e3ad34ad454784a362b1662ed6a5', 'request_id': 'req-1ba691b8-dbe2-4956-b7e3-c42644537ed3'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:14.940924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1ba691b8-dbe2-4956-b7e3-c42644537ed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd642e3ad34ad454784a362b1662ed6a5', 'request_id': 'req-1ba691b8-dbe2-4956-b7e3-c42644537ed3'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:14.961419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1ba691b8-dbe2-4956-b7e3-c42644537ed3 admin admin] The token cache is being invalidate because project d642e3ad34ad454784a362b1662ed6a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:14.961709 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1ba691b8-dbe2-4956-b7e3-c42644537ed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:14.962387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1ba691b8-dbe2-4956-b7e3-c42644537ed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:14.964289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1057/2088] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:14 2022] DELETE /identity/v3/projects/d642e3ad34ad454784a362b1662ed6a5 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:14.971942 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdb11e-7071-42ed-81d7-205226c870a8 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:14.972630 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdb11e-7071-42ed-81d7-205226c870a8 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:14.972823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdb11e-7071-42ed-81d7-205226c870a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:14.997260 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-05fdb11e-7071-42ed-81d7-205226c870a8 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:14.998569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-05fdb11e-7071-42ed-81d7-205226c870a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:15.089865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1032/2089] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:15.098879 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6b421-ca17-4cdc-84ed-b069eedfd704 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:15.099179 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6b421-ca17-4cdc-84ed-b069eedfd704 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:15.099466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6b421-ca17-4cdc-84ed-b069eedfd704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:15.123515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-3fd6b421-ca17-4cdc-84ed-b069eedfd704 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:15.124784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-3fd6b421-ca17-4cdc-84ed-b069eedfd704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:15.135206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1058/2090] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:07:15.140776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdb11e-7071-42ed-81d7-205226c870a8 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:15.158529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdb11e-7071-42ed-81d7-205226c870a8 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:15.172240 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527a822-b84c-47c2-a797-1f6c1506a106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:15.173966 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527a822-b84c-47c2-a797-1f6c1506a106 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:15.174892 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527a822-b84c-47c2-a797-1f6c1506a106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:15.175476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527a822-b84c-47c2-a797-1f6c1506a106 admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:15.176969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527a822-b84c-47c2-a797-1f6c1506a106 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:07:15.177624 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527a822-b84c-47c2-a797-1f6c1506a106 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:15.181255 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527a822-b84c-47c2-a797-1f6c1506a106 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:15.205980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1033/2091] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 15:07:15.208084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6b421-ca17-4cdc-84ed-b069eedfd704 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:15.219183 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6b421-ca17-4cdc-84ed-b069eedfd704 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:15.224779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e950c-63c1-420a-b315-0eaa9f38536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:15.225623 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e950c-63c1-420a-b315-0eaa9f38536c admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:15.225916 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e950c-63c1-420a-b315-0eaa9f38536c admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:15.226213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e950c-63c1-420a-b315-0eaa9f38536c admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:15.226966 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e950c-63c1-420a-b315-0eaa9f38536c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:15.229151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e950c-63c1-420a-b315-0eaa9f38536c admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:15.263315 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1059/2092] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:07:15 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:15.267240 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527a822-b84c-47c2-a797-1f6c1506a106 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:15.279898 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527a822-b84c-47c2-a797-1f6c1506a106 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:15.348804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3a9af-2f45-41bb-9b21-af423ce0adab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:15.349479 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3a9af-2f45-41bb-9b21-af423ce0adab admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:15.349759 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3a9af-2f45-41bb-9b21-af423ce0adab admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:15.350032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3a9af-2f45-41bb-9b21-af423ce0adab admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:15.350730 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3a9af-2f45-41bb-9b21-af423ce0adab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:15.352781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3a9af-2f45-41bb-9b21-af423ce0adab admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:15.375741 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1034/2093] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:07:15 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:15.380462 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e950c-63c1-420a-b315-0eaa9f38536c admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:15.393031 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e950c-63c1-420a-b315-0eaa9f38536c admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:15.401179 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d18f83-d4de-498e-9ee5-b178de5251f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:15.402367 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d18f83-d4de-498e-9ee5-b178de5251f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:15.402865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d18f83-d4de-498e-9ee5-b178de5251f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:15.403338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d18f83-d4de-498e-9ee5-b178de5251f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:15.404754 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d18f83-d4de-498e-9ee5-b178de5251f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:15.407962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d18f83-d4de-498e-9ee5-b178de5251f3 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:15.424554 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1060/2094] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:15.430177 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3a9af-2f45-41bb-9b21-af423ce0adab admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:15.444842 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3a9af-2f45-41bb-9b21-af423ce0adab admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:15.450466 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e2aa2-115a-4d70-aefe-de8de8a37554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:15.451181 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e2aa2-115a-4d70-aefe-de8de8a37554 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:15.451483 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e2aa2-115a-4d70-aefe-de8de8a37554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:15.451742 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e2aa2-115a-4d70-aefe-de8de8a37554 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:15.452478 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e2aa2-115a-4d70-aefe-de8de8a37554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:15.454150 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e2aa2-115a-4d70-aefe-de8de8a37554 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:15.466466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d18f83-d4de-498e-9ee5-b178de5251f3 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:15.468604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1035/2095] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:07:15.469364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e2d18f83-d4de-498e-9ee5-b178de5251f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:15.473702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e2aa2-115a-4d70-aefe-de8de8a37554 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:15.484714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e2aa2-115a-4d70-aefe-de8de8a37554 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:15.489383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d18f83-d4de-498e-9ee5-b178de5251f3 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:15.490133 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf11f8-f067-431a-a047-b483ee705397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:15.491219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf11f8-f067-431a-a047-b483ee705397 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:15.491573 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf11f8-f067-431a-a047-b483ee705397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:15.492405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf11f8-f067-431a-a047-b483ee705397 admin admin] PATH_INFO: `/v3/projects/aadb3fe2036d4869a108ed309ef973b1/users/7b0ea365bfe4480da400d78d6892dfc3/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:15.496609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac0bda-d251-44c3-998a-8680bd6ade0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:15.498441 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac0bda-d251-44c3-998a-8680bd6ade0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:15.498915 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac0bda-d251-44c3-998a-8680bd6ade0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:15.499316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac0bda-d251-44c3-998a-8680bd6ade0a admin admin] PATH_INFO: `/v3/users/5b3a2bfb080744e18e2d1d8411fd1ef2` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:15.501407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac0bda-d251-44c3-998a-8680bd6ade0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b3a2bfb080744e18e2d1d8411fd1ef2)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:15.504277 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac0bda-d251-44c3-998a-8680bd6ade0a admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:15.512409 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf11f8-f067-431a-a047-b483ee705397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aadb3fe2036d4869a108ed309ef973b1, user_id=7b0ea365bfe4480da400d78d6892dfc3, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:15.515522 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf11f8-f067-431a-a047-b483ee705397 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:15.533722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1036/2096] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:15 2022] PUT /identity/v3/projects/aadb3fe2036d4869a108ed309ef973b1/users/7b0ea365bfe4480da400d78d6892dfc3/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:15.550294 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fde37-c0d6-416e-9d74-a0c8fbcfc25f None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:15.550906 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fde37-c0d6-416e-9d74-a0c8fbcfc25f None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:15.551398 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fde37-c0d6-416e-9d74-a0c8fbcfc25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:15.576445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-c4ac0bda-d251-44c3-998a-8680bd6ade0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b3a2bfb080744e18e2d1d8411fd1ef2'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:15.589812 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-c4ac0bda-d251-44c3-998a-8680bd6ade0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b3a2bfb080744e18e2d1d8411fd1ef2'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:15.590590 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-c4ac0bda-d251-44c3-998a-8680bd6ade0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b3a2bfb080744e18e2d1d8411fd1ef2'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:15.591221 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-c4ac0bda-d251-44c3-998a-8680bd6ade0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b3a2bfb080744e18e2d1d8411fd1ef2'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:15.593547 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-621fde37-c0d6-416e-9d74-a0c8fbcfc25f None None] MFA Rules not processed for user `7b0ea365bfe4480da400d78d6892dfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:15.595526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-621fde37-c0d6-416e-9d74-a0c8fbcfc25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:15.598962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-c4ac0bda-d251-44c3-998a-8680bd6ade0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b3a2bfb080744e18e2d1d8411fd1ef2'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:15.619693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1061/2097] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:15 2022] DELETE /identity/v3/users/5b3a2bfb080744e18e2d1d8411fd1ef2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:15.625065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeffe38-f4a8-4a6e-b9d5-0a3d6f55a43f None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:15.625626 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeffe38-f4a8-4a6e-b9d5-0a3d6f55a43f None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:15.626088 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeffe38-f4a8-4a6e-b9d5-0a3d6f55a43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:15.649064 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-daeffe38-f4a8-4a6e-b9d5-0a3d6f55a43f None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:15.650262 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-daeffe38-f4a8-4a6e-b9d5-0a3d6f55a43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:15.682506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1037/2098] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:07:15.688196 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fde37-c0d6-416e-9d74-a0c8fbcfc25f None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:15.689655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-621fde37-c0d6-416e-9d74-a0c8fbcfc25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:15.724641 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1062/2099] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:07:15.735785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeffe38-f4a8-4a6e-b9d5-0a3d6f55a43f None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:15.737344 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-daeffe38-f4a8-4a6e-b9d5-0a3d6f55a43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:15.797286 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fde37-c0d6-416e-9d74-a0c8fbcfc25f None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:15.802726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a99d03-59f6-411c-ba9d-81b3f800fdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:15.803924 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a99d03-59f6-411c-ba9d-81b3f800fdf3 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:15.804798 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a99d03-59f6-411c-ba9d-81b3f800fdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:15.805148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a99d03-59f6-411c-ba9d-81b3f800fdf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:15.805862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a99d03-59f6-411c-ba9d-81b3f800fdf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:15.808183 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a99d03-59f6-411c-ba9d-81b3f800fdf3 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:15.823502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeffe38-f4a8-4a6e-b9d5-0a3d6f55a43f None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:15.831110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cef6b-3852-4a4c-9f3c-5eba73819b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:15.832284 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cef6b-3852-4a4c-9f3c-5eba73819b05 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:15.832786 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cef6b-3852-4a4c-9f3c-5eba73819b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:15.833276 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cef6b-3852-4a4c-9f3c-5eba73819b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:15.847615 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1038/2100] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:07:15 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:07:15.849077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a99d03-59f6-411c-ba9d-81b3f800fdf3 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:15.857464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56cef6b-3852-4a4c-9f3c-5eba73819b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:15.859327 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56cef6b-3852-4a4c-9f3c-5eba73819b05 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:15.871225 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1063/2101] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:07:15.926351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a99d03-59f6-411c-ba9d-81b3f800fdf3 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:15.935803 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15b188-b647-450c-a398-6c69149ee206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:15.936508 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15b188-b647-450c-a398-6c69149ee206 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:15.936929 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15b188-b647-450c-a398-6c69149ee206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:15.937828 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15b188-b647-450c-a398-6c69149ee206 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:15.937828 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15b188-b647-450c-a398-6c69149ee206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:15.939946 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15b188-b647-450c-a398-6c69149ee206 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:15.963194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1039/2102] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:07:15 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:15.967629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cef6b-3852-4a4c-9f3c-5eba73819b05 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:15.983717 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cef6b-3852-4a4c-9f3c-5eba73819b05 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:15.992016 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574204c8-4a15-4320-b211-9834761eda4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:15.993679 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574204c8-4a15-4320-b211-9834761eda4f admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:15.994171 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574204c8-4a15-4320-b211-9834761eda4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:15.994506 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574204c8-4a15-4320-b211-9834761eda4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:15.995903 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574204c8-4a15-4320-b211-9834761eda4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:15.999044 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574204c8-4a15-4320-b211-9834761eda4f admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:16.015411 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1064/2103] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:16.020775 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15b188-b647-450c-a398-6c69149ee206 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:16.035946 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15b188-b647-450c-a398-6c69149ee206 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:16.044498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4d867-4735-42f1-87b3-a5baf2b06b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:16.046101 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4d867-4735-42f1-87b3-a5baf2b06b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:16.046622 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4d867-4735-42f1-87b3-a5baf2b06b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:16.047207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4d867-4735-42f1-87b3-a5baf2b06b01 admin admin] PATH_INFO: `/v3/projects/1e12c54c7dcd41f69c3cb2235c22252c/users/6188233a1e7b476fae11a935d75d1e99/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:16.074213 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4d867-4735-42f1-87b3-a5baf2b06b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e12c54c7dcd41f69c3cb2235c22252c, user_id=6188233a1e7b476fae11a935d75d1e99, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:16.077352 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4d867-4735-42f1-87b3-a5baf2b06b01 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:16.097175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1040/2104] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:16 2022] PUT /identity/v3/projects/1e12c54c7dcd41f69c3cb2235c22252c/users/6188233a1e7b476fae11a935d75d1e99/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:16.108331 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574204c8-4a15-4320-b211-9834761eda4f admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:16.126586 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574204c8-4a15-4320-b211-9834761eda4f admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:16.201946 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f982b0-5df8-46fd-882a-aa109ca6dd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:16.203107 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f982b0-5df8-46fd-882a-aa109ca6dd15 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:16.203547 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f982b0-5df8-46fd-882a-aa109ca6dd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:16.203946 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f982b0-5df8-46fd-882a-aa109ca6dd15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:16.204853 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f982b0-5df8-46fd-882a-aa109ca6dd15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:16.207457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f982b0-5df8-46fd-882a-aa109ca6dd15 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:16.230020 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1065/2105] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:16.232317 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4d867-4735-42f1-87b3-a5baf2b06b01 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:16.244937 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4d867-4735-42f1-87b3-a5baf2b06b01 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:16.254168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc3687-85c3-4053-be57-5166508f8208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:16.255207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc3687-85c3-4053-be57-5166508f8208 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:16.255569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc3687-85c3-4053-be57-5166508f8208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:16.255915 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc3687-85c3-4053-be57-5166508f8208 admin admin] PATH_INFO: `/v3/projects/1e12c54c7dcd41f69c3cb2235c22252c/users/6188233a1e7b476fae11a935d75d1e99/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:16.258179 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc3687-85c3-4053-be57-5166508f8208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e12c54c7dcd41f69c3cb2235c22252c, user_id=6188233a1e7b476fae11a935d75d1e99, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:16.261043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc3687-85c3-4053-be57-5166508f8208 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:16.273426 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1041/2106] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:16 2022] PUT /identity/v3/projects/1e12c54c7dcd41f69c3cb2235c22252c/users/6188233a1e7b476fae11a935d75d1e99/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:16.284138 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a552060-4ad6-4331-ae51-43234f8421c0 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:16.284422 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a552060-4ad6-4331-ae51-43234f8421c0 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:16.285011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a552060-4ad6-4331-ae51-43234f8421c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:16.321996 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-9a552060-4ad6-4331-ae51-43234f8421c0 None None] MFA Rules not processed for user `6188233a1e7b476fae11a935d75d1e99`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:16.323468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-9a552060-4ad6-4331-ae51-43234f8421c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:16.364463 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc3687-85c3-4053-be57-5166508f8208 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:16.367276 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-e4dc3687-85c3-4053-be57-5166508f8208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:16.443883 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1066/2107] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:16.461831 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a552060-4ad6-4331-ae51-43234f8421c0 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:16.466854 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-9a552060-4ad6-4331-ae51-43234f8421c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:16.530356 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc3687-85c3-4053-be57-5166508f8208 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:16.539908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0514a86-3984-477e-8ca5-8c85a24459d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:16.541559 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0514a86-3984-477e-8ca5-8c85a24459d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:16.541964 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0514a86-3984-477e-8ca5-8c85a24459d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:16.542509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0514a86-3984-477e-8ca5-8c85a24459d9 admin admin] PATH_INFO: `/v3/projects/d5b810dbf78440c28fbbec80d9324a49` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:16.545115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0514a86-3984-477e-8ca5-8c85a24459d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b810dbf78440c28fbbec80d9324a49)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:16.549174 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0514a86-3984-477e-8ca5-8c85a24459d9 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:16.561120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a552060-4ad6-4331-ae51-43234f8421c0 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:16.573621 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c3258-0cae-4c4f-a000-77e4a4a084c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:16.574409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c3258-0cae-4c4f-a000-77e4a4a084c2 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:16.574958 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c3258-0cae-4c4f-a000-77e4a4a084c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:16.575315 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c3258-0cae-4c4f-a000-77e4a4a084c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:16.592032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c3258-0cae-4c4f-a000-77e4a4a084c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:16.594778 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c3258-0cae-4c4f-a000-77e4a4a084c2 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:16.605851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1067/2108] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:07:16.626862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e0514a86-3984-477e-8ca5-8c85a24459d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b810dbf78440c28fbbec80d9324a49', 'request_id': 'req-e0514a86-3984-477e-8ca5-8c85a24459d9'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:16.637557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e0514a86-3984-477e-8ca5-8c85a24459d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b810dbf78440c28fbbec80d9324a49', 'request_id': 'req-e0514a86-3984-477e-8ca5-8c85a24459d9'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:16.647195 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e0514a86-3984-477e-8ca5-8c85a24459d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b810dbf78440c28fbbec80d9324a49', 'request_id': 'req-e0514a86-3984-477e-8ca5-8c85a24459d9'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:16.666950 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e0514a86-3984-477e-8ca5-8c85a24459d9 admin admin] The token cache is being invalidate because project d5b810dbf78440c28fbbec80d9324a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:16.667289 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e0514a86-3984-477e-8ca5-8c85a24459d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:16.668143 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e0514a86-3984-477e-8ca5-8c85a24459d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:16.669808 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1042/2109] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:16 2022] DELETE /identity/v3/projects/d5b810dbf78440c28fbbec80d9324a49 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:16.674085 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c3258-0cae-4c4f-a000-77e4a4a084c2 service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:16.685297 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c3258-0cae-4c4f-a000-77e4a4a084c2 service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:16.694355 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0514a86-3984-477e-8ca5-8c85a24459d9 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:16.697142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-e0514a86-3984-477e-8ca5-8c85a24459d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:16.747457 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2546f-7353-47a9-88f4-a64d5027e303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:16.748332 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2546f-7353-47a9-88f4-a64d5027e303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:16.748613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2546f-7353-47a9-88f4-a64d5027e303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:16.748884 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2546f-7353-47a9-88f4-a64d5027e303 admin admin] PATH_INFO: `/v3/users/4147fb6afd8e460da3f74fa0f0833ce4` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:16.750123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2546f-7353-47a9-88f4-a64d5027e303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4147fb6afd8e460da3f74fa0f0833ce4)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:16.752152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2546f-7353-47a9-88f4-a64d5027e303 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:16.756377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0514a86-3984-477e-8ca5-8c85a24459d9 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:16.760957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1336c-6c2a-4a07-b847-e3b20d0586ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:16.761610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1336c-6c2a-4a07-b847-e3b20d0586ed service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:16.761884 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1336c-6c2a-4a07-b847-e3b20d0586ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:16.762152 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1336c-6c2a-4a07-b847-e3b20d0586ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:16.764063 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-f4c1336c-6c2a-4a07-b847-e3b20d0586ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:16.807762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ebd2546f-7353-47a9-88f4-a64d5027e303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4147fb6afd8e460da3f74fa0f0833ce4'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:16.823771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ebd2546f-7353-47a9-88f4-a64d5027e303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4147fb6afd8e460da3f74fa0f0833ce4'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:16.824547 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ebd2546f-7353-47a9-88f4-a64d5027e303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4147fb6afd8e460da3f74fa0f0833ce4'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:16.825164 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ebd2546f-7353-47a9-88f4-a64d5027e303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4147fb6afd8e460da3f74fa0f0833ce4'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:16.832585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ebd2546f-7353-47a9-88f4-a64d5027e303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4147fb6afd8e460da3f74fa0f0833ce4'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:16.838415 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1336c-6c2a-4a07-b847-e3b20d0586ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:16.840115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1336c-6c2a-4a07-b847-e3b20d0586ed service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:16.849989 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1043/2110] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:07:16.850461 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1068/2111] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:16 2022] DELETE /identity/v3/users/4147fb6afd8e460da3f74fa0f0833ce4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:17.242916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1336c-6c2a-4a07-b847-e3b20d0586ed service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:17.246548 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-f4c1336c-6c2a-4a07-b847-e3b20d0586ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:17.259633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2546f-7353-47a9-88f4-a64d5027e303 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:17.261525 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ebd2546f-7353-47a9-88f4-a64d5027e303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:17.269899 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1336c-6c2a-4a07-b847-e3b20d0586ed service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:17.346302 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da582b65-d7f4-44ee-9cc5-c847937bc3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:17.347575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da582b65-d7f4-44ee-9cc5-c847937bc3c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:17.348153 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da582b65-d7f4-44ee-9cc5-c847937bc3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:17.348676 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da582b65-d7f4-44ee-9cc5-c847937bc3c9 admin admin] PATH_INFO: `/v3/users/7b0ea365bfe4480da400d78d6892dfc3` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:17.351449 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da582b65-d7f4-44ee-9cc5-c847937bc3c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b0ea365bfe4480da400d78d6892dfc3)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:17.355077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da582b65-d7f4-44ee-9cc5-c847937bc3c9 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:17.367859 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2546f-7353-47a9-88f4-a64d5027e303 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:17.375050 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ebb0e-aa01-4a0a-89d4-ab588973011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:17.376373 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ebb0e-aa01-4a0a-89d4-ab588973011a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:17.376802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ebb0e-aa01-4a0a-89d4-ab588973011a admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:17.377262 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ebb0e-aa01-4a0a-89d4-ab588973011a admin admin] PATH_INFO: `/v3/projects/4fec83e7285f45e19aff1c48f24945fe` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:17.379322 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ebb0e-aa01-4a0a-89d4-ab588973011a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fec83e7285f45e19aff1c48f24945fe)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:17.382413 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ebb0e-aa01-4a0a-89d4-ab588973011a admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:17.434891 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-da582b65-d7f4-44ee-9cc5-c847937bc3c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b0ea365bfe4480da400d78d6892dfc3'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:17.446426 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-da582b65-d7f4-44ee-9cc5-c847937bc3c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b0ea365bfe4480da400d78d6892dfc3'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:17.448200 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-161ebb0e-aa01-4a0a-89d4-ab588973011a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fec83e7285f45e19aff1c48f24945fe', 'request_id': 'req-161ebb0e-aa01-4a0a-89d4-ab588973011a'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:17.464316 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-da582b65-d7f4-44ee-9cc5-c847937bc3c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b0ea365bfe4480da400d78d6892dfc3'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:17.464501 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-da582b65-d7f4-44ee-9cc5-c847937bc3c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b0ea365bfe4480da400d78d6892dfc3'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:17.469395 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-161ebb0e-aa01-4a0a-89d4-ab588973011a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fec83e7285f45e19aff1c48f24945fe', 'request_id': 'req-161ebb0e-aa01-4a0a-89d4-ab588973011a'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:17.483051 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-da582b65-d7f4-44ee-9cc5-c847937bc3c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b0ea365bfe4480da400d78d6892dfc3'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:17.490674 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1044/2112] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:17 2022] DELETE /identity/v3/users/7b0ea365bfe4480da400d78d6892dfc3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:17.492356 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-161ebb0e-aa01-4a0a-89d4-ab588973011a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fec83e7285f45e19aff1c48f24945fe', 'request_id': 'req-161ebb0e-aa01-4a0a-89d4-ab588973011a'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:17.499347 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0c373-19d4-4a3c-9beb-a7d03175b251 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:17.499854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0c373-19d4-4a3c-9beb-a7d03175b251 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:17.500339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0c373-19d4-4a3c-9beb-a7d03175b251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:17.513906 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-161ebb0e-aa01-4a0a-89d4-ab588973011a admin admin] The token cache is being invalidate because project 4fec83e7285f45e19aff1c48f24945fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:17.514619 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-161ebb0e-aa01-4a0a-89d4-ab588973011a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:17.516869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-161ebb0e-aa01-4a0a-89d4-ab588973011a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:17.520961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1069/2113] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:17 2022] DELETE /identity/v3/projects/4fec83e7285f45e19aff1c48f24945fe => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:17.525896 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2f536-5457-4647-a3c5-b2a662cb4ff9 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:17.526206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2f536-5457-4647-a3c5-b2a662cb4ff9 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:17.526465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2f536-5457-4647-a3c5-b2a662cb4ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:17.531465 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-d8b0c373-19d4-4a3c-9beb-a7d03175b251 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:17.533682 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-d8b0c373-19d4-4a3c-9beb-a7d03175b251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:17.546709 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-27e2f536-5457-4647-a3c5-b2a662cb4ff9 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:17.547989 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-27e2f536-5457-4647-a3c5-b2a662cb4ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:17.633900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1045/2114] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:17.641148 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1070/2115] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:07:17.649616 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0c373-19d4-4a3c-9beb-a7d03175b251 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:17.650358 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f6aa4-5445-4b9c-8077-dddd03f41088 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:17.650655 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f6aa4-5445-4b9c-8077-dddd03f41088 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:17.650967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f6aa4-5445-4b9c-8077-dddd03f41088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:17.651711 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-d8b0c373-19d4-4a3c-9beb-a7d03175b251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:17.671506 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-5a7f6aa4-5445-4b9c-8077-dddd03f41088 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:17.672740 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-5a7f6aa4-5445-4b9c-8077-dddd03f41088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:17.682273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1071/2116] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:07:17.686736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f6aa4-5445-4b9c-8077-dddd03f41088 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:17.698594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f6aa4-5445-4b9c-8077-dddd03f41088 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:17.706374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d15f1-dd9a-4a19-887b-6280020b18e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:17.707482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d15f1-dd9a-4a19-887b-6280020b18e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:17.707900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d15f1-dd9a-4a19-887b-6280020b18e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:17.708353 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d15f1-dd9a-4a19-887b-6280020b18e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:17.709706 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d15f1-dd9a-4a19-887b-6280020b18e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:07:17.710214 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d15f1-dd9a-4a19-887b-6280020b18e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:17.713643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d15f1-dd9a-4a19-887b-6280020b18e8 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:17.732275 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1072/2117] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 15:07:17.737495 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d15f1-dd9a-4a19-887b-6280020b18e8 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:17.740923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0c373-19d4-4a3c-9beb-a7d03175b251 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:17.745719 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7dca8-dc48-420f-8a28-23fa82a5c75d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:17.745719 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7dca8-dc48-420f-8a28-23fa82a5c75d service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:17.746738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7dca8-dc48-420f-8a28-23fa82a5c75d service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:17.746738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7dca8-dc48-420f-8a28-23fa82a5c75d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:17.749490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d15f1-dd9a-4a19-887b-6280020b18e8 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:17.754781 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b2e6e-9a56-4bba-a639-ccccfad362e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:17.755311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b2e6e-9a56-4bba-a639-ccccfad362e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:17.755596 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b2e6e-9a56-4bba-a639-ccccfad362e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:17.755911 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b2e6e-9a56-4bba-a639-ccccfad362e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:17.756587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b2e6e-9a56-4bba-a639-ccccfad362e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:17.757338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7dca8-dc48-420f-8a28-23fa82a5c75d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:17.758616 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b2e6e-9a56-4bba-a639-ccccfad362e3 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:17.760441 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7dca8-dc48-420f-8a28-23fa82a5c75d service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:17.775318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1046/2118] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:17.801426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1073/2119] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:07:17 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:07:17.806785 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7dca8-dc48-420f-8a28-23fa82a5c75d service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:17.817245 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7dca8-dc48-420f-8a28-23fa82a5c75d service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:17.897382 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e7ff1-10b4-4b8d-914e-83db702dea78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:17.898633 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e7ff1-10b4-4b8d-914e-83db702dea78 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:17.899016 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e7ff1-10b4-4b8d-914e-83db702dea78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:17.899418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e7ff1-10b4-4b8d-914e-83db702dea78 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:17.900250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e7ff1-10b4-4b8d-914e-83db702dea78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:17.902536 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e7ff1-10b4-4b8d-914e-83db702dea78 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:17.929569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1047/2120] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:07:17 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:17.934471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b2e6e-9a56-4bba-a639-ccccfad362e3 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:17.948743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b2e6e-9a56-4bba-a639-ccccfad362e3 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:17.954534 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a6f16-26f9-4e68-b95e-86e34dc34eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:17.955490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6f16-26f9-4e68-b95e-86e34dc34eed admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:17.955771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6f16-26f9-4e68-b95e-86e34dc34eed admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:17.956039 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6f16-26f9-4e68-b95e-86e34dc34eed admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:17.956783 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a6f16-26f9-4e68-b95e-86e34dc34eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:17.958456 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a6f16-26f9-4e68-b95e-86e34dc34eed admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:17.970861 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1074/2121] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:17.975089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e7ff1-10b4-4b8d-914e-83db702dea78 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:17.996349 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e7ff1-10b4-4b8d-914e-83db702dea78 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:18.001866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4d154-b73e-4260-ae28-ac8108dce587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:18.002482 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4d154-b73e-4260-ae28-ac8108dce587 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:18.002763 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4d154-b73e-4260-ae28-ac8108dce587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:18.003076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4d154-b73e-4260-ae28-ac8108dce587 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:18.003833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4d154-b73e-4260-ae28-ac8108dce587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:18.005462 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4d154-b73e-4260-ae28-ac8108dce587 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:18.022407 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1048/2122] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:18.023981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a6f16-26f9-4e68-b95e-86e34dc34eed admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:18.039714 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a6f16-26f9-4e68-b95e-86e34dc34eed admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:18.044704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f62f9a-f77a-4467-b2f5-849a0723b950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:18.045621 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f62f9a-f77a-4467-b2f5-849a0723b950 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:18.045898 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f62f9a-f77a-4467-b2f5-849a0723b950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:18.046168 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f62f9a-f77a-4467-b2f5-849a0723b950 admin admin] PATH_INFO: `/v3/projects/2363f1658fe84f89b000f2b4d511eb2d/users/49ac608d6c1c428282dd0840fa291c5d/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:18.064633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f62f9a-f77a-4467-b2f5-849a0723b950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2363f1658fe84f89b000f2b4d511eb2d, user_id=49ac608d6c1c428282dd0840fa291c5d, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:18.067587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f62f9a-f77a-4467-b2f5-849a0723b950 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:18.084030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1075/2123] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:18 2022] PUT /identity/v3/projects/2363f1658fe84f89b000f2b4d511eb2d/users/49ac608d6c1c428282dd0840fa291c5d/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:18.090230 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bdbb3-dfd7-478a-b0a8-d3ad9070cb6d None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:18.090531 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bdbb3-dfd7-478a-b0a8-d3ad9070cb6d None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:18.091002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bdbb3-dfd7-478a-b0a8-d3ad9070cb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:18.110592 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-2c8bdbb3-dfd7-478a-b0a8-d3ad9070cb6d None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:18.111855 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-2c8bdbb3-dfd7-478a-b0a8-d3ad9070cb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:18.115668 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f62f9a-f77a-4467-b2f5-849a0723b950 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:18.117621 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-c7f62f9a-f77a-4467-b2f5-849a0723b950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:18.192432 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1049/2124] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:18.214628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bdbb3-dfd7-478a-b0a8-d3ad9070cb6d None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:18.216758 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-2c8bdbb3-dfd7-478a-b0a8-d3ad9070cb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:18.217107 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f62f9a-f77a-4467-b2f5-849a0723b950 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:18.223592 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486e755-c1cc-41e8-9545-074de89754a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:18.224634 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486e755-c1cc-41e8-9545-074de89754a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:18.224967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486e755-c1cc-41e8-9545-074de89754a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:18.225302 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486e755-c1cc-41e8-9545-074de89754a3 admin admin] PATH_INFO: `/v3/projects/aadb3fe2036d4869a108ed309ef973b1` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:18.226805 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486e755-c1cc-41e8-9545-074de89754a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aadb3fe2036d4869a108ed309ef973b1)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:18.229038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486e755-c1cc-41e8-9545-074de89754a3 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:18.325295 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4486e755-c1cc-41e8-9545-074de89754a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aadb3fe2036d4869a108ed309ef973b1', 'request_id': 'req-4486e755-c1cc-41e8-9545-074de89754a3'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:18.335849 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4486e755-c1cc-41e8-9545-074de89754a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aadb3fe2036d4869a108ed309ef973b1', 'request_id': 'req-4486e755-c1cc-41e8-9545-074de89754a3'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:18.342525 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bdbb3-dfd7-478a-b0a8-d3ad9070cb6d None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:18.351947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4486e755-c1cc-41e8-9545-074de89754a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aadb3fe2036d4869a108ed309ef973b1', 'request_id': 'req-4486e755-c1cc-41e8-9545-074de89754a3'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:18.371844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4486e755-c1cc-41e8-9545-074de89754a3 admin admin] The token cache is being invalidate because project aadb3fe2036d4869a108ed309ef973b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:18.372220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4486e755-c1cc-41e8-9545-074de89754a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:18.375009 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4486e755-c1cc-41e8-9545-074de89754a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:18.383597 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1076/2125] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:18 2022] DELETE /identity/v3/projects/aadb3fe2036d4869a108ed309ef973b1 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:18.390017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486e755-c1cc-41e8-9545-074de89754a3 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:18.392773 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-4486e755-c1cc-41e8-9545-074de89754a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:18.451902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eea834-214f-4683-9016-76a9ae9339a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:18.454915 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eea834-214f-4683-9016-76a9ae9339a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:18.455901 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eea834-214f-4683-9016-76a9ae9339a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:18.456609 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eea834-214f-4683-9016-76a9ae9339a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:18.460905 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-77eea834-214f-4683-9016-76a9ae9339a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:18.529055 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486e755-c1cc-41e8-9545-074de89754a3 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:18.539407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588b8ad-859a-4ee3-81ba-e931bc690013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:18.541175 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588b8ad-859a-4ee3-81ba-e931bc690013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:18.541460 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588b8ad-859a-4ee3-81ba-e931bc690013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:18.541730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588b8ad-859a-4ee3-81ba-e931bc690013 admin admin] PATH_INFO: `/v3/users/6188233a1e7b476fae11a935d75d1e99` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:18.543188 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588b8ad-859a-4ee3-81ba-e931bc690013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6188233a1e7b476fae11a935d75d1e99)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:18.545612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588b8ad-859a-4ee3-81ba-e931bc690013 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:18.579288 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eea834-214f-4683-9016-76a9ae9339a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:18.580987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eea834-214f-4683-9016-76a9ae9339a4 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:18.594411 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1050/2126] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:07:18.620018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7588b8ad-859a-4ee3-81ba-e931bc690013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6188233a1e7b476fae11a935d75d1e99'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:18.644896 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7588b8ad-859a-4ee3-81ba-e931bc690013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6188233a1e7b476fae11a935d75d1e99'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:18.646260 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7588b8ad-859a-4ee3-81ba-e931bc690013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6188233a1e7b476fae11a935d75d1e99'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:18.647368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7588b8ad-859a-4ee3-81ba-e931bc690013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6188233a1e7b476fae11a935d75d1e99'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:18.670446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7588b8ad-859a-4ee3-81ba-e931bc690013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6188233a1e7b476fae11a935d75d1e99'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:18.704287 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1077/2127] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:18 2022] DELETE /identity/v3/users/6188233a1e7b476fae11a935d75d1e99 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:19.156402 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eea834-214f-4683-9016-76a9ae9339a4 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:19.179518 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eea834-214f-4683-9016-76a9ae9339a4 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:19.334852 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9ebfb-9f6d-4208-9f2b-620f349890ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:19.336133 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9ebfb-9f6d-4208-9f2b-620f349890ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:19.336509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9ebfb-9f6d-4208-9f2b-620f349890ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:19.336958 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9ebfb-9f6d-4208-9f2b-620f349890ca admin admin] PATH_INFO: `/v3/projects/1e12c54c7dcd41f69c3cb2235c22252c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:19.338450 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9ebfb-9f6d-4208-9f2b-620f349890ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e12c54c7dcd41f69c3cb2235c22252c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:19.340840 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9ebfb-9f6d-4208-9f2b-620f349890ca admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:19.405627 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e9f9ebfb-9f6d-4208-9f2b-620f349890ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e12c54c7dcd41f69c3cb2235c22252c', 'request_id': 'req-e9f9ebfb-9f6d-4208-9f2b-620f349890ca'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:19.418687 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e9f9ebfb-9f6d-4208-9f2b-620f349890ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e12c54c7dcd41f69c3cb2235c22252c', 'request_id': 'req-e9f9ebfb-9f6d-4208-9f2b-620f349890ca'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:19.427393 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e9f9ebfb-9f6d-4208-9f2b-620f349890ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e12c54c7dcd41f69c3cb2235c22252c', 'request_id': 'req-e9f9ebfb-9f6d-4208-9f2b-620f349890ca'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:19.445998 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e9f9ebfb-9f6d-4208-9f2b-620f349890ca admin admin] The token cache is being invalidate because project 1e12c54c7dcd41f69c3cb2235c22252c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:19.446945 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e9f9ebfb-9f6d-4208-9f2b-620f349890ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:19.447918 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e9f9ebfb-9f6d-4208-9f2b-620f349890ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:19.453456 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1051/2128] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:19 2022] DELETE /identity/v3/projects/1e12c54c7dcd41f69c3cb2235c22252c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:19.456794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a95d6-72de-48b9-b199-1d64347214a6 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:19.458360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a95d6-72de-48b9-b199-1d64347214a6 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:19.459714 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a95d6-72de-48b9-b199-1d64347214a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:19.519802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-a65a95d6-72de-48b9-b199-1d64347214a6 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:19.522218 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a65a95d6-72de-48b9-b199-1d64347214a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:19.616518 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168c033-651d-497d-81db-02b17e702213 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:19.621688 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168c033-651d-497d-81db-02b17e702213 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:19.622403 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168c033-651d-497d-81db-02b17e702213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:19.647292 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1078/2129] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:19.654879 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc7bec-6861-4457-abeb-732396e9d7e3 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:19.655492 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc7bec-6861-4457-abeb-732396e9d7e3 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:19.655953 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc7bec-6861-4457-abeb-732396e9d7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:19.672975 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-f168c033-651d-497d-81db-02b17e702213 None None] MFA Rules not processed for user `49ac608d6c1c428282dd0840fa291c5d`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:19.674442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-f168c033-651d-497d-81db-02b17e702213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:19.678692 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-35cc7bec-6861-4457-abeb-732396e9d7e3 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:19.682456 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-35cc7bec-6861-4457-abeb-732396e9d7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:19.696700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1079/2130] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:19.707034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc7bec-6861-4457-abeb-732396e9d7e3 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:19.719511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc7bec-6861-4457-abeb-732396e9d7e3 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:19.730136 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1d279-9a98-4aec-9b95-37471d1d6f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:19.731046 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1d279-9a98-4aec-9b95-37471d1d6f3e admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:19.731470 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1d279-9a98-4aec-9b95-37471d1d6f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:19.732379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1d279-9a98-4aec-9b95-37471d1d6f3e admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:19.733744 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1d279-9a98-4aec-9b95-37471d1d6f3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:07:19.734425 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1d279-9a98-4aec-9b95-37471d1d6f3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:19.737865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1d279-9a98-4aec-9b95-37471d1d6f3e admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:19.760546 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1080/2131] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:07:19.765941 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1d279-9a98-4aec-9b95-37471d1d6f3e admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:19.783198 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1d279-9a98-4aec-9b95-37471d1d6f3e admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:19.792209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82be5b-5c2f-42b0-ad07-4b3df70ea719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:19.793748 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82be5b-5c2f-42b0-ad07-4b3df70ea719 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:19.794702 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82be5b-5c2f-42b0-ad07-4b3df70ea719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:19.795365 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82be5b-5c2f-42b0-ad07-4b3df70ea719 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:19.796587 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1052/2132] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:19.797107 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82be5b-5c2f-42b0-ad07-4b3df70ea719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:19.799081 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168c033-651d-497d-81db-02b17e702213 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:19.800695 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-f168c033-651d-497d-81db-02b17e702213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:19.802268 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82be5b-5c2f-42b0-ad07-4b3df70ea719 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:19.822187 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168c033-651d-497d-81db-02b17e702213 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:19.829846 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea65b7d-1f0d-4a0d-93a1-6a825e42b8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:19.830566 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea65b7d-1f0d-4a0d-93a1-6a825e42b8c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:19.830916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea65b7d-1f0d-4a0d-93a1-6a825e42b8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:19.831162 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea65b7d-1f0d-4a0d-93a1-6a825e42b8c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:19.831880 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea65b7d-1f0d-4a0d-93a1-6a825e42b8c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:19.834081 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea65b7d-1f0d-4a0d-93a1-6a825e42b8c7 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:19.869632 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1081/2133] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:07:19 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:19.874977 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82be5b-5c2f-42b0-ad07-4b3df70ea719 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:19.876633 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1053/2134] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:07:19 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:19.892050 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea65b7d-1f0d-4a0d-93a1-6a825e42b8c7 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:20.030669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82be5b-5c2f-42b0-ad07-4b3df70ea719 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:20.040037 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea65b7d-1f0d-4a0d-93a1-6a825e42b8c7 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:20.040913 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534621f-6342-46e6-9b00-cfdb76f38302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:20.042238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534621f-6342-46e6-9b00-cfdb76f38302 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:20.042866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534621f-6342-46e6-9b00-cfdb76f38302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:20.043473 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534621f-6342-46e6-9b00-cfdb76f38302 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:20.044996 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534621f-6342-46e6-9b00-cfdb76f38302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:20.046915 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535eba44-7e29-48b5-a562-3c16a84ffae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:20.047761 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535eba44-7e29-48b5-a562-3c16a84ffae8 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:20.048189 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535eba44-7e29-48b5-a562-3c16a84ffae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:20.048625 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535eba44-7e29-48b5-a562-3c16a84ffae8 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:20.049480 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534621f-6342-46e6-9b00-cfdb76f38302 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:20.049668 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535eba44-7e29-48b5-a562-3c16a84ffae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:20.052275 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535eba44-7e29-48b5-a562-3c16a84ffae8 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:20.094634 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1082/2135] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:07:19 2022] POST /identity/v3/users => generated 292 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:20.101659 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1054/2136] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:07:19 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:20.101844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534621f-6342-46e6-9b00-cfdb76f38302 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:20.103285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535eba44-7e29-48b5-a562-3c16a84ffae8 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:20.120604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535eba44-7e29-48b5-a562-3c16a84ffae8 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:20.121254 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534621f-6342-46e6-9b00-cfdb76f38302 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:20.129813 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411158c0-df3f-4234-8636-c5feb0e27408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:20.129813 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411158c0-df3f-4234-8636-c5feb0e27408 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:20.130339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411158c0-df3f-4234-8636-c5feb0e27408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:20.130339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411158c0-df3f-4234-8636-c5feb0e27408 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:20.131635 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411158c0-df3f-4234-8636-c5feb0e27408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:20.132077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4edad-1036-4beb-924e-c8f68715e6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:20.134430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4edad-1036-4beb-924e-c8f68715e6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:20.134430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4edad-1036-4beb-924e-c8f68715e6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:20.134430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4edad-1036-4beb-924e-c8f68715e6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:20.134759 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411158c0-df3f-4234-8636-c5feb0e27408 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:20.136013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4edad-1036-4beb-924e-c8f68715e6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:20.138736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4edad-1036-4beb-924e-c8f68715e6d1 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:20.160411 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1055/2137] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:20.160686 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1083/2138] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:20.164049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4edad-1036-4beb-924e-c8f68715e6d1 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:20.164260 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411158c0-df3f-4234-8636-c5feb0e27408 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:20.175581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4edad-1036-4beb-924e-c8f68715e6d1 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:20.181862 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc7dd3-d249-4f9e-81cb-01c34089baa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:20.182197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411158c0-df3f-4234-8636-c5feb0e27408 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:20.183446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc7dd3-d249-4f9e-81cb-01c34089baa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:20.183446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc7dd3-d249-4f9e-81cb-01c34089baa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:20.183756 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc7dd3-d249-4f9e-81cb-01c34089baa5 admin admin] PATH_INFO: `/v3/projects/361f4737d650442b9df1e48ebafc04d6/users/0ce67a8dab1744ed94efb7ef4f96185c/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:20.194172 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb33a5-15e8-41f1-afea-9476f0f08749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:20.196405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb33a5-15e8-41f1-afea-9476f0f08749 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:20.197019 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb33a5-15e8-41f1-afea-9476f0f08749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:20.197529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb33a5-15e8-41f1-afea-9476f0f08749 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:20.199265 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb33a5-15e8-41f1-afea-9476f0f08749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:20.201774 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb33a5-15e8-41f1-afea-9476f0f08749 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:20.203219 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc7dd3-d249-4f9e-81cb-01c34089baa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=361f4737d650442b9df1e48ebafc04d6, user_id=0ce67a8dab1744ed94efb7ef4f96185c, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:20.206041 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc7dd3-d249-4f9e-81cb-01c34089baa5 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:20.221599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1056/2139] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:20.226609 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb33a5-15e8-41f1-afea-9476f0f08749 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:20.241107 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb33a5-15e8-41f1-afea-9476f0f08749 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:20.244043 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1084/2140] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:20 2022] PUT /identity/v3/projects/361f4737d650442b9df1e48ebafc04d6/users/0ce67a8dab1744ed94efb7ef4f96185c/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:20.250217 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc7dd3-d249-4f9e-81cb-01c34089baa5 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:20.343151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc7dd3-d249-4f9e-81cb-01c34089baa5 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:20.345782 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f60e7-3bd7-40c7-aa05-50f5bd7eb671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:20.346723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f60e7-3bd7-40c7-aa05-50f5bd7eb671 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:20.347042 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f60e7-3bd7-40c7-aa05-50f5bd7eb671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:20.347335 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f60e7-3bd7-40c7-aa05-50f5bd7eb671 admin admin] PATH_INFO: `/v3/projects/c38ebdf52b664a5a89242fd1d5d40b71/users/ebe124793636409a90cf410a988aa3d6/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:20.350413 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f1bb2-7078-405f-b8e5-c65e9d65b360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:20.351180 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f1bb2-7078-405f-b8e5-c65e9d65b360 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:20.351460 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f1bb2-7078-405f-b8e5-c65e9d65b360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:20.351735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f1bb2-7078-405f-b8e5-c65e9d65b360 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:20.352477 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f1bb2-7078-405f-b8e5-c65e9d65b360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:20.354118 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f1bb2-7078-405f-b8e5-c65e9d65b360 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:20.364600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1085/2141] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:20.365607 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f60e7-3bd7-40c7-aa05-50f5bd7eb671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38ebdf52b664a5a89242fd1d5d40b71, user_id=ebe124793636409a90cf410a988aa3d6, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:20.368690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f1bb2-7078-405f-b8e5-c65e9d65b360 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:20.368996 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f60e7-3bd7-40c7-aa05-50f5bd7eb671 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:20.378694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f1bb2-7078-405f-b8e5-c65e9d65b360 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:20.387607 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1057/2142] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:20 2022] PUT /identity/v3/projects/c38ebdf52b664a5a89242fd1d5d40b71/users/ebe124793636409a90cf410a988aa3d6/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:20.399927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca8255-0098-449e-89d5-da2bacb45963 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:20.400244 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca8255-0098-449e-89d5-da2bacb45963 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:20.400469 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca8255-0098-449e-89d5-da2bacb45963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:20.427736 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-b5ca8255-0098-449e-89d5-da2bacb45963 None None] MFA Rules not processed for user `ebe124793636409a90cf410a988aa3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:20.429329 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-b5ca8255-0098-449e-89d5-da2bacb45963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:20.442325 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb970bc-5286-4a8b-a49e-d2f6bc98c8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:20.443265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb970bc-5286-4a8b-a49e-d2f6bc98c8b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:20.443631 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb970bc-5286-4a8b-a49e-d2f6bc98c8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:20.443912 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb970bc-5286-4a8b-a49e-d2f6bc98c8b1 admin admin] PATH_INFO: `/v3/projects/361f4737d650442b9df1e48ebafc04d6/users/0ce67a8dab1744ed94efb7ef4f96185c/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:20.446611 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb970bc-5286-4a8b-a49e-d2f6bc98c8b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=361f4737d650442b9df1e48ebafc04d6, user_id=0ce67a8dab1744ed94efb7ef4f96185c, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:20.449354 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb970bc-5286-4a8b-a49e-d2f6bc98c8b1 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:20.460974 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1086/2143] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:20 2022] PUT /identity/v3/projects/361f4737d650442b9df1e48ebafc04d6/users/0ce67a8dab1744ed94efb7ef4f96185c/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:20.505161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1058/2144] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:07:20.517680 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb970bc-5286-4a8b-a49e-d2f6bc98c8b1 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:20.520684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-9fb970bc-5286-4a8b-a49e-d2f6bc98c8b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:20.659423 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb970bc-5286-4a8b-a49e-d2f6bc98c8b1 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:20.671418 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e151ef9-e6d3-47d2-9e69-1621096b87a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:20.672789 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e151ef9-e6d3-47d2-9e69-1621096b87a4 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:20.673377 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e151ef9-e6d3-47d2-9e69-1621096b87a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:20.673906 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e151ef9-e6d3-47d2-9e69-1621096b87a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:20.747333 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e151ef9-e6d3-47d2-9e69-1621096b87a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:20.748778 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e151ef9-e6d3-47d2-9e69-1621096b87a4 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:20.761403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1087/2145] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:07:21.049928 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca8255-0098-449e-89d5-da2bacb45963 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:21.051976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-b5ca8255-0098-449e-89d5-da2bacb45963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:21.075729 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca8255-0098-449e-89d5-da2bacb45963 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:21.207908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9245a5-6f56-4a0b-9204-8ea7a9deca89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:21.209856 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9245a5-6f56-4a0b-9204-8ea7a9deca89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:21.210990 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9245a5-6f56-4a0b-9204-8ea7a9deca89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:21.211443 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9245a5-6f56-4a0b-9204-8ea7a9deca89 admin admin] PATH_INFO: `/v3/users/1ad47d91fb074164abff84205fe5e9c6` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:21.214728 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9245a5-6f56-4a0b-9204-8ea7a9deca89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad47d91fb074164abff84205fe5e9c6)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:21.217574 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9245a5-6f56-4a0b-9204-8ea7a9deca89 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:21.316824 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4e9245a5-6f56-4a0b-9204-8ea7a9deca89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad47d91fb074164abff84205fe5e9c6'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:21.330172 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4e9245a5-6f56-4a0b-9204-8ea7a9deca89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad47d91fb074164abff84205fe5e9c6'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:21.354605 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4e9245a5-6f56-4a0b-9204-8ea7a9deca89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad47d91fb074164abff84205fe5e9c6'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:21.356305 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4e9245a5-6f56-4a0b-9204-8ea7a9deca89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad47d91fb074164abff84205fe5e9c6'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:21.367157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4e9245a5-6f56-4a0b-9204-8ea7a9deca89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad47d91fb074164abff84205fe5e9c6'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:21.374468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1059/2146] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:21 2022] DELETE /identity/v3/users/1ad47d91fb074164abff84205fe5e9c6 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:21.381250 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7bfe7-bad7-44b6-a226-261cb92a9c81 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:21.382458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7bfe7-bad7-44b6-a226-261cb92a9c81 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:21.383651 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7bfe7-bad7-44b6-a226-261cb92a9c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:21.410976 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-30d7bfe7-bad7-44b6-a226-261cb92a9c81 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:21.414062 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-30d7bfe7-bad7-44b6-a226-261cb92a9c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:21.433953 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8feb3-1b4f-4959-821c-84766ba21e22 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:21.435500 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8feb3-1b4f-4959-821c-84766ba21e22 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:21.436299 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8feb3-1b4f-4959-821c-84766ba21e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:21.488975 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-01f8feb3-1b4f-4959-821c-84766ba21e22 None None] MFA Rules not processed for user `0ce67a8dab1744ed94efb7ef4f96185c`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:21.492902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-01f8feb3-1b4f-4959-821c-84766ba21e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:21.497333 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1088/2147] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:21.510930 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7bfe7-bad7-44b6-a226-261cb92a9c81 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:21.512873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-30d7bfe7-bad7-44b6-a226-261cb92a9c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:21.589566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7bfe7-bad7-44b6-a226-261cb92a9c81 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:21.596751 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bd2ee-7881-4227-80e7-ee62de114ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:21.597714 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bd2ee-7881-4227-80e7-ee62de114ccb service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:21.598139 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bd2ee-7881-4227-80e7-ee62de114ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:21.598571 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bd2ee-7881-4227-80e7-ee62de114ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:21.609601 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bd2ee-7881-4227-80e7-ee62de114ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:21.611559 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bd2ee-7881-4227-80e7-ee62de114ccb service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:21.620674 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1060/2148] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:21.647309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8feb3-1b4f-4959-821c-84766ba21e22 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:21.651385 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-01f8feb3-1b4f-4959-821c-84766ba21e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:21.669664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1089/2149] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:07:21.819177 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8feb3-1b4f-4959-821c-84766ba21e22 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:21.825391 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac21dcc-2835-41ed-8ba8-e16fc82a2ab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:21.826218 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac21dcc-2835-41ed-8ba8-e16fc82a2ab8 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:21.826700 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac21dcc-2835-41ed-8ba8-e16fc82a2ab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:21.827217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac21dcc-2835-41ed-8ba8-e16fc82a2ab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:21.831327 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-fac21dcc-2835-41ed-8ba8-e16fc82a2ab8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:21.907260 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac21dcc-2835-41ed-8ba8-e16fc82a2ab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:21.908766 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac21dcc-2835-41ed-8ba8-e16fc82a2ab8 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:21.921199 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1061/2150] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:07:22.292996 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bd2ee-7881-4227-80e7-ee62de114ccb service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:22.295778 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-268bd2ee-7881-4227-80e7-ee62de114ccb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:22.315250 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bd2ee-7881-4227-80e7-ee62de114ccb service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:22.336975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d637e-dadd-4cce-ab04-8d9190559233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:22.336975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d637e-dadd-4cce-ab04-8d9190559233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:22.336975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d637e-dadd-4cce-ab04-8d9190559233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:22.336975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d637e-dadd-4cce-ab04-8d9190559233 admin admin] PATH_INFO: `/v3/projects/b42e0def324642089afe8b25a29e2817` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:22.341589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d637e-dadd-4cce-ab04-8d9190559233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b42e0def324642089afe8b25a29e2817)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:22.344712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d637e-dadd-4cce-ab04-8d9190559233 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:22.463480 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-0a4d637e-dadd-4cce-ab04-8d9190559233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b42e0def324642089afe8b25a29e2817', 'request_id': 'req-0a4d637e-dadd-4cce-ab04-8d9190559233'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:22.472770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-0a4d637e-dadd-4cce-ab04-8d9190559233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b42e0def324642089afe8b25a29e2817', 'request_id': 'req-0a4d637e-dadd-4cce-ab04-8d9190559233'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:22.496810 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-0a4d637e-dadd-4cce-ab04-8d9190559233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b42e0def324642089afe8b25a29e2817', 'request_id': 'req-0a4d637e-dadd-4cce-ab04-8d9190559233'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:22.519125 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-0a4d637e-dadd-4cce-ab04-8d9190559233 admin admin] The token cache is being invalidate because project b42e0def324642089afe8b25a29e2817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:22.519940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-0a4d637e-dadd-4cce-ab04-8d9190559233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:22.521733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-0a4d637e-dadd-4cce-ab04-8d9190559233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:22.524451 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1090/2151] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:22 2022] DELETE /identity/v3/projects/b42e0def324642089afe8b25a29e2817 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:22.529375 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165772e-566a-4e85-8908-1dc7ca013af7 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:22.529933 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165772e-566a-4e85-8908-1dc7ca013af7 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:22.529933 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165772e-566a-4e85-8908-1dc7ca013af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:22.566632 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-7165772e-566a-4e85-8908-1dc7ca013af7 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:22.566632 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-7165772e-566a-4e85-8908-1dc7ca013af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:22.722606 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1062/2152] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:22.731532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55c8f9-eb90-430a-a189-b1e585beda02 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:22.732054 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55c8f9-eb90-430a-a189-b1e585beda02 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:22.732464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55c8f9-eb90-430a-a189-b1e585beda02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:22.766557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-8e55c8f9-eb90-430a-a189-b1e585beda02 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:22.768763 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-8e55c8f9-eb90-430a-a189-b1e585beda02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:22.780895 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1091/2153] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:22.785216 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165772e-566a-4e85-8908-1dc7ca013af7 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:22.797093 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165772e-566a-4e85-8908-1dc7ca013af7 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:22.807833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d68af-885b-4baa-9486-be0459f6c365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:22.808634 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d68af-885b-4baa-9486-be0459f6c365 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:22.809028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d68af-885b-4baa-9486-be0459f6c365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:22.809378 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d68af-885b-4baa-9486-be0459f6c365 admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:22.810226 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d68af-885b-4baa-9486-be0459f6c365 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:07:22.810700 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d68af-885b-4baa-9486-be0459f6c365 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:22.813326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d68af-885b-4baa-9486-be0459f6c365 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:22.834544 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1063/2154] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:07:22.836903 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55c8f9-eb90-430a-a189-b1e585beda02 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:22.850975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55c8f9-eb90-430a-a189-b1e585beda02 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:22.863244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b95bd3-6dde-4ae0-b0c4-c3a361e5dd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:22.863987 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b95bd3-6dde-4ae0-b0c4-c3a361e5dd25 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:22.864329 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b95bd3-6dde-4ae0-b0c4-c3a361e5dd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:22.864605 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b95bd3-6dde-4ae0-b0c4-c3a361e5dd25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:22.866037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b95bd3-6dde-4ae0-b0c4-c3a361e5dd25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:22.868160 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b95bd3-6dde-4ae0-b0c4-c3a361e5dd25 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:22.920218 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1092/2155] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:07:22 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:22.927050 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d68af-885b-4baa-9486-be0459f6c365 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:22.944815 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d68af-885b-4baa-9486-be0459f6c365 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:23.047597 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57732531-c8c4-46b6-bdf6-15dd5ed60051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:23.048324 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57732531-c8c4-46b6-bdf6-15dd5ed60051 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:23.048606 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57732531-c8c4-46b6-bdf6-15dd5ed60051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:23.048875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57732531-c8c4-46b6-bdf6-15dd5ed60051 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:23.049606 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57732531-c8c4-46b6-bdf6-15dd5ed60051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:23.051633 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57732531-c8c4-46b6-bdf6-15dd5ed60051 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:23.079230 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1064/2156] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:07:22 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:23.080220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b95bd3-6dde-4ae0-b0c4-c3a361e5dd25 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:23.092134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b95bd3-6dde-4ae0-b0c4-c3a361e5dd25 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:23.095140 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57732531-c8c4-46b6-bdf6-15dd5ed60051 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:23.097737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-57732531-c8c4-46b6-bdf6-15dd5ed60051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:23.098614 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6daf996-e8c0-470f-b905-a90da25c9937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:23.101243 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6daf996-e8c0-470f-b905-a90da25c9937 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:23.101722 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6daf996-e8c0-470f-b905-a90da25c9937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:23.101884 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6daf996-e8c0-470f-b905-a90da25c9937 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:23.102542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6daf996-e8c0-470f-b905-a90da25c9937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:23.104217 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6daf996-e8c0-470f-b905-a90da25c9937 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:23.114178 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57732531-c8c4-46b6-bdf6-15dd5ed60051 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:23.116425 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1093/2157] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:07:23.122371 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6daf996-e8c0-470f-b905-a90da25c9937 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:23.123358 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74abdb-8505-4f94-87c1-57dd060b2a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:23.124329 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74abdb-8505-4f94-87c1-57dd060b2a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:23.124713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74abdb-8505-4f94-87c1-57dd060b2a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:23.125051 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74abdb-8505-4f94-87c1-57dd060b2a45 admin admin] PATH_INFO: `/v3/users/a521044065d74e8992bd69c9fa63be19` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:23.126379 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74abdb-8505-4f94-87c1-57dd060b2a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a521044065d74e8992bd69c9fa63be19)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:23.128820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74abdb-8505-4f94-87c1-57dd060b2a45 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:23.139609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6daf996-e8c0-470f-b905-a90da25c9937 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:23.148515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f07058-515c-4795-8aba-47f4c6c66ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:23.149640 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f07058-515c-4795-8aba-47f4c6c66ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:23.150087 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f07058-515c-4795-8aba-47f4c6c66ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:23.150731 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f07058-515c-4795-8aba-47f4c6c66ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:23.152046 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f07058-515c-4795-8aba-47f4c6c66ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:23.154957 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f07058-515c-4795-8aba-47f4c6c66ee6 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:23.174912 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1094/2158] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:23.175886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f07058-515c-4795-8aba-47f4c6c66ee6 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:23.188726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f07058-515c-4795-8aba-47f4c6c66ee6 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:23.195482 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ad74abdb-8505-4f94-87c1-57dd060b2a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a521044065d74e8992bd69c9fa63be19'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:23.200192 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1088a3-ba4f-4ff1-9ff7-f70249ba5780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:23.202553 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1088a3-ba4f-4ff1-9ff7-f70249ba5780 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:23.202851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1088a3-ba4f-4ff1-9ff7-f70249ba5780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:23.203122 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1088a3-ba4f-4ff1-9ff7-f70249ba5780 admin admin] PATH_INFO: `/v3/projects/2f8abbaff1d64f80aaaee94cbcebbacc/users/933db9887896416d8a0efe5cbd1dfb6d/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:23.207828 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ad74abdb-8505-4f94-87c1-57dd060b2a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a521044065d74e8992bd69c9fa63be19'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:23.228238 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ad74abdb-8505-4f94-87c1-57dd060b2a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a521044065d74e8992bd69c9fa63be19'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:23.229542 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ad74abdb-8505-4f94-87c1-57dd060b2a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a521044065d74e8992bd69c9fa63be19'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:23.234371 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1088a3-ba4f-4ff1-9ff7-f70249ba5780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f8abbaff1d64f80aaaee94cbcebbacc, user_id=933db9887896416d8a0efe5cbd1dfb6d, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:23.239841 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ad74abdb-8505-4f94-87c1-57dd060b2a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a521044065d74e8992bd69c9fa63be19'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:23.243816 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1088a3-ba4f-4ff1-9ff7-f70249ba5780 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:23.249946 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1065/2159] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:23 2022] DELETE /identity/v3/users/a521044065d74e8992bd69c9fa63be19 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:23.256156 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc83299-df74-4a29-867b-88fe8ea5a1f3 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:23.256585 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc83299-df74-4a29-867b-88fe8ea5a1f3 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:23.257668 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc83299-df74-4a29-867b-88fe8ea5a1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:23.284412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-4dc83299-df74-4a29-867b-88fe8ea5a1f3 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:23.286479 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-4dc83299-df74-4a29-867b-88fe8ea5a1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:23.287216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1095/2160] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:23 2022] PUT /identity/v3/projects/2f8abbaff1d64f80aaaee94cbcebbacc/users/933db9887896416d8a0efe5cbd1dfb6d/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:23.295080 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ca0fd-9599-4c62-ba62-c1beedd5cd9a None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:23.295868 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ca0fd-9599-4c62-ba62-c1beedd5cd9a None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:23.296330 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ca0fd-9599-4c62-ba62-c1beedd5cd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:23.345577 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-a28ca0fd-9599-4c62-ba62-c1beedd5cd9a None None] MFA Rules not processed for user `933db9887896416d8a0efe5cbd1dfb6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:23.347150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a28ca0fd-9599-4c62-ba62-c1beedd5cd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:23.392769 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1066/2161] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:23.406292 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc83299-df74-4a29-867b-88fe8ea5a1f3 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:23.408532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-4dc83299-df74-4a29-867b-88fe8ea5a1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:23.429226 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1096/2162] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:07:23.451222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ca0fd-9599-4c62-ba62-c1beedd5cd9a None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:23.452656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a28ca0fd-9599-4c62-ba62-c1beedd5cd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:23.518687 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc83299-df74-4a29-867b-88fe8ea5a1f3 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:23.519220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ca0fd-9599-4c62-ba62-c1beedd5cd9a None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:23.523162 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838c8de-0863-443e-943d-4459d8d6a811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:23.524343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838c8de-0863-443e-943d-4459d8d6a811 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:23.524608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838c8de-0863-443e-943d-4459d8d6a811 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:23.525063 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838c8de-0863-443e-943d-4459d8d6a811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:23.528256 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f34d7e-165d-4545-891b-450ae0ed7448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:23.529580 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f34d7e-165d-4545-891b-450ae0ed7448 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:23.530140 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f34d7e-165d-4545-891b-450ae0ed7448 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:23.530344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f34d7e-165d-4545-891b-450ae0ed7448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:23.534033 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838c8de-0863-443e-943d-4459d8d6a811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:23.535590 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838c8de-0863-443e-943d-4459d8d6a811 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:23.548036 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1097/2163] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:07:23.551462 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f34d7e-165d-4545-891b-450ae0ed7448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:23.554657 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f34d7e-165d-4545-891b-450ae0ed7448 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:23.572820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1067/2164] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:07:23.711354 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838c8de-0863-443e-943d-4459d8d6a811 service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:23.714411 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-0838c8de-0863-443e-943d-4459d8d6a811 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:23.736813 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838c8de-0863-443e-943d-4459d8d6a811 service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:23.743879 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d430f-61a6-465f-bcb9-965af3cbbc90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:23.745156 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d430f-61a6-465f-bcb9-965af3cbbc90 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:23.745895 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d430f-61a6-465f-bcb9-965af3cbbc90 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:23.746605 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d430f-61a6-465f-bcb9-965af3cbbc90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:23.750046 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-b46d430f-61a6-465f-bcb9-965af3cbbc90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:23.887656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d430f-61a6-465f-bcb9-965af3cbbc90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:23.890442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d430f-61a6-465f-bcb9-965af3cbbc90 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:23.909800 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1098/2165] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:24.181879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f34d7e-165d-4545-891b-450ae0ed7448 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:24.185096 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-04f34d7e-165d-4545-891b-450ae0ed7448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:24.211335 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f34d7e-165d-4545-891b-450ae0ed7448 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:24.220874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f79832-96af-4d4e-8b16-e91d757a38b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:24.227070 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f79832-96af-4d4e-8b16-e91d757a38b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:24.227070 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f79832-96af-4d4e-8b16-e91d757a38b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:24.227070 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f79832-96af-4d4e-8b16-e91d757a38b9 admin admin] PATH_INFO: `/v3/projects/8a073f10e7d14dc696cad222233d99df` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:24.227070 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f79832-96af-4d4e-8b16-e91d757a38b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a073f10e7d14dc696cad222233d99df)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:24.230178 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f79832-96af-4d4e-8b16-e91d757a38b9 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:24.314389 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-96f79832-96af-4d4e-8b16-e91d757a38b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a073f10e7d14dc696cad222233d99df', 'request_id': 'req-96f79832-96af-4d4e-8b16-e91d757a38b9'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:24.322530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-96f79832-96af-4d4e-8b16-e91d757a38b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a073f10e7d14dc696cad222233d99df', 'request_id': 'req-96f79832-96af-4d4e-8b16-e91d757a38b9'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:24.330387 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-96f79832-96af-4d4e-8b16-e91d757a38b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a073f10e7d14dc696cad222233d99df', 'request_id': 'req-96f79832-96af-4d4e-8b16-e91d757a38b9'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:24.347833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-96f79832-96af-4d4e-8b16-e91d757a38b9 admin admin] The token cache is being invalidate because project 8a073f10e7d14dc696cad222233d99df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:24.348257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-96f79832-96af-4d4e-8b16-e91d757a38b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:24.349222 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-96f79832-96af-4d4e-8b16-e91d757a38b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:24.357131 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1068/2166] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:24 2022] DELETE /identity/v3/projects/8a073f10e7d14dc696cad222233d99df => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:24.362948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d430f-61a6-465f-bcb9-965af3cbbc90 service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:24.374713 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d430f-61a6-465f-bcb9-965af3cbbc90 service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:24.486987 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cda18-bae1-4836-9c06-d9091b92ea33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:24.488550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cda18-bae1-4836-9c06-d9091b92ea33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:24.489065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cda18-bae1-4836-9c06-d9091b92ea33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:24.489577 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cda18-bae1-4836-9c06-d9091b92ea33 admin admin] PATH_INFO: `/v3/users/ce18b8611b65448eadec1f2424cb97af` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:24.492498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cda18-bae1-4836-9c06-d9091b92ea33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce18b8611b65448eadec1f2424cb97af)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:24.496340 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cda18-bae1-4836-9c06-d9091b92ea33 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:24.560532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2d3cda18-bae1-4836-9c06-d9091b92ea33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce18b8611b65448eadec1f2424cb97af'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:24.581353 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2d3cda18-bae1-4836-9c06-d9091b92ea33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce18b8611b65448eadec1f2424cb97af'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:24.582327 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2d3cda18-bae1-4836-9c06-d9091b92ea33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce18b8611b65448eadec1f2424cb97af'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:24.583410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2d3cda18-bae1-4836-9c06-d9091b92ea33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce18b8611b65448eadec1f2424cb97af'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:24.591499 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2d3cda18-bae1-4836-9c06-d9091b92ea33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce18b8611b65448eadec1f2424cb97af'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:24.606349 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1099/2167] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:24 2022] DELETE /identity/v3/users/ce18b8611b65448eadec1f2424cb97af => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:24.936866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f79832-96af-4d4e-8b16-e91d757a38b9 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:24.939336 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-96f79832-96af-4d4e-8b16-e91d757a38b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:24.973492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f79832-96af-4d4e-8b16-e91d757a38b9 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:25.077626 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45fd5f-09e7-491b-8faa-3e7cfea1c923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:25.078673 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45fd5f-09e7-491b-8faa-3e7cfea1c923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:25.079100 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45fd5f-09e7-491b-8faa-3e7cfea1c923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:25.079484 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45fd5f-09e7-491b-8faa-3e7cfea1c923 admin admin] PATH_INFO: `/v3/projects/b336359bfc9546c3b7669496f778de8d` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:25.081175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45fd5f-09e7-491b-8faa-3e7cfea1c923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b336359bfc9546c3b7669496f778de8d)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:25.083387 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45fd5f-09e7-491b-8faa-3e7cfea1c923 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:25.148775 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4e45fd5f-09e7-491b-8faa-3e7cfea1c923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b336359bfc9546c3b7669496f778de8d', 'request_id': 'req-4e45fd5f-09e7-491b-8faa-3e7cfea1c923'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:25.159829 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4e45fd5f-09e7-491b-8faa-3e7cfea1c923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b336359bfc9546c3b7669496f778de8d', 'request_id': 'req-4e45fd5f-09e7-491b-8faa-3e7cfea1c923'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:25.167152 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4e45fd5f-09e7-491b-8faa-3e7cfea1c923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b336359bfc9546c3b7669496f778de8d', 'request_id': 'req-4e45fd5f-09e7-491b-8faa-3e7cfea1c923'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:25.190975 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4e45fd5f-09e7-491b-8faa-3e7cfea1c923 admin admin] The token cache is being invalidate because project b336359bfc9546c3b7669496f778de8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:25.191405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4e45fd5f-09e7-491b-8faa-3e7cfea1c923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:25.192454 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-4e45fd5f-09e7-491b-8faa-3e7cfea1c923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:25.195782 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1069/2168] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:24 2022] DELETE /identity/v3/projects/b336359bfc9546c3b7669496f778de8d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:25.201513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c87929-971e-4d69-b373-deb0b4c4b3a7 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:25.201797 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c87929-971e-4d69-b373-deb0b4c4b3a7 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:25.202081 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c87929-971e-4d69-b373-deb0b4c4b3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:25.227301 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-f9c87929-971e-4d69-b373-deb0b4c4b3a7 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:25.229359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-f9c87929-971e-4d69-b373-deb0b4c4b3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:25.302064 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1100/2169] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:25.315131 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7678099-6ddf-4f99-86c2-881258396179 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:25.315894 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7678099-6ddf-4f99-86c2-881258396179 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:25.316287 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7678099-6ddf-4f99-86c2-881258396179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:25.339486 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-f7678099-6ddf-4f99-86c2-881258396179 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:25.355207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-f7678099-6ddf-4f99-86c2-881258396179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:25.355964 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1070/2170] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:25.360465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c87929-971e-4d69-b373-deb0b4c4b3a7 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:25.371745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c87929-971e-4d69-b373-deb0b4c4b3a7 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:25.376937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcc67c-4ba0-41b0-b86b-c03b9bbbe128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:25.377607 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcc67c-4ba0-41b0-b86b-c03b9bbbe128 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:25.377955 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcc67c-4ba0-41b0-b86b-c03b9bbbe128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:25.378264 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcc67c-4ba0-41b0-b86b-c03b9bbbe128 admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:25.379165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcc67c-4ba0-41b0-b86b-c03b9bbbe128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:07:25.379556 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcc67c-4ba0-41b0-b86b-c03b9bbbe128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:25.381440 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcc67c-4ba0-41b0-b86b-c03b9bbbe128 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:25.395389 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1101/2171] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 15:07:25.401013 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7678099-6ddf-4f99-86c2-881258396179 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:25.411288 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7678099-6ddf-4f99-86c2-881258396179 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:25.416966 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b32a4-28e0-45e3-a454-682361fcb01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:25.417659 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b32a4-28e0-45e3-a454-682361fcb01e admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:25.417936 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b32a4-28e0-45e3-a454-682361fcb01e admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:25.418223 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b32a4-28e0-45e3-a454-682361fcb01e admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:25.418948 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b32a4-28e0-45e3-a454-682361fcb01e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:25.421271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b32a4-28e0-45e3-a454-682361fcb01e admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:25.450652 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1071/2172] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:07:25 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:25.455364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcc67c-4ba0-41b0-b86b-c03b9bbbe128 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:25.466118 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcc67c-4ba0-41b0-b86b-c03b9bbbe128 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:25.527832 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fbcc9-0fc7-4c75-9e17-1dda463c9a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:25.528399 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fbcc9-0fc7-4c75-9e17-1dda463c9a35 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:25.528713 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fbcc9-0fc7-4c75-9e17-1dda463c9a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:25.528971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fbcc9-0fc7-4c75-9e17-1dda463c9a35 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:25.529690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2fbcc9-0fc7-4c75-9e17-1dda463c9a35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:25.531788 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2fbcc9-0fc7-4c75-9e17-1dda463c9a35 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:25.557911 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1102/2173] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:07:25 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:07:25.562515 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b32a4-28e0-45e3-a454-682361fcb01e admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:25.575697 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b32a4-28e0-45e3-a454-682361fcb01e admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:25.581427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6541d1-8807-4d28-a623-0b64e8a03989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:25.582052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6541d1-8807-4d28-a623-0b64e8a03989 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:25.582333 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6541d1-8807-4d28-a623-0b64e8a03989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:25.582608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6541d1-8807-4d28-a623-0b64e8a03989 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:25.583410 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6541d1-8807-4d28-a623-0b64e8a03989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:25.585610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6541d1-8807-4d28-a623-0b64e8a03989 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:25.597580 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1072/2174] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:25.603394 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fbcc9-0fc7-4c75-9e17-1dda463c9a35 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:25.622099 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fbcc9-0fc7-4c75-9e17-1dda463c9a35 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:25.632230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746aee0-88c3-40eb-afc7-575f5c343822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:25.633595 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746aee0-88c3-40eb-afc7-575f5c343822 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:25.634198 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746aee0-88c3-40eb-afc7-575f5c343822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:25.634675 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746aee0-88c3-40eb-afc7-575f5c343822 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:25.636115 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746aee0-88c3-40eb-afc7-575f5c343822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:25.639828 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746aee0-88c3-40eb-afc7-575f5c343822 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:25.664626 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1103/2175] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:25.667163 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6541d1-8807-4d28-a623-0b64e8a03989 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:25.678413 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6541d1-8807-4d28-a623-0b64e8a03989 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:25.683729 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3049a-5868-4ec9-b9b0-7304eb69137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:25.684758 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3049a-5868-4ec9-b9b0-7304eb69137f admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:25.685127 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3049a-5868-4ec9-b9b0-7304eb69137f admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:25.685476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3049a-5868-4ec9-b9b0-7304eb69137f admin admin] PATH_INFO: `/v3/projects/4f546f86872e4eaaa7476382ef48580f/users/408ad3b5b03a4bd2b1fef960969f2d88/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:25.704260 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3049a-5868-4ec9-b9b0-7304eb69137f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f546f86872e4eaaa7476382ef48580f, user_id=408ad3b5b03a4bd2b1fef960969f2d88, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:25.707949 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3049a-5868-4ec9-b9b0-7304eb69137f admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:25.730931 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1073/2176] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:25 2022] PUT /identity/v3/projects/4f546f86872e4eaaa7476382ef48580f/users/408ad3b5b03a4bd2b1fef960969f2d88/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:25.740470 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927ca90-9f86-4371-ad2c-fce734946533 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:25.740970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927ca90-9f86-4371-ad2c-fce734946533 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:25.741293 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927ca90-9f86-4371-ad2c-fce734946533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:25.791148 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-4927ca90-9f86-4371-ad2c-fce734946533 None None] MFA Rules not processed for user `408ad3b5b03a4bd2b1fef960969f2d88`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:25.793092 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-4927ca90-9f86-4371-ad2c-fce734946533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:25.897514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1104/2177] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:25.902165 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3049a-5868-4ec9-b9b0-7304eb69137f admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:25.999223 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3049a-5868-4ec9-b9b0-7304eb69137f admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:26.007263 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce8818-6fbf-47b0-8289-00183b8dbc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:26.008399 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce8818-6fbf-47b0-8289-00183b8dbc25 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:26.008904 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce8818-6fbf-47b0-8289-00183b8dbc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:26.009417 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce8818-6fbf-47b0-8289-00183b8dbc25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:26.010707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce8818-6fbf-47b0-8289-00183b8dbc25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:26.014427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce8818-6fbf-47b0-8289-00183b8dbc25 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:26.053747 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1074/2178] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:07:25 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:07:26.058109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927ca90-9f86-4371-ad2c-fce734946533 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:26.070028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927ca90-9f86-4371-ad2c-fce734946533 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:26.135734 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56456023-54e6-42af-b4bf-539883749b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:26.136599 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56456023-54e6-42af-b4bf-539883749b1a admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:26.136973 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56456023-54e6-42af-b4bf-539883749b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:26.137294 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56456023-54e6-42af-b4bf-539883749b1a admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:26.138594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56456023-54e6-42af-b4bf-539883749b1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:26.142152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56456023-54e6-42af-b4bf-539883749b1a admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:26.174735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1105/2179] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:07:26 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:07:26.176448 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce8818-6fbf-47b0-8289-00183b8dbc25 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:26.194370 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce8818-6fbf-47b0-8289-00183b8dbc25 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:26.202480 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc919382-4ea6-4edf-870e-8fcb23925c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:26.203595 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc919382-4ea6-4edf-870e-8fcb23925c89 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:26.204052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc919382-4ea6-4edf-870e-8fcb23925c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:26.204492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc919382-4ea6-4edf-870e-8fcb23925c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:26.205726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc919382-4ea6-4edf-870e-8fcb23925c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:26.208844 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc919382-4ea6-4edf-870e-8fcb23925c89 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:26.230062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1075/2180] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:07:26.231999 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56456023-54e6-42af-b4bf-539883749b1a admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:26.247913 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56456023-54e6-42af-b4bf-539883749b1a admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:26.257023 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cf0df-9919-4bf7-bf6b-b81a15453752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:26.258022 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cf0df-9919-4bf7-bf6b-b81a15453752 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:26.258352 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cf0df-9919-4bf7-bf6b-b81a15453752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:26.258699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cf0df-9919-4bf7-bf6b-b81a15453752 admin admin] PATH_INFO: `/v3/projects/ac344bdbb8e64c5482e9b3fa7ef03494/users/5d27ebbcea2547609642044118514cf0/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:26.276000 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cf0df-9919-4bf7-bf6b-b81a15453752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac344bdbb8e64c5482e9b3fa7ef03494, user_id=5d27ebbcea2547609642044118514cf0, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:26.278692 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cf0df-9919-4bf7-bf6b-b81a15453752 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:26.297670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1106/2181] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:26 2022] PUT /identity/v3/projects/ac344bdbb8e64c5482e9b3fa7ef03494/users/5d27ebbcea2547609642044118514cf0/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:26.302114 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc919382-4ea6-4edf-870e-8fcb23925c89 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:26.314326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc919382-4ea6-4edf-870e-8fcb23925c89 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:26.402948 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefc1a0-0329-4f7c-babb-f8dbf7b35ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:26.404426 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefc1a0-0329-4f7c-babb-f8dbf7b35ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:26.404856 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefc1a0-0329-4f7c-babb-f8dbf7b35ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:26.405253 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefc1a0-0329-4f7c-babb-f8dbf7b35ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:26.406147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefc1a0-0329-4f7c-babb-f8dbf7b35ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:26.408102 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefc1a0-0329-4f7c-babb-f8dbf7b35ec4 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:26.426052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1076/2182] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:07:26.433958 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cf0df-9919-4bf7-bf6b-b81a15453752 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:26.449155 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cf0df-9919-4bf7-bf6b-b81a15453752 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:26.454687 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ea08d-dc18-49a4-b569-a3f820c814b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:26.455650 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ea08d-dc18-49a4-b569-a3f820c814b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:26.455928 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ea08d-dc18-49a4-b569-a3f820c814b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:26.456200 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ea08d-dc18-49a4-b569-a3f820c814b4 admin admin] PATH_INFO: `/v3/projects/ac344bdbb8e64c5482e9b3fa7ef03494/users/5d27ebbcea2547609642044118514cf0/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:26.458320 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ea08d-dc18-49a4-b569-a3f820c814b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac344bdbb8e64c5482e9b3fa7ef03494, user_id=5d27ebbcea2547609642044118514cf0, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:26.461371 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ea08d-dc18-49a4-b569-a3f820c814b4 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:26.473513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1107/2183] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:26 2022] PUT /identity/v3/projects/ac344bdbb8e64c5482e9b3fa7ef03494/users/5d27ebbcea2547609642044118514cf0/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:26.484859 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336d15a-1254-4b9b-b972-88b83a657dba None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:26.485157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336d15a-1254-4b9b-b972-88b83a657dba None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:26.485488 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336d15a-1254-4b9b-b972-88b83a657dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:26.518244 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-a336d15a-1254-4b9b-b972-88b83a657dba None None] MFA Rules not processed for user `5d27ebbcea2547609642044118514cf0`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:26.519674 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-a336d15a-1254-4b9b-b972-88b83a657dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:26.601417 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1077/2184] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:26 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:07:26.613250 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ea08d-dc18-49a4-b569-a3f820c814b4 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:26.615200 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-398ea08d-dc18-49a4-b569-a3f820c814b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:26.690942 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ea08d-dc18-49a4-b569-a3f820c814b4 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:26.694722 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901838a-c23a-4ad3-b70d-6547fc63c3e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:26.695421 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901838a-c23a-4ad3-b70d-6547fc63c3e6 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:26.695704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901838a-c23a-4ad3-b70d-6547fc63c3e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:26.695970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901838a-c23a-4ad3-b70d-6547fc63c3e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:26.710414 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901838a-c23a-4ad3-b70d-6547fc63c3e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:26.711922 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901838a-c23a-4ad3-b70d-6547fc63c3e6 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:26.722895 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1108/2185] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:26 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:07:26.771091 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336d15a-1254-4b9b-b972-88b83a657dba None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:26.772859 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-a336d15a-1254-4b9b-b972-88b83a657dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:26.785909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336d15a-1254-4b9b-b972-88b83a657dba None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:26.789911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c05b5-5a78-4352-b72a-70bd9ce2743c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:26.790581 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c05b5-5a78-4352-b72a-70bd9ce2743c service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:26.790901 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c05b5-5a78-4352-b72a-70bd9ce2743c service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:26.791182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c05b5-5a78-4352-b72a-70bd9ce2743c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:26.855080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c05b5-5a78-4352-b72a-70bd9ce2743c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:26.856545 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c05b5-5a78-4352-b72a-70bd9ce2743c service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:26.868154 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1078/2186] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:29.454719 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb264c-872c-46d0-bdae-ca95f2540291 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:29.455577 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb264c-872c-46d0-bdae-ca95f2540291 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:29.456026 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb264c-872c-46d0-bdae-ca95f2540291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:29.475756 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-27bb264c-872c-46d0-bdae-ca95f2540291 None None] MFA Rules not processed for user `933db9887896416d8a0efe5cbd1dfb6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:29.479563 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-27bb264c-872c-46d0-bdae-ca95f2540291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:29.565155 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1109/2187] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:07:30.913260 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c05b5-5a78-4352-b72a-70bd9ce2743c service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:31.037259 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c05b5-5a78-4352-b72a-70bd9ce2743c service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:31.048227 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26abe7-c0d8-46fb-9cb4-596f76bb68da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:31.049485 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26abe7-c0d8-46fb-9cb4-596f76bb68da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:31.050688 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26abe7-c0d8-46fb-9cb4-596f76bb68da admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:31.050688 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26abe7-c0d8-46fb-9cb4-596f76bb68da admin admin] PATH_INFO: `/v3/users/408ad3b5b03a4bd2b1fef960969f2d88` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:31.051638 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26abe7-c0d8-46fb-9cb4-596f76bb68da admin admin] RBAC: Authorizing `identity:delete_user(user_id=408ad3b5b03a4bd2b1fef960969f2d88)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:31.056405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26abe7-c0d8-46fb-9cb4-596f76bb68da admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:31.180123 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-3f26abe7-c0d8-46fb-9cb4-596f76bb68da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '408ad3b5b03a4bd2b1fef960969f2d88'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:31.198985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-3f26abe7-c0d8-46fb-9cb4-596f76bb68da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '408ad3b5b03a4bd2b1fef960969f2d88'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:31.248643 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-3f26abe7-c0d8-46fb-9cb4-596f76bb68da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '408ad3b5b03a4bd2b1fef960969f2d88'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:31.250425 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-3f26abe7-c0d8-46fb-9cb4-596f76bb68da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '408ad3b5b03a4bd2b1fef960969f2d88'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:31.265890 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-3f26abe7-c0d8-46fb-9cb4-596f76bb68da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '408ad3b5b03a4bd2b1fef960969f2d88'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:31.277718 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1079/2188] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:30 2022] DELETE /identity/v3/users/408ad3b5b03a4bd2b1fef960969f2d88 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:31.281102 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3330887-0ac7-47e5-8a3c-2446161f460f None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:31.281629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3330887-0ac7-47e5-8a3c-2446161f460f None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:31.283410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3330887-0ac7-47e5-8a3c-2446161f460f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:31.330798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-a3330887-0ac7-47e5-8a3c-2446161f460f None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:31.332709 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a3330887-0ac7-47e5-8a3c-2446161f460f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:31.459953 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1110/2189] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:31.477577 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26abe7-c0d8-46fb-9cb4-596f76bb68da admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:31.479362 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-3f26abe7-c0d8-46fb-9cb4-596f76bb68da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:31.648227 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26abe7-c0d8-46fb-9cb4-596f76bb68da admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:31.655479 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5250e-cd1a-4c02-b402-daad9ce82434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:31.657897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5250e-cd1a-4c02-b402-daad9ce82434 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:31.658698 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5250e-cd1a-4c02-b402-daad9ce82434 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:31.659536 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5250e-cd1a-4c02-b402-daad9ce82434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:31.685005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5250e-cd1a-4c02-b402-daad9ce82434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:31.688081 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5250e-cd1a-4c02-b402-daad9ce82434 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:31.701784 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1080/2190] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:07:32.263340 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3330887-0ac7-47e5-8a3c-2446161f460f None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:32.268273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a3330887-0ac7-47e5-8a3c-2446161f460f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:32.304606 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3330887-0ac7-47e5-8a3c-2446161f460f None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:32.323844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5a157-9f3a-47b4-ae97-0534d83c32c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:32.325488 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5a157-9f3a-47b4-ae97-0534d83c32c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:32.325999 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5a157-9f3a-47b4-ae97-0534d83c32c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:32.326567 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5a157-9f3a-47b4-ae97-0534d83c32c8 admin admin] PATH_INFO: `/v3/projects/4f546f86872e4eaaa7476382ef48580f` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:32.329168 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5a157-9f3a-47b4-ae97-0534d83c32c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f546f86872e4eaaa7476382ef48580f)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:32.333218 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5a157-9f3a-47b4-ae97-0534d83c32c8 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:32.437237 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ddd5a157-9f3a-47b4-ae97-0534d83c32c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f546f86872e4eaaa7476382ef48580f', 'request_id': 'req-ddd5a157-9f3a-47b4-ae97-0534d83c32c8'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:32.451425 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ddd5a157-9f3a-47b4-ae97-0534d83c32c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f546f86872e4eaaa7476382ef48580f', 'request_id': 'req-ddd5a157-9f3a-47b4-ae97-0534d83c32c8'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:32.474568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ddd5a157-9f3a-47b4-ae97-0534d83c32c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f546f86872e4eaaa7476382ef48580f', 'request_id': 'req-ddd5a157-9f3a-47b4-ae97-0534d83c32c8'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:32.511989 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ddd5a157-9f3a-47b4-ae97-0534d83c32c8 admin admin] The token cache is being invalidate because project 4f546f86872e4eaaa7476382ef48580f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:32.512517 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ddd5a157-9f3a-47b4-ae97-0534d83c32c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:32.517371 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ddd5a157-9f3a-47b4-ae97-0534d83c32c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:32.526252 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1111/2191] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:32 2022] DELETE /identity/v3/projects/4f546f86872e4eaaa7476382ef48580f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:32.535732 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5250e-cd1a-4c02-b402-daad9ce82434 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:32.564184 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5250e-cd1a-4c02-b402-daad9ce82434 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:32.694191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab1fdb-11f2-4838-a218-6e212b383661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:32.695177 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab1fdb-11f2-4838-a218-6e212b383661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:32.695463 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab1fdb-11f2-4838-a218-6e212b383661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:32.695736 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab1fdb-11f2-4838-a218-6e212b383661 admin admin] PATH_INFO: `/v3/users/5d27ebbcea2547609642044118514cf0` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:32.698073 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab1fdb-11f2-4838-a218-6e212b383661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d27ebbcea2547609642044118514cf0)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:32.701839 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab1fdb-11f2-4838-a218-6e212b383661 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:32.724008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5a157-9f3a-47b4-ae97-0534d83c32c8 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:32.726280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ddd5a157-9f3a-47b4-ae97-0534d83c32c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:32.765320 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5a157-9f3a-47b4-ae97-0534d83c32c8 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:32.794498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a376e4-0fcd-4013-a396-2a57551c8b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:32.796479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a376e4-0fcd-4013-a396-2a57551c8b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:32.797232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a376e4-0fcd-4013-a396-2a57551c8b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:32.800945 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a376e4-0fcd-4013-a396-2a57551c8b40 admin admin] PATH_INFO: `/v3/users/ebe124793636409a90cf410a988aa3d6` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:32.812814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a376e4-0fcd-4013-a396-2a57551c8b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebe124793636409a90cf410a988aa3d6)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:32.817363 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a376e4-0fcd-4013-a396-2a57551c8b40 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:32.839796 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-7dab1fdb-11f2-4838-a218-6e212b383661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d27ebbcea2547609642044118514cf0'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:32.860287 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-7dab1fdb-11f2-4838-a218-6e212b383661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d27ebbcea2547609642044118514cf0'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:32.903369 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-7dab1fdb-11f2-4838-a218-6e212b383661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d27ebbcea2547609642044118514cf0'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:32.904190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-7dab1fdb-11f2-4838-a218-6e212b383661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d27ebbcea2547609642044118514cf0'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:32.916669 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-7dab1fdb-11f2-4838-a218-6e212b383661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d27ebbcea2547609642044118514cf0'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:32.938683 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1081/2192] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:32 2022] DELETE /identity/v3/users/5d27ebbcea2547609642044118514cf0 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:33.029816 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-24a376e4-0fcd-4013-a396-2a57551c8b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebe124793636409a90cf410a988aa3d6'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:33.053878 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-24a376e4-0fcd-4013-a396-2a57551c8b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebe124793636409a90cf410a988aa3d6'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:33.055194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-24a376e4-0fcd-4013-a396-2a57551c8b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebe124793636409a90cf410a988aa3d6'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:33.056213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-24a376e4-0fcd-4013-a396-2a57551c8b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebe124793636409a90cf410a988aa3d6'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:33.082492 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-24a376e4-0fcd-4013-a396-2a57551c8b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebe124793636409a90cf410a988aa3d6'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:33.112449 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1112/2193] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:32 2022] DELETE /identity/v3/users/ebe124793636409a90cf410a988aa3d6 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:33.116677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55bcc5-a859-4625-836b-a9c09b772620 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:33.117056 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55bcc5-a859-4625-836b-a9c09b772620 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:33.117395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55bcc5-a859-4625-836b-a9c09b772620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:33.139642 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-cd55bcc5-a859-4625-836b-a9c09b772620 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:33.141074 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-cd55bcc5-a859-4625-836b-a9c09b772620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:33.223238 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1082/2194] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:33.258424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a376e4-0fcd-4013-a396-2a57551c8b40 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:33.263388 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-24a376e4-0fcd-4013-a396-2a57551c8b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:33.475084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a376e4-0fcd-4013-a396-2a57551c8b40 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:33.523353 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690086bd-3a8b-4243-8dd9-172b6b6e5e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:33.524424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690086bd-3a8b-4243-8dd9-172b6b6e5e68 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:33.524882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690086bd-3a8b-4243-8dd9-172b6b6e5e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:33.525318 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690086bd-3a8b-4243-8dd9-172b6b6e5e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:33.550491 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55bcc5-a859-4625-836b-a9c09b772620 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:33.554991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-cd55bcc5-a859-4625-836b-a9c09b772620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:33.561465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690086bd-3a8b-4243-8dd9-172b6b6e5e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:33.566610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690086bd-3a8b-4243-8dd9-172b6b6e5e68 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:33.580310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55bcc5-a859-4625-836b-a9c09b772620 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:33.596088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03b4ea-a3eb-49c4-b6bf-b404669b08c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:33.597450 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03b4ea-a3eb-49c4-b6bf-b404669b08c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:33.598384 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03b4ea-a3eb-49c4-b6bf-b404669b08c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:33.599212 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03b4ea-a3eb-49c4-b6bf-b404669b08c2 admin admin] PATH_INFO: `/v3/projects/ac344bdbb8e64c5482e9b3fa7ef03494` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:33.602416 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03b4ea-a3eb-49c4-b6bf-b404669b08c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac344bdbb8e64c5482e9b3fa7ef03494)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:33.606264 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03b4ea-a3eb-49c4-b6bf-b404669b08c2 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:33.606972 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1113/2195] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:33.686123 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-1b03b4ea-a3eb-49c4-b6bf-b404669b08c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac344bdbb8e64c5482e9b3fa7ef03494', 'request_id': 'req-1b03b4ea-a3eb-49c4-b6bf-b404669b08c2'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:33.696190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-1b03b4ea-a3eb-49c4-b6bf-b404669b08c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac344bdbb8e64c5482e9b3fa7ef03494', 'request_id': 'req-1b03b4ea-a3eb-49c4-b6bf-b404669b08c2'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:33.703357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-1b03b4ea-a3eb-49c4-b6bf-b404669b08c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac344bdbb8e64c5482e9b3fa7ef03494', 'request_id': 'req-1b03b4ea-a3eb-49c4-b6bf-b404669b08c2'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:33.720532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-1b03b4ea-a3eb-49c4-b6bf-b404669b08c2 admin admin] The token cache is being invalidate because project ac344bdbb8e64c5482e9b3fa7ef03494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:33.721394 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-1b03b4ea-a3eb-49c4-b6bf-b404669b08c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:33.722062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-1b03b4ea-a3eb-49c4-b6bf-b404669b08c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:33.724549 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1083/2196] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:33 2022] DELETE /identity/v3/projects/ac344bdbb8e64c5482e9b3fa7ef03494 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:33.732379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd321a75-8e31-4c70-9bb4-5434c8b88836 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:33.732689 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd321a75-8e31-4c70-9bb4-5434c8b88836 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:33.733300 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd321a75-8e31-4c70-9bb4-5434c8b88836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:33.754798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-dd321a75-8e31-4c70-9bb4-5434c8b88836 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:33.755876 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-dd321a75-8e31-4c70-9bb4-5434c8b88836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:33.846870 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1114/2197] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:33.855305 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3d735-4554-4a07-9f42-84e23301cbbf None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:33.855811 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3d735-4554-4a07-9f42-84e23301cbbf None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:33.856227 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3d735-4554-4a07-9f42-84e23301cbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:33.882304 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-29a3d735-4554-4a07-9f42-84e23301cbbf None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:33.883882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-29a3d735-4554-4a07-9f42-84e23301cbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:33.898498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1084/2198] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:33.902946 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd321a75-8e31-4c70-9bb4-5434c8b88836 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:33.913602 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd321a75-8e31-4c70-9bb4-5434c8b88836 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:33.919432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df005266-4561-4ee0-a396-0e9a2d0c81a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:33.919693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df005266-4561-4ee0-a396-0e9a2d0c81a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:33.920151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df005266-4561-4ee0-a396-0e9a2d0c81a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:33.920431 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df005266-4561-4ee0-a396-0e9a2d0c81a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:33.921184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df005266-4561-4ee0-a396-0e9a2d0c81a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:07:33.921490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df005266-4561-4ee0-a396-0e9a2d0c81a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:33.923218 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df005266-4561-4ee0-a396-0e9a2d0c81a9 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:33.939525 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1115/2199] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:07:33.944942 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3d735-4554-4a07-9f42-84e23301cbbf None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:33.957688 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3d735-4554-4a07-9f42-84e23301cbbf None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:33.965475 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8d5c4-6290-42f2-b7e0-2be50e918ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:33.966182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8d5c4-6290-42f2-b7e0-2be50e918ccf admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:33.966468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8d5c4-6290-42f2-b7e0-2be50e918ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:33.966743 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8d5c4-6290-42f2-b7e0-2be50e918ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:33.967583 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8d5c4-6290-42f2-b7e0-2be50e918ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:33.970467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8d5c4-6290-42f2-b7e0-2be50e918ccf admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:34.018222 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1085/2200] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:07:33 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:34.019920 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df005266-4561-4ee0-a396-0e9a2d0c81a9 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:34.036151 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df005266-4561-4ee0-a396-0e9a2d0c81a9 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:34.051240 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8d5c4-6290-42f2-b7e0-2be50e918ccf admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:34.057077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-34e8d5c4-6290-42f2-b7e0-2be50e918ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:34.191465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15ebb7-49e6-4da3-9bcc-6224f547059e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:34.192798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15ebb7-49e6-4da3-9bcc-6224f547059e admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:34.193294 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15ebb7-49e6-4da3-9bcc-6224f547059e admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:34.193843 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15ebb7-49e6-4da3-9bcc-6224f547059e admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:34.194845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15ebb7-49e6-4da3-9bcc-6224f547059e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:34.199176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15ebb7-49e6-4da3-9bcc-6224f547059e admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:34.217191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8d5c4-6290-42f2-b7e0-2be50e918ccf admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:34.227605 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceec6f3-186f-4d44-924b-823437948b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:34.229354 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec6f3-186f-4d44-924b-823437948b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:34.229844 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec6f3-186f-4d44-924b-823437948b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:34.230321 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec6f3-186f-4d44-924b-823437948b95 admin admin] PATH_INFO: `/v3/projects/c38ebdf52b664a5a89242fd1d5d40b71` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:34.232794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceec6f3-186f-4d44-924b-823437948b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c38ebdf52b664a5a89242fd1d5d40b71)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:34.235625 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1116/2201] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:07:34 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:34.240104 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceec6f3-186f-4d44-924b-823437948b95 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:34.242406 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15ebb7-49e6-4da3-9bcc-6224f547059e admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:34.257884 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15ebb7-49e6-4da3-9bcc-6224f547059e admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:34.281856 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16abcc-d82d-4071-a2fc-591986a700d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:34.283181 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16abcc-d82d-4071-a2fc-591986a700d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:34.283708 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16abcc-d82d-4071-a2fc-591986a700d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:34.284389 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16abcc-d82d-4071-a2fc-591986a700d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:34.286069 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16abcc-d82d-4071-a2fc-591986a700d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:34.288604 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16abcc-d82d-4071-a2fc-591986a700d4 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:34.300817 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1117/2202] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:34.307810 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16abcc-d82d-4071-a2fc-591986a700d4 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:34.325265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16abcc-d82d-4071-a2fc-591986a700d4 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:34.361304 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2ceec6f3-186f-4d44-924b-823437948b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c38ebdf52b664a5a89242fd1d5d40b71', 'request_id': 'req-2ceec6f3-186f-4d44-924b-823437948b95'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:34.379376 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2ceec6f3-186f-4d44-924b-823437948b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c38ebdf52b664a5a89242fd1d5d40b71', 'request_id': 'req-2ceec6f3-186f-4d44-924b-823437948b95'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:34.398786 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2ceec6f3-186f-4d44-924b-823437948b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c38ebdf52b664a5a89242fd1d5d40b71', 'request_id': 'req-2ceec6f3-186f-4d44-924b-823437948b95'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:34.407513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c4ad1-5d5c-4d33-9d28-6ee98e64b819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:34.408583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c4ad1-5d5c-4d33-9d28-6ee98e64b819 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:34.409306 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c4ad1-5d5c-4d33-9d28-6ee98e64b819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:34.409888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c4ad1-5d5c-4d33-9d28-6ee98e64b819 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:34.410774 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c4ad1-5d5c-4d33-9d28-6ee98e64b819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:34.413298 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c4ad1-5d5c-4d33-9d28-6ee98e64b819 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:34.429081 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1118/2203] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:07:34.434074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c4ad1-5d5c-4d33-9d28-6ee98e64b819 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:34.434992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2ceec6f3-186f-4d44-924b-823437948b95 admin admin] The token cache is being invalidate because project c38ebdf52b664a5a89242fd1d5d40b71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:34.435789 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2ceec6f3-186f-4d44-924b-823437948b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:34.437408 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2ceec6f3-186f-4d44-924b-823437948b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:34.440803 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1086/2204] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:34 2022] DELETE /identity/v3/projects/c38ebdf52b664a5a89242fd1d5d40b71 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:34.446307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c4ad1-5d5c-4d33-9d28-6ee98e64b819 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:34.449539 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e8c11-d1ed-44bf-8dbe-6b1e729b5fd2 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:34.450017 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e8c11-d1ed-44bf-8dbe-6b1e729b5fd2 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:34.450737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e8c11-d1ed-44bf-8dbe-6b1e729b5fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:34.454978 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0768ee0-983f-4c14-ac9d-ab6a719d4099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:34.457085 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0768ee0-983f-4c14-ac9d-ab6a719d4099 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:34.457690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0768ee0-983f-4c14-ac9d-ab6a719d4099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:34.458643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0768ee0-983f-4c14-ac9d-ab6a719d4099 admin admin] PATH_INFO: `/v3/projects/d434524298e14ba2b3d1f8e5db156014/users/bb40d04cebdb4889baf08c67cb6dd290/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:34.484552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-9a8e8c11-d1ed-44bf-8dbe-6b1e729b5fd2 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:34.486008 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-9a8e8c11-d1ed-44bf-8dbe-6b1e729b5fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:34.497455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0768ee0-983f-4c14-ac9d-ab6a719d4099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d434524298e14ba2b3d1f8e5db156014, user_id=bb40d04cebdb4889baf08c67cb6dd290, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:34.500569 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0768ee0-983f-4c14-ac9d-ab6a719d4099 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:34.513655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1087/2205] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:34.517627 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3c77a-e789-47a4-8d0d-5a10d59fa19d None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:34.518132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3c77a-e789-47a4-8d0d-5a10d59fa19d None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:34.518573 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3c77a-e789-47a4-8d0d-5a10d59fa19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:34.530635 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1119/2206] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:34 2022] PUT /identity/v3/projects/d434524298e14ba2b3d1f8e5db156014/users/bb40d04cebdb4889baf08c67cb6dd290/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:34.544856 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4717de-0369-45b4-a011-b0f623b21034 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:34.545277 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4717de-0369-45b4-a011-b0f623b21034 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:34.546287 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4717de-0369-45b4-a011-b0f623b21034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:34.575339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-a8d3c77a-e789-47a4-8d0d-5a10d59fa19d None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:34.576623 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-a8d3c77a-e789-47a4-8d0d-5a10d59fa19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:34.585782 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-cc4717de-0369-45b4-a011-b0f623b21034 None None] MFA Rules not processed for user `bb40d04cebdb4889baf08c67cb6dd290`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:34.587046 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-cc4717de-0369-45b4-a011-b0f623b21034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:34.694852 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1088/2207] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:34.698188 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3c77a-e789-47a4-8d0d-5a10d59fa19d None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:34.716241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3c77a-e789-47a4-8d0d-5a10d59fa19d None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:34.732167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb446f9-72fd-4b3c-9ba0-2bffa2522ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:34.732961 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb446f9-72fd-4b3c-9ba0-2bffa2522ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:34.733250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb446f9-72fd-4b3c-9ba0-2bffa2522ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:34.733527 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb446f9-72fd-4b3c-9ba0-2bffa2522ed3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:34.734276 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb446f9-72fd-4b3c-9ba0-2bffa2522ed3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:07:34.734581 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb446f9-72fd-4b3c-9ba0-2bffa2522ed3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:34.740206 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb446f9-72fd-4b3c-9ba0-2bffa2522ed3 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:34.748319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1120/2208] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:34.752508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4717de-0369-45b4-a011-b0f623b21034 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:34.756988 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-cc4717de-0369-45b4-a011-b0f623b21034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:34.763764 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1089/2209] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:07:34.768793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb446f9-72fd-4b3c-9ba0-2bffa2522ed3 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:34.781087 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb446f9-72fd-4b3c-9ba0-2bffa2522ed3 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:34.783928 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4717de-0369-45b4-a011-b0f623b21034 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:34.788408 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5c0b1-3434-474a-9747-eca51ec55b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:34.789297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5c0b1-3434-474a-9747-eca51ec55b91 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:34.789655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5c0b1-3434-474a-9747-eca51ec55b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:34.790014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5c0b1-3434-474a-9747-eca51ec55b91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:34.791463 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5c0b1-3434-474a-9747-eca51ec55b91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:34.793593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5c0b1-3434-474a-9747-eca51ec55b91 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:34.797039 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ef861-0d52-499a-bafb-e5d60483e69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:34.797931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ef861-0d52-499a-bafb-e5d60483e69c admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:34.798458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ef861-0d52-499a-bafb-e5d60483e69c admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:34.800012 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ef861-0d52-499a-bafb-e5d60483e69c admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:34.800273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ef861-0d52-499a-bafb-e5d60483e69c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:34.804216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ef861-0d52-499a-bafb-e5d60483e69c admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:34.842946 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1090/2210] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:07:34 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:34.846982 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1121/2211] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:07:34 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:07:34.848611 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5c0b1-3434-474a-9747-eca51ec55b91 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:34.848868 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ef861-0d52-499a-bafb-e5d60483e69c admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:34.989175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5c0b1-3434-474a-9747-eca51ec55b91 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:34.995418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9dd77-56a4-4dee-992f-a8249be82ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:34.996123 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9dd77-56a4-4dee-992f-a8249be82ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:34.996389 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9dd77-56a4-4dee-992f-a8249be82ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:34.996660 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9dd77-56a4-4dee-992f-a8249be82ea0 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:34.997353 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9dd77-56a4-4dee-992f-a8249be82ea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:34.999565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9dd77-56a4-4dee-992f-a8249be82ea0 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:35.003497 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ef861-0d52-499a-bafb-e5d60483e69c admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:35.019739 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d1929-73b1-460e-92d2-602c6013638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:35.020630 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d1929-73b1-460e-92d2-602c6013638a admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:35.020909 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d1929-73b1-460e-92d2-602c6013638a admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:35.022767 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d1929-73b1-460e-92d2-602c6013638a admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:35.026863 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d1929-73b1-460e-92d2-602c6013638a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:35.030288 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d1929-73b1-460e-92d2-602c6013638a admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:35.034104 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1091/2212] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:07:34 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:35.040614 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9dd77-56a4-4dee-992f-a8249be82ea0 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:35.082386 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9dd77-56a4-4dee-992f-a8249be82ea0 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:35.097091 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e346cc9-7517-4094-ae63-ab50e92ac322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:35.098410 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e346cc9-7517-4094-ae63-ab50e92ac322 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:35.100521 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1122/2213] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:07:34 2022] POST /identity/v3/users => generated 296 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:07:35.100640 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e346cc9-7517-4094-ae63-ab50e92ac322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:35.100640 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e346cc9-7517-4094-ae63-ab50e92ac322 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:35.103271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e346cc9-7517-4094-ae63-ab50e92ac322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:35.105137 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d1929-73b1-460e-92d2-602c6013638a admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:35.107621 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e346cc9-7517-4094-ae63-ab50e92ac322 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:35.141285 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d1929-73b1-460e-92d2-602c6013638a admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:35.160370 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1092/2214] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:35.161753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e346cc9-7517-4094-ae63-ab50e92ac322 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:35.163953 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de07e68-d6b5-4b48-94c8-ae70e8d63af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:35.165195 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de07e68-d6b5-4b48-94c8-ae70e8d63af7 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:35.165707 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de07e68-d6b5-4b48-94c8-ae70e8d63af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:35.166210 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de07e68-d6b5-4b48-94c8-ae70e8d63af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:35.167787 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de07e68-d6b5-4b48-94c8-ae70e8d63af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:35.178444 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e346cc9-7517-4094-ae63-ab50e92ac322 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:35.184969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f13fa9-446a-4c6d-9cb7-54896fa0e727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:35.186514 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f13fa9-446a-4c6d-9cb7-54896fa0e727 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:35.187274 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f13fa9-446a-4c6d-9cb7-54896fa0e727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:35.187817 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f13fa9-446a-4c6d-9cb7-54896fa0e727 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:35.188800 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f13fa9-446a-4c6d-9cb7-54896fa0e727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:35.188911 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de07e68-d6b5-4b48-94c8-ae70e8d63af7 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:35.190793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f13fa9-446a-4c6d-9cb7-54896fa0e727 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:35.206270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1093/2215] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:35.212263 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f13fa9-446a-4c6d-9cb7-54896fa0e727 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:35.226714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f13fa9-446a-4c6d-9cb7-54896fa0e727 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:35.232890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1123/2216] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:35.237168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462323db-88ef-41cd-8616-6e0ccdeaac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:35.237760 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de07e68-d6b5-4b48-94c8-ae70e8d63af7 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:35.238986 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462323db-88ef-41cd-8616-6e0ccdeaac4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:35.239562 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462323db-88ef-41cd-8616-6e0ccdeaac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:35.240124 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462323db-88ef-41cd-8616-6e0ccdeaac4c admin admin] PATH_INFO: `/v3/projects/20c5a8df111543f2a9c5c43fd834e2b5/users/a4ceef7d4f68465286dd304059d32706/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:35.265439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de07e68-d6b5-4b48-94c8-ae70e8d63af7 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:35.268692 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462323db-88ef-41cd-8616-6e0ccdeaac4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c5a8df111543f2a9c5c43fd834e2b5, user_id=a4ceef7d4f68465286dd304059d32706, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:35.273209 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462323db-88ef-41cd-8616-6e0ccdeaac4c admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:35.283103 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea2761-bb74-47dc-8936-8687a29b2f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:35.284615 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea2761-bb74-47dc-8936-8687a29b2f79 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:35.285077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea2761-bb74-47dc-8936-8687a29b2f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:35.285710 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea2761-bb74-47dc-8936-8687a29b2f79 admin admin] PATH_INFO: `/v3/projects/14a06e92d0774a04b6096b5791c766e2/users/add9f3326ec74cd8b110b4f6d1e19e42/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:35.299108 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1094/2217] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:35 2022] PUT /identity/v3/projects/20c5a8df111543f2a9c5c43fd834e2b5/users/a4ceef7d4f68465286dd304059d32706/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:35.314452 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae128334-4ae0-4648-8d7a-7af394c7a292 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:35.314767 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae128334-4ae0-4648-8d7a-7af394c7a292 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:35.315111 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae128334-4ae0-4648-8d7a-7af394c7a292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:35.323543 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea2761-bb74-47dc-8936-8687a29b2f79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a06e92d0774a04b6096b5791c766e2, user_id=add9f3326ec74cd8b110b4f6d1e19e42, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:35.327974 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea2761-bb74-47dc-8936-8687a29b2f79 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:35.372521 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1124/2218] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:35 2022] PUT /identity/v3/projects/14a06e92d0774a04b6096b5791c766e2/users/add9f3326ec74cd8b110b4f6d1e19e42/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:35.373900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea2761-bb74-47dc-8936-8687a29b2f79 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:35.376914 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-ae128334-4ae0-4648-8d7a-7af394c7a292 None None] MFA Rules not processed for user `a4ceef7d4f68465286dd304059d32706`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:35.378613 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ae128334-4ae0-4648-8d7a-7af394c7a292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:35.473012 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1095/2219] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:07:35.479817 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae128334-4ae0-4648-8d7a-7af394c7a292 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:35.492690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea2761-bb74-47dc-8936-8687a29b2f79 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:35.499770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3fe5a-9b4d-4473-b148-ccd7b61a705a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:35.499770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3fe5a-9b4d-4473-b148-ccd7b61a705a admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:35.499770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3fe5a-9b4d-4473-b148-ccd7b61a705a admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:35.499770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3fe5a-9b4d-4473-b148-ccd7b61a705a admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:35.501561 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3fe5a-9b4d-4473-b148-ccd7b61a705a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:35.502863 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3fe5a-9b4d-4473-b148-ccd7b61a705a admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:35.518629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1125/2220] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:07:35.519968 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3fe5a-9b4d-4473-b148-ccd7b61a705a admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:35.533229 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3fe5a-9b4d-4473-b148-ccd7b61a705a admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:35.540336 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36a592-9236-45b8-bf25-2dfb508dd008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:35.541314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36a592-9236-45b8-bf25-2dfb508dd008 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:35.541660 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36a592-9236-45b8-bf25-2dfb508dd008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:35.543072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36a592-9236-45b8-bf25-2dfb508dd008 admin admin] PATH_INFO: `/v3/projects/14a06e92d0774a04b6096b5791c766e2/users/add9f3326ec74cd8b110b4f6d1e19e42/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:35.548004 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36a592-9236-45b8-bf25-2dfb508dd008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a06e92d0774a04b6096b5791c766e2, user_id=add9f3326ec74cd8b110b4f6d1e19e42, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:35.552250 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36a592-9236-45b8-bf25-2dfb508dd008 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:35.576733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1126/2221] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:35 2022] PUT /identity/v3/projects/14a06e92d0774a04b6096b5791c766e2/users/add9f3326ec74cd8b110b4f6d1e19e42/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:35.581533 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1d8f4-292b-432a-8095-8681d3183459 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:35.581948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1d8f4-292b-432a-8095-8681d3183459 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:35.583079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1d8f4-292b-432a-8095-8681d3183459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:35.616869 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae128334-4ae0-4648-8d7a-7af394c7a292 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:35.624563 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-fbd1d8f4-292b-432a-8095-8681d3183459 None None] MFA Rules not processed for user `add9f3326ec74cd8b110b4f6d1e19e42`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:35.626103 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-fbd1d8f4-292b-432a-8095-8681d3183459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:35.694273 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8ff18-a949-4fec-acd6-7fd37d5a0ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:35.695473 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8ff18-a949-4fec-acd6-7fd37d5a0ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:35.695833 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8ff18-a949-4fec-acd6-7fd37d5a0ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:35.696201 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8ff18-a949-4fec-acd6-7fd37d5a0ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:35.697074 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8ff18-a949-4fec-acd6-7fd37d5a0ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:35.699189 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8ff18-a949-4fec-acd6-7fd37d5a0ca6 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:35.739272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1096/2222] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:07:35 2022] POST /identity/v3/projects => generated 375 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:07:35.745888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8ff18-a949-4fec-acd6-7fd37d5a0ca6 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:35.747150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1127/2223] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:35.758484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1d8f4-292b-432a-8095-8681d3183459 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:35.782505 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-fbd1d8f4-292b-432a-8095-8681d3183459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:35.859939 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1d8f4-292b-432a-8095-8681d3183459 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:35.870327 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8ff18-a949-4fec-acd6-7fd37d5a0ca6 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:35.877421 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7c075-b374-4dc9-b30f-17607ee4ba09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:35.878119 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7c075-b374-4dc9-b30f-17607ee4ba09 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:35.878708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7c075-b374-4dc9-b30f-17607ee4ba09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:35.879194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7c075-b374-4dc9-b30f-17607ee4ba09 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:35.879913 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7c075-b374-4dc9-b30f-17607ee4ba09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:35.883093 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7c075-b374-4dc9-b30f-17607ee4ba09 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:35.937589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1097/2224] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:07:35 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:35.941396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7c075-b374-4dc9-b30f-17607ee4ba09 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:35.955532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e779caa-bd00-413d-ae12-89cb8f2018d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:35.956202 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e779caa-bd00-413d-ae12-89cb8f2018d1 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:35.956481 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e779caa-bd00-413d-ae12-89cb8f2018d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:35.956778 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7c075-b374-4dc9-b30f-17607ee4ba09 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:35.956968 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e779caa-bd00-413d-ae12-89cb8f2018d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:35.964150 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5bfa5-bda5-4771-b967-a7d5f5d1673b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:35.965004 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5bfa5-bda5-4771-b967-a7d5f5d1673b admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:35.966364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5bfa5-bda5-4771-b967-a7d5f5d1673b admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:35.966364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5bfa5-bda5-4771-b967-a7d5f5d1673b admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:35.967287 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5bfa5-bda5-4771-b967-a7d5f5d1673b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:35.969514 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5bfa5-bda5-4771-b967-a7d5f5d1673b admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:35.984882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1098/2225] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:07:35.988995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5bfa5-bda5-4771-b967-a7d5f5d1673b admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:36.012927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5bfa5-bda5-4771-b967-a7d5f5d1673b admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:36.025547 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb819bc4-a208-4fa2-a652-b0d51b02405b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:36.026737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb819bc4-a208-4fa2-a652-b0d51b02405b admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:36.027452 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb819bc4-a208-4fa2-a652-b0d51b02405b admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:36.027946 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb819bc4-a208-4fa2-a652-b0d51b02405b admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:36.028911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb819bc4-a208-4fa2-a652-b0d51b02405b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:36.032464 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb819bc4-a208-4fa2-a652-b0d51b02405b admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:36.049378 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e779caa-bd00-413d-ae12-89cb8f2018d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:36.051060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e779caa-bd00-413d-ae12-89cb8f2018d1 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:36.051472 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1099/2226] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:07:36.056022 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb819bc4-a208-4fa2-a652-b0d51b02405b admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:36.063551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1128/2227] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:36.073719 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb819bc4-a208-4fa2-a652-b0d51b02405b admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:36.078869 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78827a4-c16b-4c1b-9ff0-66eb2f2c467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:36.079830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78827a4-c16b-4c1b-9ff0-66eb2f2c467a admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:36.080112 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78827a4-c16b-4c1b-9ff0-66eb2f2c467a admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:36.080588 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78827a4-c16b-4c1b-9ff0-66eb2f2c467a admin admin] PATH_INFO: `/v3/projects/de32bd779a5243229eeee40dcb11842c/users/6606d986d0ce471a8aa666f7dacbe20e/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:36.098050 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78827a4-c16b-4c1b-9ff0-66eb2f2c467a admin admin] RBAC: Authorizing `identity:create_grant(project_id=de32bd779a5243229eeee40dcb11842c, user_id=6606d986d0ce471a8aa666f7dacbe20e, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:36.101005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78827a4-c16b-4c1b-9ff0-66eb2f2c467a admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:36.123937 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1100/2228] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:36 2022] PUT /identity/v3/projects/de32bd779a5243229eeee40dcb11842c/users/6606d986d0ce471a8aa666f7dacbe20e/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:36.155111 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11de06d-907e-4586-839c-f7f1c826c7da None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:36.155674 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11de06d-907e-4586-839c-f7f1c826c7da None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:36.156162 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11de06d-907e-4586-839c-f7f1c826c7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:36.219571 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-e11de06d-907e-4586-839c-f7f1c826c7da None None] MFA Rules not processed for user `6606d986d0ce471a8aa666f7dacbe20e`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:36.221561 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e11de06d-907e-4586-839c-f7f1c826c7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:36.324276 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1129/2229] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:36.331454 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78827a4-c16b-4c1b-9ff0-66eb2f2c467a admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:36.539893 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78827a4-c16b-4c1b-9ff0-66eb2f2c467a admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:36.545639 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b2d52-e1cd-401a-a102-55ec011ed254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:36.546516 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b2d52-e1cd-401a-a102-55ec011ed254 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:36.546900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b2d52-e1cd-401a-a102-55ec011ed254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:36.547188 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b2d52-e1cd-401a-a102-55ec011ed254 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:36.548016 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b2d52-e1cd-401a-a102-55ec011ed254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:36.550421 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b2d52-e1cd-401a-a102-55ec011ed254 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:36.615692 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1101/2230] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:07:36 2022] POST /identity/v3/projects => generated 377 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:07:36.619825 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11de06d-907e-4586-839c-f7f1c826c7da None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:36.641257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11de06d-907e-4586-839c-f7f1c826c7da None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:36.793677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b2d52-e1cd-401a-a102-55ec011ed254 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:36.812977 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082f960-da47-4190-a09e-d15b00f393a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:36.813227 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082f960-da47-4190-a09e-d15b00f393a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:36.813727 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082f960-da47-4190-a09e-d15b00f393a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:36.814220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082f960-da47-4190-a09e-d15b00f393a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:36.815983 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082f960-da47-4190-a09e-d15b00f393a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:36.829780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082f960-da47-4190-a09e-d15b00f393a0 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:36.864209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1130/2231] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:07:36 2022] POST /identity/v3/users => generated 295 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:36.868647 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082f960-da47-4190-a09e-d15b00f393a0 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:36.899004 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082f960-da47-4190-a09e-d15b00f393a0 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:36.910735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655ad73-61c6-4f49-8128-bb97e5d56e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:36.913987 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655ad73-61c6-4f49-8128-bb97e5d56e71 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:36.914285 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655ad73-61c6-4f49-8128-bb97e5d56e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:36.914622 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655ad73-61c6-4f49-8128-bb97e5d56e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:36.916673 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655ad73-61c6-4f49-8128-bb97e5d56e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:36.920590 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655ad73-61c6-4f49-8128-bb97e5d56e71 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:36.952445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1131/2232] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:36.954526 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655ad73-61c6-4f49-8128-bb97e5d56e71 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:36.985416 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655ad73-61c6-4f49-8128-bb97e5d56e71 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:36.991899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20658a2a-efac-4f9d-81f3-34a71ff107c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:36.993064 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20658a2a-efac-4f9d-81f3-34a71ff107c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:36.993291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20658a2a-efac-4f9d-81f3-34a71ff107c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:36.993812 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20658a2a-efac-4f9d-81f3-34a71ff107c0 admin admin] PATH_INFO: `/v3/projects/b5c44fcd179a4a45971a910d2c44cd54/users/8726d4737265442a88c8d85e6bb96dfa/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:37.045022 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20658a2a-efac-4f9d-81f3-34a71ff107c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5c44fcd179a4a45971a910d2c44cd54, user_id=8726d4737265442a88c8d85e6bb96dfa, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:37.054260 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20658a2a-efac-4f9d-81f3-34a71ff107c0 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:37.112385 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1132/2233] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:36 2022] PUT /identity/v3/projects/b5c44fcd179a4a45971a910d2c44cd54/users/8726d4737265442a88c8d85e6bb96dfa/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:37.120880 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b2d52-e1cd-401a-a102-55ec011ed254 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:37.122260 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20658a2a-efac-4f9d-81f3-34a71ff107c0 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:37.254710 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0130b1-5042-457d-9d18-3ed059274759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:37.255640 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0130b1-5042-457d-9d18-3ed059274759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:37.255926 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0130b1-5042-457d-9d18-3ed059274759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:37.256496 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0130b1-5042-457d-9d18-3ed059274759 admin admin] PATH_INFO: `/v3/users/bb40d04cebdb4889baf08c67cb6dd290` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:37.259051 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0130b1-5042-457d-9d18-3ed059274759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb40d04cebdb4889baf08c67cb6dd290)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:37.264880 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0130b1-5042-457d-9d18-3ed059274759 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:37.295391 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20658a2a-efac-4f9d-81f3-34a71ff107c0 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:37.313584 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5789f9-4a33-4c97-9eab-d35a4410d357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:37.314490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5789f9-4a33-4c97-9eab-d35a4410d357 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:37.314778 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5789f9-4a33-4c97-9eab-d35a4410d357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:37.315088 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5789f9-4a33-4c97-9eab-d35a4410d357 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:37.315854 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5789f9-4a33-4c97-9eab-d35a4410d357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:37.318152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5789f9-4a33-4c97-9eab-d35a4410d357 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:37.352098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1133/2234] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:37.358232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5789f9-4a33-4c97-9eab-d35a4410d357 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:37.370557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5789f9-4a33-4c97-9eab-d35a4410d357 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:37.376559 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395ac61-7d52-4466-bb3e-620cc8f6d186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:37.377694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395ac61-7d52-4466-bb3e-620cc8f6d186 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:37.377983 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395ac61-7d52-4466-bb3e-620cc8f6d186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:37.378253 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395ac61-7d52-4466-bb3e-620cc8f6d186 admin admin] PATH_INFO: `/v3/projects/b5c44fcd179a4a45971a910d2c44cd54/users/8726d4737265442a88c8d85e6bb96dfa/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:37.380511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395ac61-7d52-4466-bb3e-620cc8f6d186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5c44fcd179a4a45971a910d2c44cd54, user_id=8726d4737265442a88c8d85e6bb96dfa, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:37.383580 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395ac61-7d52-4466-bb3e-620cc8f6d186 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:37.386724 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-5f0130b1-5042-457d-9d18-3ed059274759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb40d04cebdb4889baf08c67cb6dd290'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:37.403579 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-5f0130b1-5042-457d-9d18-3ed059274759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb40d04cebdb4889baf08c67cb6dd290'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:37.410508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1134/2235] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:37 2022] PUT /identity/v3/projects/b5c44fcd179a4a45971a910d2c44cd54/users/8726d4737265442a88c8d85e6bb96dfa/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:37.428019 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6b1e7-e2ae-4354-8817-743420cc9ca9 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:37.428467 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6b1e7-e2ae-4354-8817-743420cc9ca9 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:37.428857 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6b1e7-e2ae-4354-8817-743420cc9ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:37.435986 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-5f0130b1-5042-457d-9d18-3ed059274759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb40d04cebdb4889baf08c67cb6dd290'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:37.437107 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-5f0130b1-5042-457d-9d18-3ed059274759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb40d04cebdb4889baf08c67cb6dd290'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:37.452722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-5f0130b1-5042-457d-9d18-3ed059274759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb40d04cebdb4889baf08c67cb6dd290'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:37.468367 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1102/2236] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:36 2022] DELETE /identity/v3/users/bb40d04cebdb4889baf08c67cb6dd290 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:37.481676 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40fbb9-856d-4140-87e1-072eed0c0249 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:37.482731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40fbb9-856d-4140-87e1-072eed0c0249 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:37.483757 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40fbb9-856d-4140-87e1-072eed0c0249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:37.505729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-15b6b1e7-e2ae-4354-8817-743420cc9ca9 None None] MFA Rules not processed for user `8726d4737265442a88c8d85e6bb96dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:37.507240 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-15b6b1e7-e2ae-4354-8817-743420cc9ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:37.531244 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-ab40fbb9-856d-4140-87e1-072eed0c0249 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:37.533408 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ab40fbb9-856d-4140-87e1-072eed0c0249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:37.628660 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1103/2237] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:37.636113 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1135/2238] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:07:37.642533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40fbb9-856d-4140-87e1-072eed0c0249 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:37.644173 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6b1e7-e2ae-4354-8817-743420cc9ca9 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:37.644744 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ab40fbb9-856d-4140-87e1-072eed0c0249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:37.646533 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-15b6b1e7-e2ae-4354-8817-743420cc9ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:37.727302 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6b1e7-e2ae-4354-8817-743420cc9ca9 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:37.732467 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edef00-8314-4147-a625-00dde1d84a05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:37.733146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edef00-8314-4147-a625-00dde1d84a05 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:37.733426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edef00-8314-4147-a625-00dde1d84a05 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:37.733707 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edef00-8314-4147-a625-00dde1d84a05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:37.736276 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-73edef00-8314-4147-a625-00dde1d84a05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:37.749166 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40fbb9-856d-4140-87e1-072eed0c0249 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:37.754500 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfc9a7-05bc-4001-8d44-00a145c8f50b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:37.755269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfc9a7-05bc-4001-8d44-00a145c8f50b service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:37.755617 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfc9a7-05bc-4001-8d44-00a145c8f50b service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:37.756635 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfc9a7-05bc-4001-8d44-00a145c8f50b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:37.771162 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfc9a7-05bc-4001-8d44-00a145c8f50b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:37.774655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfc9a7-05bc-4001-8d44-00a145c8f50b service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:37.792823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1104/2239] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:37.873376 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edef00-8314-4147-a625-00dde1d84a05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:37.877078 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edef00-8314-4147-a625-00dde1d84a05 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:37.901180 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1136/2240] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:38.705046 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfc9a7-05bc-4001-8d44-00a145c8f50b service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:38.706613 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-d5bfc9a7-05bc-4001-8d44-00a145c8f50b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:38.723664 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfc9a7-05bc-4001-8d44-00a145c8f50b service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:38.730208 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7e10e-a861-4ef8-a4c9-2647323e7f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:38.731515 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7e10e-a861-4ef8-a4c9-2647323e7f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:38.731944 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7e10e-a861-4ef8-a4c9-2647323e7f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:38.732399 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7e10e-a861-4ef8-a4c9-2647323e7f1f admin admin] PATH_INFO: `/v3/projects/d434524298e14ba2b3d1f8e5db156014` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:38.733920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7e10e-a861-4ef8-a4c9-2647323e7f1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d434524298e14ba2b3d1f8e5db156014)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:38.735972 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7e10e-a861-4ef8-a4c9-2647323e7f1f admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:38.800078 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c0c7e10e-a861-4ef8-a4c9-2647323e7f1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd434524298e14ba2b3d1f8e5db156014', 'request_id': 'req-c0c7e10e-a861-4ef8-a4c9-2647323e7f1f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:38.809590 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c0c7e10e-a861-4ef8-a4c9-2647323e7f1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd434524298e14ba2b3d1f8e5db156014', 'request_id': 'req-c0c7e10e-a861-4ef8-a4c9-2647323e7f1f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:38.817934 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c0c7e10e-a861-4ef8-a4c9-2647323e7f1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd434524298e14ba2b3d1f8e5db156014', 'request_id': 'req-c0c7e10e-a861-4ef8-a4c9-2647323e7f1f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:38.845045 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c0c7e10e-a861-4ef8-a4c9-2647323e7f1f admin admin] The token cache is being invalidate because project d434524298e14ba2b3d1f8e5db156014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:38.846140 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c0c7e10e-a861-4ef8-a4c9-2647323e7f1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:38.848652 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c0c7e10e-a861-4ef8-a4c9-2647323e7f1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:38.865982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1105/2241] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:38 2022] DELETE /identity/v3/projects/d434524298e14ba2b3d1f8e5db156014 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:38.868002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edef00-8314-4147-a625-00dde1d84a05 service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:38.895482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edef00-8314-4147-a625-00dde1d84a05 service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:39.014364 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5edcc-bbd7-4cf3-bd25-42d02a59a645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:39.016297 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5edcc-bbd7-4cf3-bd25-42d02a59a645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:39.017724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5edcc-bbd7-4cf3-bd25-42d02a59a645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:39.018230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5edcc-bbd7-4cf3-bd25-42d02a59a645 admin admin] PATH_INFO: `/v3/users/add9f3326ec74cd8b110b4f6d1e19e42` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:39.020934 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5edcc-bbd7-4cf3-bd25-42d02a59a645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=add9f3326ec74cd8b110b4f6d1e19e42)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:39.037042 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5edcc-bbd7-4cf3-bd25-42d02a59a645 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:39.115632 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d8b5edcc-bbd7-4cf3-bd25-42d02a59a645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'add9f3326ec74cd8b110b4f6d1e19e42'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:39.136483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d8b5edcc-bbd7-4cf3-bd25-42d02a59a645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'add9f3326ec74cd8b110b4f6d1e19e42'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:39.137455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d8b5edcc-bbd7-4cf3-bd25-42d02a59a645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'add9f3326ec74cd8b110b4f6d1e19e42'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:39.138412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d8b5edcc-bbd7-4cf3-bd25-42d02a59a645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'add9f3326ec74cd8b110b4f6d1e19e42'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:39.150967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d8b5edcc-bbd7-4cf3-bd25-42d02a59a645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'add9f3326ec74cd8b110b4f6d1e19e42'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:39.177784 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1137/2242] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:38 2022] DELETE /identity/v3/users/add9f3326ec74cd8b110b4f6d1e19e42 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:39.518137 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7e10e-a861-4ef8-a4c9-2647323e7f1f admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:39.520831 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c0c7e10e-a861-4ef8-a4c9-2647323e7f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:39.559650 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7e10e-a861-4ef8-a4c9-2647323e7f1f admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:39.588032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad805c19-1914-4e95-834d-8868f961078a None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:39.588713 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad805c19-1914-4e95-834d-8868f961078a None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:39.589043 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad805c19-1914-4e95-834d-8868f961078a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:39.625308 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-ad805c19-1914-4e95-834d-8868f961078a None None] MFA Rules not processed for user `1a01e9f4844940af9d8b112eb8d9efdc`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:39.628872 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ad805c19-1914-4e95-834d-8868f961078a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:39.676811 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1b7ca-78be-43ba-a2a4-99feea6cab91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:39.679214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1b7ca-78be-43ba-a2a4-99feea6cab91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:39.679491 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1b7ca-78be-43ba-a2a4-99feea6cab91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:39.679928 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1b7ca-78be-43ba-a2a4-99feea6cab91 admin admin] PATH_INFO: `/v3/users/36f22701b4514d32a15c66e5e4d63bf1` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:39.681583 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1b7ca-78be-43ba-a2a4-99feea6cab91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36f22701b4514d32a15c66e5e4d63bf1)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:39.684077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1b7ca-78be-43ba-a2a4-99feea6cab91 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:39.760895 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-02f1b7ca-78be-43ba-a2a4-99feea6cab91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36f22701b4514d32a15c66e5e4d63bf1'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:39.773365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-02f1b7ca-78be-43ba-a2a4-99feea6cab91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36f22701b4514d32a15c66e5e4d63bf1'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:39.792593 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1138/2243] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:07:39.814989 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-02f1b7ca-78be-43ba-a2a4-99feea6cab91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36f22701b4514d32a15c66e5e4d63bf1'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:39.817152 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-02f1b7ca-78be-43ba-a2a4-99feea6cab91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36f22701b4514d32a15c66e5e4d63bf1'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:39.838660 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-02f1b7ca-78be-43ba-a2a4-99feea6cab91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36f22701b4514d32a15c66e5e4d63bf1'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:39.851973 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1106/2244] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:39 2022] DELETE /identity/v3/users/36f22701b4514d32a15c66e5e4d63bf1 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:40.086851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad805c19-1914-4e95-834d-8868f961078a None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:40.088482 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ad805c19-1914-4e95-834d-8868f961078a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:40.197619 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad805c19-1914-4e95-834d-8868f961078a None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:40.251171 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1b7ca-78be-43ba-a2a4-99feea6cab91 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:40.252853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-02f1b7ca-78be-43ba-a2a4-99feea6cab91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:40.371407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d005ad-d663-4742-9aee-bb604ce93ba5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:40.372676 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d005ad-d663-4742-9aee-bb604ce93ba5 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:40.373087 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d005ad-d663-4742-9aee-bb604ce93ba5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:40.373511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d005ad-d663-4742-9aee-bb604ce93ba5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:40.376135 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-63d005ad-d663-4742-9aee-bb604ce93ba5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:40.402674 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1b7ca-78be-43ba-a2a4-99feea6cab91 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:40.413622 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc4fe0-6696-4319-ba8b-12a571b3ea0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:40.414682 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc4fe0-6696-4319-ba8b-12a571b3ea0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:40.415129 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc4fe0-6696-4319-ba8b-12a571b3ea0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:40.415520 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc4fe0-6696-4319-ba8b-12a571b3ea0b admin admin] PATH_INFO: `/v3/projects/14a06e92d0774a04b6096b5791c766e2` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:40.417609 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc4fe0-6696-4319-ba8b-12a571b3ea0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=14a06e92d0774a04b6096b5791c766e2)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:40.419890 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc4fe0-6696-4319-ba8b-12a571b3ea0b admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:40.496658 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-bfcc4fe0-6696-4319-ba8b-12a571b3ea0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14a06e92d0774a04b6096b5791c766e2', 'request_id': 'req-bfcc4fe0-6696-4319-ba8b-12a571b3ea0b'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:40.503281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-bfcc4fe0-6696-4319-ba8b-12a571b3ea0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14a06e92d0774a04b6096b5791c766e2', 'request_id': 'req-bfcc4fe0-6696-4319-ba8b-12a571b3ea0b'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:40.511371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-bfcc4fe0-6696-4319-ba8b-12a571b3ea0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14a06e92d0774a04b6096b5791c766e2', 'request_id': 'req-bfcc4fe0-6696-4319-ba8b-12a571b3ea0b'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:40.530552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d005ad-d663-4742-9aee-bb604ce93ba5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:40.531517 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-bfcc4fe0-6696-4319-ba8b-12a571b3ea0b admin admin] The token cache is being invalidate because project 14a06e92d0774a04b6096b5791c766e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:40.531854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-bfcc4fe0-6696-4319-ba8b-12a571b3ea0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:40.532603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-bfcc4fe0-6696-4319-ba8b-12a571b3ea0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:40.533245 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d005ad-d663-4742-9aee-bb604ce93ba5 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:40.534699 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1107/2245] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:40 2022] DELETE /identity/v3/projects/14a06e92d0774a04b6096b5791c766e2 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:40.535906 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc4fe0-6696-4319-ba8b-12a571b3ea0b admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:40.538098 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-bfcc4fe0-6696-4319-ba8b-12a571b3ea0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:40.547699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1139/2246] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:40.565067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606b273-2721-47e9-8099-e916f3dc6378 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:40.565803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606b273-2721-47e9-8099-e916f3dc6378 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:40.566314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606b273-2721-47e9-8099-e916f3dc6378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:40.603771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-a606b273-2721-47e9-8099-e916f3dc6378 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:40.605910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a606b273-2721-47e9-8099-e916f3dc6378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:40.614736 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc4fe0-6696-4319-ba8b-12a571b3ea0b admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:40.616853 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1140/2247] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:40.620264 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf05ee8-3803-4583-a955-e2f154761c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:40.621146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf05ee8-3803-4583-a955-e2f154761c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:40.621431 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf05ee8-3803-4583-a955-e2f154761c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:40.621860 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf05ee8-3803-4583-a955-e2f154761c0c admin admin] PATH_INFO: `/v3/projects/bff8925b6c874ee0aa397a21e93d22f4` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:40.623181 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf05ee8-3803-4583-a955-e2f154761c0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bff8925b6c874ee0aa397a21e93d22f4)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:40.625205 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf05ee8-3803-4583-a955-e2f154761c0c admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:40.629689 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9658929-0b9e-4b42-8c9d-5bafee203941 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:40.629960 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9658929-0b9e-4b42-8c9d-5bafee203941 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:40.630276 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9658929-0b9e-4b42-8c9d-5bafee203941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:40.660360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-a9658929-0b9e-4b42-8c9d-5bafee203941 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:40.662959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a9658929-0b9e-4b42-8c9d-5bafee203941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:40.692277 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1141/2248] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:07:40.694373 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9658929-0b9e-4b42-8c9d-5bafee203941 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:40.713477 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9658929-0b9e-4b42-8c9d-5bafee203941 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:40.715245 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-adf05ee8-3803-4583-a955-e2f154761c0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bff8925b6c874ee0aa397a21e93d22f4', 'request_id': 'req-adf05ee8-3803-4583-a955-e2f154761c0c'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:40.728794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-adf05ee8-3803-4583-a955-e2f154761c0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bff8925b6c874ee0aa397a21e93d22f4', 'request_id': 'req-adf05ee8-3803-4583-a955-e2f154761c0c'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:40.737486 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-adf05ee8-3803-4583-a955-e2f154761c0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bff8925b6c874ee0aa397a21e93d22f4', 'request_id': 'req-adf05ee8-3803-4583-a955-e2f154761c0c'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:40.763413 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-adf05ee8-3803-4583-a955-e2f154761c0c admin admin] The token cache is being invalidate because project bff8925b6c874ee0aa397a21e93d22f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:40.764575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-adf05ee8-3803-4583-a955-e2f154761c0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:40.766416 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-adf05ee8-3803-4583-a955-e2f154761c0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:40.768317 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1108/2249] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:40 2022] DELETE /identity/v3/projects/bff8925b6c874ee0aa397a21e93d22f4 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:40.778261 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519930e-d552-4931-89c0-0dba1fd4baab None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:40.779097 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519930e-d552-4931-89c0-0dba1fd4baab None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:40.780010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519930e-d552-4931-89c0-0dba1fd4baab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:40.818095 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-6519930e-d552-4931-89c0-0dba1fd4baab None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:40.821764 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6519930e-d552-4931-89c0-0dba1fd4baab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:40.835318 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992bb70-d361-41e0-a706-6faaad0aac1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:40.845973 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992bb70-d361-41e0-a706-6faaad0aac1f admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:40.845973 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992bb70-d361-41e0-a706-6faaad0aac1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:40.845973 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992bb70-d361-41e0-a706-6faaad0aac1f admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:40.845973 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992bb70-d361-41e0-a706-6faaad0aac1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:07:40.845973 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992bb70-d361-41e0-a706-6faaad0aac1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:40.845973 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992bb70-d361-41e0-a706-6faaad0aac1f admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:40.859998 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1142/2250] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:07:40.862018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992bb70-d361-41e0-a706-6faaad0aac1f admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:40.864736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e992bb70-d361-41e0-a706-6faaad0aac1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:40.889077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992bb70-d361-41e0-a706-6faaad0aac1f admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:40.892068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004f71a-ae83-4012-8993-9f8fa90f462e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:40.893601 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004f71a-ae83-4012-8993-9f8fa90f462e admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:40.893887 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004f71a-ae83-4012-8993-9f8fa90f462e admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:40.894260 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004f71a-ae83-4012-8993-9f8fa90f462e admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:40.897647 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004f71a-ae83-4012-8993-9f8fa90f462e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:40.900150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004f71a-ae83-4012-8993-9f8fa90f462e admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:40.947193 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1143/2251] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:07:40 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:40.952710 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004f71a-ae83-4012-8993-9f8fa90f462e admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:40.980808 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1109/2252] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:07:40.989468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c007e81-1106-4823-8a1a-3c61026bfda8 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:40.990081 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c007e81-1106-4823-8a1a-3c61026bfda8 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:40.991195 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c007e81-1106-4823-8a1a-3c61026bfda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:41.042891 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-6c007e81-1106-4823-8a1a-3c61026bfda8 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:41.044636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6c007e81-1106-4823-8a1a-3c61026bfda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:41.166306 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004f71a-ae83-4012-8993-9f8fa90f462e admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:41.200790 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f1da5-6391-4806-b99d-6bee991be095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:41.201986 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f1da5-6391-4806-b99d-6bee991be095 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:41.202471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f1da5-6391-4806-b99d-6bee991be095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:41.207811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f1da5-6391-4806-b99d-6bee991be095 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:41.209349 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f1da5-6391-4806-b99d-6bee991be095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:41.219450 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1110/2253] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:41.220326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f1da5-6391-4806-b99d-6bee991be095 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:41.225294 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c007e81-1106-4823-8a1a-3c61026bfda8 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:41.250294 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c007e81-1106-4823-8a1a-3c61026bfda8 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:41.264077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235af1ca-4efb-43c2-9e02-bd6a99091cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:41.266173 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235af1ca-4efb-43c2-9e02-bd6a99091cba admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:41.267280 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235af1ca-4efb-43c2-9e02-bd6a99091cba admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:41.268295 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235af1ca-4efb-43c2-9e02-bd6a99091cba admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:41.269942 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235af1ca-4efb-43c2-9e02-bd6a99091cba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:07:41.270442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235af1ca-4efb-43c2-9e02-bd6a99091cba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:41.276100 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235af1ca-4efb-43c2-9e02-bd6a99091cba admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:41.322994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1144/2254] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:07:40 2022] POST /identity/v3/users => generated 288 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:07:41.323182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1111/2255] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:07:41.325396 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f1da5-6391-4806-b99d-6bee991be095 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:41.328613 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235af1ca-4efb-43c2-9e02-bd6a99091cba admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:41.375877 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f1da5-6391-4806-b99d-6bee991be095 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:41.376627 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235af1ca-4efb-43c2-9e02-bd6a99091cba admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:41.395193 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870db870-683e-4118-8690-d117ed900e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:41.395508 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43ddd2-5edd-4fca-a62c-b4d23a15052f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:41.396905 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43ddd2-5edd-4fca-a62c-b4d23a15052f admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:41.398963 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870db870-683e-4118-8690-d117ed900e2f admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:41.399543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43ddd2-5edd-4fca-a62c-b4d23a15052f admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:41.400141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43ddd2-5edd-4fca-a62c-b4d23a15052f admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:41.401013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870db870-683e-4118-8690-d117ed900e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:41.401700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870db870-683e-4118-8690-d117ed900e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:41.404832 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870db870-683e-4118-8690-d117ed900e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:41.409020 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43ddd2-5edd-4fca-a62c-b4d23a15052f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:41.413724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870db870-683e-4118-8690-d117ed900e2f admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:41.417318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43ddd2-5edd-4fca-a62c-b4d23a15052f admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:41.461672 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1145/2256] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:41.466695 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870db870-683e-4118-8690-d117ed900e2f admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:41.517817 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870db870-683e-4118-8690-d117ed900e2f admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:41.533578 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1112/2257] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:07:41 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:41.534808 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43ddd2-5edd-4fca-a62c-b4d23a15052f admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:41.698910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ffcc76-0e60-4ff5-8122-851a17840267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:41.699758 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffcc76-0e60-4ff5-8122-851a17840267 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:41.700347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffcc76-0e60-4ff5-8122-851a17840267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:41.700894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffcc76-0e60-4ff5-8122-851a17840267 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:41.702111 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ffcc76-0e60-4ff5-8122-851a17840267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:41.705579 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ffcc76-0e60-4ff5-8122-851a17840267 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:41.712357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43ddd2-5edd-4fca-a62c-b4d23a15052f admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:41.723793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b0658-ea5e-462c-be57-0ff16c0911ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:41.724734 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b0658-ea5e-462c-be57-0ff16c0911ea admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:41.725236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b0658-ea5e-462c-be57-0ff16c0911ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:41.725654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b0658-ea5e-462c-be57-0ff16c0911ea admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:41.727967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b0658-ea5e-462c-be57-0ff16c0911ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:41.733035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b0658-ea5e-462c-be57-0ff16c0911ea admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:41.761775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1146/2258] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:41.769293 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ffcc76-0e60-4ff5-8122-851a17840267 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:41.797461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1113/2259] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:07:41 2022] POST /identity/v3/users => generated 292 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:41.798608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b0658-ea5e-462c-be57-0ff16c0911ea admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:41.806483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ffcc76-0e60-4ff5-8122-851a17840267 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:41.825412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b0658-ea5e-462c-be57-0ff16c0911ea admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:41.825970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2472e16-e60b-4e63-a01f-360abf8a58b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:41.827467 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2472e16-e60b-4e63-a01f-360abf8a58b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:41.827998 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2472e16-e60b-4e63-a01f-360abf8a58b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:41.828650 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2472e16-e60b-4e63-a01f-360abf8a58b3 admin admin] PATH_INFO: `/v3/projects/c1227782323e4c97b99f4bbb385ada1c/users/d1142677c500472ebe17dc205c40c0bf/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:41.855132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbd4c1-93ab-40dd-9091-ec0ab408b818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:41.855838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbd4c1-93ab-40dd-9091-ec0ab408b818 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:41.856248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbd4c1-93ab-40dd-9091-ec0ab408b818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:41.856426 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbd4c1-93ab-40dd-9091-ec0ab408b818 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:41.857119 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbd4c1-93ab-40dd-9091-ec0ab408b818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:41.859157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbd4c1-93ab-40dd-9091-ec0ab408b818 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:41.896067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2472e16-e60b-4e63-a01f-360abf8a58b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1227782323e4c97b99f4bbb385ada1c, user_id=d1142677c500472ebe17dc205c40c0bf, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:41.901383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2472e16-e60b-4e63-a01f-360abf8a58b3 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:41.905922 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1114/2260] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:41.907364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbd4c1-93ab-40dd-9091-ec0ab408b818 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:41.938033 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbd4c1-93ab-40dd-9091-ec0ab408b818 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:41.944275 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1147/2261] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:41 2022] PUT /identity/v3/projects/c1227782323e4c97b99f4bbb385ada1c/users/d1142677c500472ebe17dc205c40c0bf/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:41.945544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2472e16-e60b-4e63-a01f-360abf8a58b3 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:41.953947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-b2472e16-e60b-4e63-a01f-360abf8a58b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:42.066262 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2472e16-e60b-4e63-a01f-360abf8a58b3 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:42.072293 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096b5a0-8ebd-47d1-a3f6-c2c4ea3da0b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:42.073133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096b5a0-8ebd-47d1-a3f6-c2c4ea3da0b1 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:42.073769 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096b5a0-8ebd-47d1-a3f6-c2c4ea3da0b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:42.074059 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096b5a0-8ebd-47d1-a3f6-c2c4ea3da0b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:42.078617 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a096b5a0-8ebd-47d1-a3f6-c2c4ea3da0b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:42.103749 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97977e-daf8-4ff3-bd1d-46883d87eda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:42.106310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97977e-daf8-4ff3-bd1d-46883d87eda5 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:42.106862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97977e-daf8-4ff3-bd1d-46883d87eda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:42.107315 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97977e-daf8-4ff3-bd1d-46883d87eda5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:42.109857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97977e-daf8-4ff3-bd1d-46883d87eda5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:42.114640 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97977e-daf8-4ff3-bd1d-46883d87eda5 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:42.146101 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1115/2262] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:42.146881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41492cbc-a945-4adb-ba2f-00df634aaf08 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:42.147388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41492cbc-a945-4adb-ba2f-00df634aaf08 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:42.148031 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41492cbc-a945-4adb-ba2f-00df634aaf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:42.170371 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096b5a0-8ebd-47d1-a3f6-c2c4ea3da0b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:42.172739 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096b5a0-8ebd-47d1-a3f6-c2c4ea3da0b1 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:42.186022 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1148/2263] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:42.187309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096b5a0-8ebd-47d1-a3f6-c2c4ea3da0b1 service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:42.201199 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096b5a0-8ebd-47d1-a3f6-c2c4ea3da0b1 service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:42.208075 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6b38d-d526-4f28-bdc5-e0e66c77f8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:42.208628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-41492cbc-a945-4adb-ba2f-00df634aaf08 None None] MFA Rules not processed for user `d1142677c500472ebe17dc205c40c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:42.209381 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6b38d-d526-4f28-bdc5-e0e66c77f8a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:42.209730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6b38d-d526-4f28-bdc5-e0e66c77f8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:42.210074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6b38d-d526-4f28-bdc5-e0e66c77f8a6 admin admin] PATH_INFO: `/v3/projects/6feadeffa89f44d0b5e327c6e70ffd62/users/5e51df81654f4ece9a90adaa1f7a5f4a/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:42.211369 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-41492cbc-a945-4adb-ba2f-00df634aaf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:42.236968 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6b38d-d526-4f28-bdc5-e0e66c77f8a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6feadeffa89f44d0b5e327c6e70ffd62, user_id=5e51df81654f4ece9a90adaa1f7a5f4a, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:42.245115 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6b38d-d526-4f28-bdc5-e0e66c77f8a6 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:42.270461 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1149/2264] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:42 2022] PUT /identity/v3/projects/6feadeffa89f44d0b5e327c6e70ffd62/users/5e51df81654f4ece9a90adaa1f7a5f4a/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:42.279614 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0254b3-bb0c-4d97-bf5b-5fb3de898893 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:42.280122 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0254b3-bb0c-4d97-bf5b-5fb3de898893 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:42.280873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0254b3-bb0c-4d97-bf5b-5fb3de898893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:42.315379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-7b0254b3-bb0c-4d97-bf5b-5fb3de898893 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:42.317774 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-7b0254b3-bb0c-4d97-bf5b-5fb3de898893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:42.347155 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1116/2265] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:42.367584 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41492cbc-a945-4adb-ba2f-00df634aaf08 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:42.370643 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-41492cbc-a945-4adb-ba2f-00df634aaf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:42.506767 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1150/2266] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:07:42.524517 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0254b3-bb0c-4d97-bf5b-5fb3de898893 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:42.528221 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-7b0254b3-bb0c-4d97-bf5b-5fb3de898893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:42.600627 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41492cbc-a945-4adb-ba2f-00df634aaf08 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:42.677883 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0254b3-bb0c-4d97-bf5b-5fb3de898893 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:42.687689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b96782-0b9b-4a8c-a1a9-84e43727438e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdd8008619d4ee3b8fe45e0e5241878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:42.688992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b96782-0b9b-4a8c-a1a9-84e43727438e service glance] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:42.689946 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b96782-0b9b-4a8c-a1a9-84e43727438e service glance] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:42.690656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b96782-0b9b-4a8c-a1a9-84e43727438e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:42.690895 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f009b-d741-4edf-9b81-3ddbdbbf775e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:42.691959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f009b-d741-4edf-9b81-3ddbdbbf775e service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:42.692396 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f009b-d741-4edf-9b81-3ddbdbbf775e service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:42.692860 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f009b-d741-4edf-9b81-3ddbdbbf775e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:42.709690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f009b-d741-4edf-9b81-3ddbdbbf775e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:42.712579 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f009b-d741-4edf-9b81-3ddbdbbf775e service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:42.729008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1151/2267] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:07:42.789654 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b96782-0b9b-4a8c-a1a9-84e43727438e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:42.791284 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b96782-0b9b-4a8c-a1a9-84e43727438e service glance] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:42.804447 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1117/2268] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:07:47.577129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f009b-d741-4edf-9b81-3ddbdbbf775e service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:47.587709 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-503f009b-d741-4edf-9b81-3ddbdbbf775e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:47.606289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f009b-d741-4edf-9b81-3ddbdbbf775e service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:47.617270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e459f-231d-43a0-b552-80a31a6358a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:47.619499 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e459f-231d-43a0-b552-80a31a6358a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:47.620039 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e459f-231d-43a0-b552-80a31a6358a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:47.621320 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e459f-231d-43a0-b552-80a31a6358a1 admin admin] PATH_INFO: `/v3/users/49ac608d6c1c428282dd0840fa291c5d` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:47.624437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e459f-231d-43a0-b552-80a31a6358a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49ac608d6c1c428282dd0840fa291c5d)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:47.631272 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e459f-231d-43a0-b552-80a31a6358a1 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:47.796953 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-595e459f-231d-43a0-b552-80a31a6358a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49ac608d6c1c428282dd0840fa291c5d'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:47.814525 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-595e459f-231d-43a0-b552-80a31a6358a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49ac608d6c1c428282dd0840fa291c5d'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:47.818573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-595e459f-231d-43a0-b552-80a31a6358a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49ac608d6c1c428282dd0840fa291c5d'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:47.819975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-595e459f-231d-43a0-b552-80a31a6358a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49ac608d6c1c428282dd0840fa291c5d'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:47.834409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-595e459f-231d-43a0-b552-80a31a6358a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49ac608d6c1c428282dd0840fa291c5d'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:47.875414 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1152/2269] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:47 2022] DELETE /identity/v3/users/49ac608d6c1c428282dd0840fa291c5d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:48.067573 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b96782-0b9b-4a8c-a1a9-84e43727438e service glance] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:48.075907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-61b96782-0b9b-4a8c-a1a9-84e43727438e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:48.147145 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b96782-0b9b-4a8c-a1a9-84e43727438e service glance] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:48.269990 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea23360-d4f2-4d2f-8204-125cb09584e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:48.271869 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea23360-d4f2-4d2f-8204-125cb09584e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:48.272239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea23360-d4f2-4d2f-8204-125cb09584e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:48.273510 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea23360-d4f2-4d2f-8204-125cb09584e8 admin admin] PATH_INFO: `/v3/users/a4ceef7d4f68465286dd304059d32706` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:48.277726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea23360-d4f2-4d2f-8204-125cb09584e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4ceef7d4f68465286dd304059d32706)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:48.283169 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea23360-d4f2-4d2f-8204-125cb09584e8 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:48.377050 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6ea23360-d4f2-4d2f-8204-125cb09584e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ceef7d4f68465286dd304059d32706'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:48.385571 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e459f-231d-43a0-b552-80a31a6358a1 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:48.387881 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-595e459f-231d-43a0-b552-80a31a6358a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:48.413652 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e459f-231d-43a0-b552-80a31a6358a1 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:48.416117 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6ea23360-d4f2-4d2f-8204-125cb09584e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ceef7d4f68465286dd304059d32706'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:48.420032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f95b6-5989-431b-93a2-d22fbaeee083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:48.420323 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f95b6-5989-431b-93a2-d22fbaeee083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:48.420507 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f95b6-5989-431b-93a2-d22fbaeee083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:48.420798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f95b6-5989-431b-93a2-d22fbaeee083 admin admin] PATH_INFO: `/v3/projects/2363f1658fe84f89b000f2b4d511eb2d` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:48.422361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f95b6-5989-431b-93a2-d22fbaeee083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2363f1658fe84f89b000f2b4d511eb2d)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:48.424580 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f95b6-5989-431b-93a2-d22fbaeee083 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:48.469921 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6ea23360-d4f2-4d2f-8204-125cb09584e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ceef7d4f68465286dd304059d32706'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:48.471065 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6ea23360-d4f2-4d2f-8204-125cb09584e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ceef7d4f68465286dd304059d32706'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:48.481455 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6ea23360-d4f2-4d2f-8204-125cb09584e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ceef7d4f68465286dd304059d32706'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:48.495787 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1118/2270] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:48 2022] DELETE /identity/v3/users/a4ceef7d4f68465286dd304059d32706 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:48.497806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc04be2-9150-4261-8276-afbd5730a278 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:48.497806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc04be2-9150-4261-8276-afbd5730a278 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:48.498095 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc04be2-9150-4261-8276-afbd5730a278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:48.515812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-ebc04be2-9150-4261-8276-afbd5730a278 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:48.517034 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ebc04be2-9150-4261-8276-afbd5730a278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:48.524146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d87f95b6-5989-431b-93a2-d22fbaeee083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2363f1658fe84f89b000f2b4d511eb2d', 'request_id': 'req-d87f95b6-5989-431b-93a2-d22fbaeee083'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:48.538250 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d87f95b6-5989-431b-93a2-d22fbaeee083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2363f1658fe84f89b000f2b4d511eb2d', 'request_id': 'req-d87f95b6-5989-431b-93a2-d22fbaeee083'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:48.555854 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d87f95b6-5989-431b-93a2-d22fbaeee083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2363f1658fe84f89b000f2b4d511eb2d', 'request_id': 'req-d87f95b6-5989-431b-93a2-d22fbaeee083'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:48.580475 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d87f95b6-5989-431b-93a2-d22fbaeee083 admin admin] The token cache is being invalidate because project 2363f1658fe84f89b000f2b4d511eb2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:48.581404 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d87f95b6-5989-431b-93a2-d22fbaeee083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:48.585007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d87f95b6-5989-431b-93a2-d22fbaeee083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:48.593153 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1153/2271] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:48 2022] DELETE /identity/v3/projects/2363f1658fe84f89b000f2b4d511eb2d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:48.595289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f95b6-5989-431b-93a2-d22fbaeee083 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:48.597491 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-d87f95b6-5989-431b-93a2-d22fbaeee083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:48.601105 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1119/2272] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:48.615386 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc04be2-9150-4261-8276-afbd5730a278 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:48.616985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ebc04be2-9150-4261-8276-afbd5730a278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:48.719627 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc04be2-9150-4261-8276-afbd5730a278 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:48.724905 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c0d31-bd96-4cd5-b5dc-ac52c3887078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:48.725733 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c0d31-bd96-4cd5-b5dc-ac52c3887078 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:48.726132 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c0d31-bd96-4cd5-b5dc-ac52c3887078 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:48.726486 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c0d31-bd96-4cd5-b5dc-ac52c3887078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:48.740412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c0d31-bd96-4cd5-b5dc-ac52c3887078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:48.744170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c0d31-bd96-4cd5-b5dc-ac52c3887078 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:48.756937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f95b6-5989-431b-93a2-d22fbaeee083 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:48.763676 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8592e80-a9ec-4685-a611-0044415620b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:48.764704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8592e80-a9ec-4685-a611-0044415620b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:48.765048 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8592e80-a9ec-4685-a611-0044415620b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:48.765688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8592e80-a9ec-4685-a611-0044415620b3 admin admin] PATH_INFO: `/v3/users/0ce67a8dab1744ed94efb7ef4f96185c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:48.765844 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1120/2273] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:07:48.766948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8592e80-a9ec-4685-a611-0044415620b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ce67a8dab1744ed94efb7ef4f96185c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:48.769187 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8592e80-a9ec-4685-a611-0044415620b3 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:48.856838 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-a8592e80-a9ec-4685-a611-0044415620b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ce67a8dab1744ed94efb7ef4f96185c'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:48.883268 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-a8592e80-a9ec-4685-a611-0044415620b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ce67a8dab1744ed94efb7ef4f96185c'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:48.885511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-a8592e80-a9ec-4685-a611-0044415620b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ce67a8dab1744ed94efb7ef4f96185c'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:48.886871 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-a8592e80-a9ec-4685-a611-0044415620b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ce67a8dab1744ed94efb7ef4f96185c'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:48.899069 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-a8592e80-a9ec-4685-a611-0044415620b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ce67a8dab1744ed94efb7ef4f96185c'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:48.930517 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1154/2274] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:48 2022] DELETE /identity/v3/users/0ce67a8dab1744ed94efb7ef4f96185c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:49.551171 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c0d31-bd96-4cd5-b5dc-ac52c3887078 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:49.567222 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c0d31-bd96-4cd5-b5dc-ac52c3887078 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:49.597915 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8592e80-a9ec-4685-a611-0044415620b3 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:49.600961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a8592e80-a9ec-4685-a611-0044415620b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:49.717118 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6f207-6e2f-4b0c-87a8-ce65efcfa495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:49.718008 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6f207-6e2f-4b0c-87a8-ce65efcfa495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:49.718278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6f207-6e2f-4b0c-87a8-ce65efcfa495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:49.718676 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6f207-6e2f-4b0c-87a8-ce65efcfa495 admin admin] PATH_INFO: `/v3/projects/361f4737d650442b9df1e48ebafc04d6` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:49.720181 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6f207-6e2f-4b0c-87a8-ce65efcfa495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=361f4737d650442b9df1e48ebafc04d6)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:49.722367 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6f207-6e2f-4b0c-87a8-ce65efcfa495 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:49.741493 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8592e80-a9ec-4685-a611-0044415620b3 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:49.754942 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15aef6-5125-4b2f-a9e5-cb8fb1b34e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:49.756788 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15aef6-5125-4b2f-a9e5-cb8fb1b34e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:49.758096 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15aef6-5125-4b2f-a9e5-cb8fb1b34e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:49.758592 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15aef6-5125-4b2f-a9e5-cb8fb1b34e16 admin admin] PATH_INFO: `/v3/projects/20c5a8df111543f2a9c5c43fd834e2b5` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:49.762386 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15aef6-5125-4b2f-a9e5-cb8fb1b34e16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20c5a8df111543f2a9c5c43fd834e2b5)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:49.767481 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15aef6-5125-4b2f-a9e5-cb8fb1b34e16 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:49.813753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-aae6f207-6e2f-4b0c-87a8-ce65efcfa495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '361f4737d650442b9df1e48ebafc04d6', 'request_id': 'req-aae6f207-6e2f-4b0c-87a8-ce65efcfa495'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:49.824857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-aae6f207-6e2f-4b0c-87a8-ce65efcfa495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '361f4737d650442b9df1e48ebafc04d6', 'request_id': 'req-aae6f207-6e2f-4b0c-87a8-ce65efcfa495'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:49.840686 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-aae6f207-6e2f-4b0c-87a8-ce65efcfa495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '361f4737d650442b9df1e48ebafc04d6', 'request_id': 'req-aae6f207-6e2f-4b0c-87a8-ce65efcfa495'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:49.848125 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-8f15aef6-5125-4b2f-a9e5-cb8fb1b34e16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20c5a8df111543f2a9c5c43fd834e2b5', 'request_id': 'req-8f15aef6-5125-4b2f-a9e5-cb8fb1b34e16'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:49.867043 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-8f15aef6-5125-4b2f-a9e5-cb8fb1b34e16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20c5a8df111543f2a9c5c43fd834e2b5', 'request_id': 'req-8f15aef6-5125-4b2f-a9e5-cb8fb1b34e16'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:49.869498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-8f15aef6-5125-4b2f-a9e5-cb8fb1b34e16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20c5a8df111543f2a9c5c43fd834e2b5', 'request_id': 'req-8f15aef6-5125-4b2f-a9e5-cb8fb1b34e16'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:49.871165 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-aae6f207-6e2f-4b0c-87a8-ce65efcfa495 admin admin] The token cache is being invalidate because project 361f4737d650442b9df1e48ebafc04d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:49.871491 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-aae6f207-6e2f-4b0c-87a8-ce65efcfa495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:49.872653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-aae6f207-6e2f-4b0c-87a8-ce65efcfa495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:49.874646 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1121/2275] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:49 2022] DELETE /identity/v3/projects/361f4737d650442b9df1e48ebafc04d6 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:49.881098 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e61a3-fd8c-49a6-885e-bbf6d622d24b None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:49.881565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e61a3-fd8c-49a6-885e-bbf6d622d24b None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:49.882081 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e61a3-fd8c-49a6-885e-bbf6d622d24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:49.903706 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-8f15aef6-5125-4b2f-a9e5-cb8fb1b34e16 admin admin] The token cache is being invalidate because project 20c5a8df111543f2a9c5c43fd834e2b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:49.904324 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-8f15aef6-5125-4b2f-a9e5-cb8fb1b34e16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:49.905925 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-8f15aef6-5125-4b2f-a9e5-cb8fb1b34e16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:49.908767 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1155/2276] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:49 2022] DELETE /identity/v3/projects/20c5a8df111543f2a9c5c43fd834e2b5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:49.915133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15aef6-5125-4b2f-a9e5-cb8fb1b34e16 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:49.921992 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-8f15aef6-5125-4b2f-a9e5-cb8fb1b34e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:49.929357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-735e61a3-fd8c-49a6-885e-bbf6d622d24b None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:49.932550 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-735e61a3-fd8c-49a6-885e-bbf6d622d24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:50.050456 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1122/2277] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:50.055433 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15aef6-5125-4b2f-a9e5-cb8fb1b34e16 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:50.064009 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72ce4b-cd6a-4756-b1d2-1af4a9f43ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:50.064437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f100c76-ca11-4ad8-89c1-37ba94c7f6ab None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:50.065037 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f100c76-ca11-4ad8-89c1-37ba94c7f6ab None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:50.065510 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f100c76-ca11-4ad8-89c1-37ba94c7f6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:50.065752 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72ce4b-cd6a-4756-b1d2-1af4a9f43ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:50.066254 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72ce4b-cd6a-4756-b1d2-1af4a9f43ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:50.066747 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72ce4b-cd6a-4756-b1d2-1af4a9f43ee3 admin admin] PATH_INFO: `/v3/users/6606d986d0ce471a8aa666f7dacbe20e` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:50.069118 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72ce4b-cd6a-4756-b1d2-1af4a9f43ee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6606d986d0ce471a8aa666f7dacbe20e)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:50.073034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72ce4b-cd6a-4756-b1d2-1af4a9f43ee3 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:50.104068 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-2f100c76-ca11-4ad8-89c1-37ba94c7f6ab None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:50.106160 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-2f100c76-ca11-4ad8-89c1-37ba94c7f6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:50.118117 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1123/2278] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:50.123035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f100c76-ca11-4ad8-89c1-37ba94c7f6ab None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:50.142079 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f100c76-ca11-4ad8-89c1-37ba94c7f6ab None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:50.159104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-5a72ce4b-cd6a-4756-b1d2-1af4a9f43ee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6606d986d0ce471a8aa666f7dacbe20e'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:50.161109 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a970b-3657-4ee3-96f2-03a04ca849cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:50.162918 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a970b-3657-4ee3-96f2-03a04ca849cb admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:50.163406 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a970b-3657-4ee3-96f2-03a04ca849cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:50.163903 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a970b-3657-4ee3-96f2-03a04ca849cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:50.165305 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a970b-3657-4ee3-96f2-03a04ca849cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:07:50.165835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a970b-3657-4ee3-96f2-03a04ca849cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:50.169229 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a970b-3657-4ee3-96f2-03a04ca849cb admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:50.186707 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-5a72ce4b-cd6a-4756-b1d2-1af4a9f43ee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6606d986d0ce471a8aa666f7dacbe20e'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:50.189265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-5a72ce4b-cd6a-4756-b1d2-1af4a9f43ee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6606d986d0ce471a8aa666f7dacbe20e'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:50.192240 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-5a72ce4b-cd6a-4756-b1d2-1af4a9f43ee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6606d986d0ce471a8aa666f7dacbe20e'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:50.198215 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1124/2279] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 15:07:50.203398 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a970b-3657-4ee3-96f2-03a04ca849cb admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:50.207208 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-854a970b-3657-4ee3-96f2-03a04ca849cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:50.229641 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-5a72ce4b-cd6a-4756-b1d2-1af4a9f43ee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6606d986d0ce471a8aa666f7dacbe20e'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:50.249982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a970b-3657-4ee3-96f2-03a04ca849cb admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:50.272788 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1156/2280] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:49 2022] DELETE /identity/v3/users/6606d986d0ce471a8aa666f7dacbe20e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:07:50.284919 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840ba2e-fb17-48e2-81c5-500db8b57a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:50.285624 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840ba2e-fb17-48e2-81c5-500db8b57a5d admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:50.286495 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840ba2e-fb17-48e2-81c5-500db8b57a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:50.294246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840ba2e-fb17-48e2-81c5-500db8b57a5d admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:50.295090 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840ba2e-fb17-48e2-81c5-500db8b57a5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:50.297138 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840ba2e-fb17-48e2-81c5-500db8b57a5d admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:50.361357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1125/2281] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:07:50 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:50.365747 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72ce4b-cd6a-4756-b1d2-1af4a9f43ee3 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:50.554326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72ce4b-cd6a-4756-b1d2-1af4a9f43ee3 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:50.644581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3670b6-ca24-4512-abf8-c877e2b0e12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:50.645644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3670b6-ca24-4512-abf8-c877e2b0e12e admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:50.645867 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3670b6-ca24-4512-abf8-c877e2b0e12e admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:50.646640 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3670b6-ca24-4512-abf8-c877e2b0e12e admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:50.651405 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3670b6-ca24-4512-abf8-c877e2b0e12e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:50.651405 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3670b6-ca24-4512-abf8-c877e2b0e12e admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:50.680062 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1157/2282] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:07:50 2022] POST /identity/v3/users => generated 287 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:50.684457 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840ba2e-fb17-48e2-81c5-500db8b57a5d admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:50.711683 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840ba2e-fb17-48e2-81c5-500db8b57a5d admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:50.721004 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad58c7e-194e-452a-a424-1a391263ba90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:50.721864 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad58c7e-194e-452a-a424-1a391263ba90 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:50.722221 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad58c7e-194e-452a-a424-1a391263ba90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:50.722558 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad58c7e-194e-452a-a424-1a391263ba90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:50.723446 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad58c7e-194e-452a-a424-1a391263ba90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:50.725566 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad58c7e-194e-452a-a424-1a391263ba90 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:50.740853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1126/2283] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:50.745290 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3670b6-ca24-4512-abf8-c877e2b0e12e admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:50.758997 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3670b6-ca24-4512-abf8-c877e2b0e12e admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:50.765986 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520106b-26ea-41be-b8e0-43e0010962fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:50.767140 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520106b-26ea-41be-b8e0-43e0010962fb admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:50.767563 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520106b-26ea-41be-b8e0-43e0010962fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:50.768056 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520106b-26ea-41be-b8e0-43e0010962fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:50.769134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520106b-26ea-41be-b8e0-43e0010962fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:50.771406 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520106b-26ea-41be-b8e0-43e0010962fb admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:50.790281 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1158/2284] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:07:50.792079 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad58c7e-194e-452a-a424-1a391263ba90 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:50.808488 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad58c7e-194e-452a-a424-1a391263ba90 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:50.813422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194fda6-a422-4c61-81c5-5c7483ce713d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:50.814406 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194fda6-a422-4c61-81c5-5c7483ce713d admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:50.814768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194fda6-a422-4c61-81c5-5c7483ce713d admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:50.815151 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194fda6-a422-4c61-81c5-5c7483ce713d admin admin] PATH_INFO: `/v3/projects/4449207b099e467f9af18188ac14edc3/users/a0f359a8ba284d3088622af696a3eba7/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:50.835973 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194fda6-a422-4c61-81c5-5c7483ce713d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4449207b099e467f9af18188ac14edc3, user_id=a0f359a8ba284d3088622af696a3eba7, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:50.838896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194fda6-a422-4c61-81c5-5c7483ce713d admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:50.875302 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1127/2285] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:50 2022] PUT /identity/v3/projects/4449207b099e467f9af18188ac14edc3/users/a0f359a8ba284d3088622af696a3eba7/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:50.881015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a5ffb-6501-464e-96d0-7b48fb8ea8ea None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:50.881554 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a5ffb-6501-464e-96d0-7b48fb8ea8ea None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:50.882388 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a5ffb-6501-464e-96d0-7b48fb8ea8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:50.936565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194fda6-a422-4c61-81c5-5c7483ce713d admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:50.939141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-b194fda6-a422-4c61-81c5-5c7483ce713d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:50.953362 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-644a5ffb-6501-464e-96d0-7b48fb8ea8ea None None] MFA Rules not processed for user `a0f359a8ba284d3088622af696a3eba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:50.974419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-644a5ffb-6501-464e-96d0-7b48fb8ea8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:51.122475 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194fda6-a422-4c61-81c5-5c7483ce713d admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:51.134287 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1159/2286] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:51.159549 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e8cf8-7e7c-48d9-a9c1-ddaf0957c71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:51.160783 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e8cf8-7e7c-48d9-a9c1-ddaf0957c71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:51.161274 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e8cf8-7e7c-48d9-a9c1-ddaf0957c71c admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:51.168748 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a5ffb-6501-464e-96d0-7b48fb8ea8ea None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:51.169458 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e8cf8-7e7c-48d9-a9c1-ddaf0957c71c admin admin] PATH_INFO: `/v3/projects/de32bd779a5243229eeee40dcb11842c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:51.170541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-644a5ffb-6501-464e-96d0-7b48fb8ea8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:51.175219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e8cf8-7e7c-48d9-a9c1-ddaf0957c71c admin admin] RBAC: Authorizing `identity:delete_project(project_id=de32bd779a5243229eeee40dcb11842c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:51.179332 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e8cf8-7e7c-48d9-a9c1-ddaf0957c71c admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:51.264355 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a5ffb-6501-464e-96d0-7b48fb8ea8ea None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:51.269676 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21cb8c-4d89-4573-881f-aff6ee95ad8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:51.270533 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21cb8c-4d89-4573-881f-aff6ee95ad8e service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:51.272026 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21cb8c-4d89-4573-881f-aff6ee95ad8e service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:51.272366 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21cb8c-4d89-4573-881f-aff6ee95ad8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:51.299865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21cb8c-4d89-4573-881f-aff6ee95ad8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:51.301759 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21cb8c-4d89-4573-881f-aff6ee95ad8e service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:51.314807 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-db6e8cf8-7e7c-48d9-a9c1-ddaf0957c71c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de32bd779a5243229eeee40dcb11842c', 'request_id': 'req-db6e8cf8-7e7c-48d9-a9c1-ddaf0957c71c'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:51.326368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1160/2287] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:51.327339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-db6e8cf8-7e7c-48d9-a9c1-ddaf0957c71c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de32bd779a5243229eeee40dcb11842c', 'request_id': 'req-db6e8cf8-7e7c-48d9-a9c1-ddaf0957c71c'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:51.344672 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-db6e8cf8-7e7c-48d9-a9c1-ddaf0957c71c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de32bd779a5243229eeee40dcb11842c', 'request_id': 'req-db6e8cf8-7e7c-48d9-a9c1-ddaf0957c71c'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:51.372871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-db6e8cf8-7e7c-48d9-a9c1-ddaf0957c71c admin admin] The token cache is being invalidate because project de32bd779a5243229eeee40dcb11842c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:51.373153 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-db6e8cf8-7e7c-48d9-a9c1-ddaf0957c71c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:51.376208 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-db6e8cf8-7e7c-48d9-a9c1-ddaf0957c71c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:51.378283 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21cb8c-4d89-4573-881f-aff6ee95ad8e service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:51.391867 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1128/2288] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:50 2022] DELETE /identity/v3/projects/de32bd779a5243229eeee40dcb11842c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:51.396609 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e8cf8-7e7c-48d9-a9c1-ddaf0957c71c admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:51.403849 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-db6e8cf8-7e7c-48d9-a9c1-ddaf0957c71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:51.405157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21cb8c-4d89-4573-881f-aff6ee95ad8e service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:51.495255 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e8cf8-7e7c-48d9-a9c1-ddaf0957c71c admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:51.500708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b9b00-0873-4809-be1b-52a5be0757e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:51.501686 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b9b00-0873-4809-be1b-52a5be0757e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:51.502072 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b9b00-0873-4809-be1b-52a5be0757e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:51.502410 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b9b00-0873-4809-be1b-52a5be0757e5 admin admin] PATH_INFO: `/v3/users/8726d4737265442a88c8d85e6bb96dfa` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:51.503930 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b9b00-0873-4809-be1b-52a5be0757e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8726d4737265442a88c8d85e6bb96dfa)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:51.506540 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b9b00-0873-4809-be1b-52a5be0757e5 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:51.609856 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750109df-10c3-46b4-bd64-23975e87f8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:51.612233 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750109df-10c3-46b4-bd64-23975e87f8c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:51.613257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750109df-10c3-46b4-bd64-23975e87f8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:51.614070 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750109df-10c3-46b4-bd64-23975e87f8c5 admin admin] PATH_INFO: `/v3/users/a0f359a8ba284d3088622af696a3eba7` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:51.619553 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750109df-10c3-46b4-bd64-23975e87f8c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0f359a8ba284d3088622af696a3eba7)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:51.624911 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750109df-10c3-46b4-bd64-23975e87f8c5 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:51.640580 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-5f8b9b00-0873-4809-be1b-52a5be0757e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8726d4737265442a88c8d85e6bb96dfa'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:51.665867 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-5f8b9b00-0873-4809-be1b-52a5be0757e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8726d4737265442a88c8d85e6bb96dfa'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:51.703690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-5f8b9b00-0873-4809-be1b-52a5be0757e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8726d4737265442a88c8d85e6bb96dfa'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:51.706235 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-5f8b9b00-0873-4809-be1b-52a5be0757e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8726d4737265442a88c8d85e6bb96dfa'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:51.728979 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-5f8b9b00-0873-4809-be1b-52a5be0757e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8726d4737265442a88c8d85e6bb96dfa'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:51.739161 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-750109df-10c3-46b4-bd64-23975e87f8c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0f359a8ba284d3088622af696a3eba7'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:51.746083 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1129/2289] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:51 2022] DELETE /identity/v3/users/8726d4737265442a88c8d85e6bb96dfa => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:51.781633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-750109df-10c3-46b4-bd64-23975e87f8c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0f359a8ba284d3088622af696a3eba7'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:51.784115 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-750109df-10c3-46b4-bd64-23975e87f8c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0f359a8ba284d3088622af696a3eba7'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:51.785206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-750109df-10c3-46b4-bd64-23975e87f8c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0f359a8ba284d3088622af696a3eba7'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:51.803871 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-750109df-10c3-46b4-bd64-23975e87f8c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0f359a8ba284d3088622af696a3eba7'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:51.841399 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1161/2290] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:07:51 2022] DELETE /identity/v3/users/a0f359a8ba284d3088622af696a3eba7 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:51.844836 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb094ca-bf1d-43b0-b1bc-8f81bb1d065f None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:51.845611 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb094ca-bf1d-43b0-b1bc-8f81bb1d065f None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:51.846321 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb094ca-bf1d-43b0-b1bc-8f81bb1d065f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:51.889192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-4fb094ca-bf1d-43b0-b1bc-8f81bb1d065f None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:51.892021 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-4fb094ca-bf1d-43b0-b1bc-8f81bb1d065f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:52.104960 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1130/2291] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:07:52.127861 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750109df-10c3-46b4-bd64-23975e87f8c5 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:52.136098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-750109df-10c3-46b4-bd64-23975e87f8c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:52.307868 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750109df-10c3-46b4-bd64-23975e87f8c5 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:52.315768 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc818bd-26ba-473c-90cc-b6ca2f8d6fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:52.316904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc818bd-26ba-473c-90cc-b6ca2f8d6fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:52.321210 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc818bd-26ba-473c-90cc-b6ca2f8d6fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:52.321210 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc818bd-26ba-473c-90cc-b6ca2f8d6fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:52.339091 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc818bd-26ba-473c-90cc-b6ca2f8d6fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:52.341952 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc818bd-26ba-473c-90cc-b6ca2f8d6fc6 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:52.379323 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1162/2292] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:52.896748 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb094ca-bf1d-43b0-b1bc-8f81bb1d065f None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:52.898807 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-4fb094ca-bf1d-43b0-b1bc-8f81bb1d065f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:52.914018 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb094ca-bf1d-43b0-b1bc-8f81bb1d065f None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:52.925170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afaf31-f609-472a-889f-d8368e253b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:52.925170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afaf31-f609-472a-889f-d8368e253b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:52.925170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afaf31-f609-472a-889f-d8368e253b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:52.925170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afaf31-f609-472a-889f-d8368e253b10 admin admin] PATH_INFO: `/v3/projects/b5c44fcd179a4a45971a910d2c44cd54` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:52.925866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afaf31-f609-472a-889f-d8368e253b10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5c44fcd179a4a45971a910d2c44cd54)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:52.925866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afaf31-f609-472a-889f-d8368e253b10 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:53.043008 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d0afaf31-f609-472a-889f-d8368e253b10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5c44fcd179a4a45971a910d2c44cd54', 'request_id': 'req-d0afaf31-f609-472a-889f-d8368e253b10'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:53.054224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d0afaf31-f609-472a-889f-d8368e253b10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5c44fcd179a4a45971a910d2c44cd54', 'request_id': 'req-d0afaf31-f609-472a-889f-d8368e253b10'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:53.061892 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d0afaf31-f609-472a-889f-d8368e253b10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5c44fcd179a4a45971a910d2c44cd54', 'request_id': 'req-d0afaf31-f609-472a-889f-d8368e253b10'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:53.134275 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d0afaf31-f609-472a-889f-d8368e253b10 admin admin] The token cache is being invalidate because project b5c44fcd179a4a45971a910d2c44cd54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:53.134559 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d0afaf31-f609-472a-889f-d8368e253b10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:53.135718 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d0afaf31-f609-472a-889f-d8368e253b10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:53.138954 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1131/2293] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:52 2022] DELETE /identity/v3/projects/b5c44fcd179a4a45971a910d2c44cd54 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:53.614118 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc818bd-26ba-473c-90cc-b6ca2f8d6fc6 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:53.617174 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-1bc818bd-26ba-473c-90cc-b6ca2f8d6fc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:53.695116 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc818bd-26ba-473c-90cc-b6ca2f8d6fc6 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:53.842764 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f202f4-4564-4a64-8029-8555c5a5ef9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:53.843943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f202f4-4564-4a64-8029-8555c5a5ef9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:53.844436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f202f4-4564-4a64-8029-8555c5a5ef9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:53.844729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f202f4-4564-4a64-8029-8555c5a5ef9c admin admin] PATH_INFO: `/v3/projects/4449207b099e467f9af18188ac14edc3` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:53.846466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f202f4-4564-4a64-8029-8555c5a5ef9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4449207b099e467f9af18188ac14edc3)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:53.850180 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f202f4-4564-4a64-8029-8555c5a5ef9c admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:53.940285 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-31f202f4-4564-4a64-8029-8555c5a5ef9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4449207b099e467f9af18188ac14edc3', 'request_id': 'req-31f202f4-4564-4a64-8029-8555c5a5ef9c'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:53.950501 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-31f202f4-4564-4a64-8029-8555c5a5ef9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4449207b099e467f9af18188ac14edc3', 'request_id': 'req-31f202f4-4564-4a64-8029-8555c5a5ef9c'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:53.963495 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-31f202f4-4564-4a64-8029-8555c5a5ef9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4449207b099e467f9af18188ac14edc3', 'request_id': 'req-31f202f4-4564-4a64-8029-8555c5a5ef9c'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:53.994298 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-31f202f4-4564-4a64-8029-8555c5a5ef9c admin admin] The token cache is being invalidate because project 4449207b099e467f9af18188ac14edc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:07:53.994682 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-31f202f4-4564-4a64-8029-8555c5a5ef9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:53.996026 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-31f202f4-4564-4a64-8029-8555c5a5ef9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:07:54.002527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1163/2294] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:07:53 2022] DELETE /identity/v3/projects/4449207b099e467f9af18188ac14edc3 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:54.005837 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55e4c9-378d-4100-bf61-4cf6691f5742 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:54.006361 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55e4c9-378d-4100-bf61-4cf6691f5742 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:54.006894 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55e4c9-378d-4100-bf61-4cf6691f5742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:54.035587 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-fa55e4c9-378d-4100-bf61-4cf6691f5742 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:54.039712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-fa55e4c9-378d-4100-bf61-4cf6691f5742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:54.164411 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1132/2295] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:54.173386 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefb09c-06c4-45ee-bad3-8491b90a3e93 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:54.173647 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefb09c-06c4-45ee-bad3-8491b90a3e93 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:54.173925 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefb09c-06c4-45ee-bad3-8491b90a3e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:54.202567 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-5aefb09c-06c4-45ee-bad3-8491b90a3e93 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:54.204156 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-5aefb09c-06c4-45ee-bad3-8491b90a3e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:54.252395 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1164/2296] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:54.256945 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55e4c9-378d-4100-bf61-4cf6691f5742 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:54.268686 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55e4c9-378d-4100-bf61-4cf6691f5742 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:54.281340 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b3c17-3d46-4521-9585-4a89866c22b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:54.282671 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b3c17-3d46-4521-9585-4a89866c22b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:54.283358 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b3c17-3d46-4521-9585-4a89866c22b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:54.283985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b3c17-3d46-4521-9585-4a89866c22b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:54.285500 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b3c17-3d46-4521-9585-4a89866c22b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:07:54.285957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b3c17-3d46-4521-9585-4a89866c22b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:54.290774 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b3c17-3d46-4521-9585-4a89866c22b6 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:54.322009 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1133/2297] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:07:54.327706 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefb09c-06c4-45ee-bad3-8491b90a3e93 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:54.347451 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefb09c-06c4-45ee-bad3-8491b90a3e93 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:54.361849 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3dd1a-1c42-4ca9-adf3-953ba4aae677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:54.362561 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3dd1a-1c42-4ca9-adf3-953ba4aae677 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:54.362865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3dd1a-1c42-4ca9-adf3-953ba4aae677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:54.363158 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3dd1a-1c42-4ca9-adf3-953ba4aae677 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:54.363877 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3dd1a-1c42-4ca9-adf3-953ba4aae677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:54.373488 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3dd1a-1c42-4ca9-adf3-953ba4aae677 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:54.506249 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1165/2298] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:07:54 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:54.508154 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b3c17-3d46-4521-9585-4a89866c22b6 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:54.555960 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b3c17-3d46-4521-9585-4a89866c22b6 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:54.729770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fc339-33e3-401d-8f11-10f92e3f2c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:54.731245 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fc339-33e3-401d-8f11-10f92e3f2c6a admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:54.731712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fc339-33e3-401d-8f11-10f92e3f2c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:54.732166 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fc339-33e3-401d-8f11-10f92e3f2c6a admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:54.733489 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fc339-33e3-401d-8f11-10f92e3f2c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:54.737155 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fc339-33e3-401d-8f11-10f92e3f2c6a admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:54.804646 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1134/2299] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:07:54 2022] POST /identity/v3/users => generated 289 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:07:54.810034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3dd1a-1c42-4ca9-adf3-953ba4aae677 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:54.838860 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3dd1a-1c42-4ca9-adf3-953ba4aae677 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:54.855621 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a0837-94a7-45b3-b8a4-628c7487502a None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:54.856040 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a0837-94a7-45b3-b8a4-628c7487502a None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:54.856440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a0837-94a7-45b3-b8a4-628c7487502a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:54.866691 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105214ba-ee31-442b-91d9-4ca98cd58a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:54.867439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105214ba-ee31-442b-91d9-4ca98cd58a21 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:54.867724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105214ba-ee31-442b-91d9-4ca98cd58a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:54.868831 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105214ba-ee31-442b-91d9-4ca98cd58a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:54.868831 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105214ba-ee31-442b-91d9-4ca98cd58a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:54.870847 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105214ba-ee31-442b-91d9-4ca98cd58a21 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:54.888297 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1166/2300] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:07:54.890936 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105214ba-ee31-442b-91d9-4ca98cd58a21 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:54.901467 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105214ba-ee31-442b-91d9-4ca98cd58a21 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:54.909507 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0cc1c-2712-4790-ba65-125230970dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:54.910681 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0cc1c-2712-4790-ba65-125230970dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:54.911256 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0cc1c-2712-4790-ba65-125230970dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:54.911923 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0cc1c-2712-4790-ba65-125230970dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:54.912141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-771a0837-94a7-45b3-b8a4-628c7487502a None None] MFA Rules not processed for user `5e51df81654f4ece9a90adaa1f7a5f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:54.913303 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0cc1c-2712-4790-ba65-125230970dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:54.913413 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-771a0837-94a7-45b3-b8a4-628c7487502a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:54.925470 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0cc1c-2712-4790-ba65-125230970dc7 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:54.950257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1167/2301] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:07:54.960483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0cc1c-2712-4790-ba65-125230970dc7 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:54.976908 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0cc1c-2712-4790-ba65-125230970dc7 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:54.983878 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f592ff-3a4c-4864-8e1f-b291415d9b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:54.985112 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f592ff-3a4c-4864-8e1f-b291415d9b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:54.985505 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f592ff-3a4c-4864-8e1f-b291415d9b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:54.985890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f592ff-3a4c-4864-8e1f-b291415d9b97 admin admin] PATH_INFO: `/v3/projects/e7d272f291d244a7b8cd08df351918d2/users/bc802fbde351424f8ed20485efb84a36/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:55.014455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f592ff-3a4c-4864-8e1f-b291415d9b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d272f291d244a7b8cd08df351918d2, user_id=bc802fbde351424f8ed20485efb84a36, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:55.023978 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f592ff-3a4c-4864-8e1f-b291415d9b97 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:55.045831 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1135/2302] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:55.057849 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1168/2303] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:07:54 2022] PUT /identity/v3/projects/e7d272f291d244a7b8cd08df351918d2/users/bc802fbde351424f8ed20485efb84a36/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:07:55.089556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a8a59-601a-4d01-9049-8f49094a8701 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:55.090281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a8a59-601a-4d01-9049-8f49094a8701 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:55.092601 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a8a59-601a-4d01-9049-8f49094a8701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:55.148539 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-aa2a8a59-601a-4d01-9049-8f49094a8701 None None] MFA Rules not processed for user `bc802fbde351424f8ed20485efb84a36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:55.150566 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-aa2a8a59-601a-4d01-9049-8f49094a8701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:55.252853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1136/2304] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:07:55.272018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f592ff-3a4c-4864-8e1f-b291415d9b97 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:55.275696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-77f592ff-3a4c-4864-8e1f-b291415d9b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:55.276523 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a8a59-601a-4d01-9049-8f49094a8701 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:07:55.280343 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-aa2a8a59-601a-4d01-9049-8f49094a8701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:55.414878 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a8a59-601a-4d01-9049-8f49094a8701 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:55.421316 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a8dfc-ee25-40bd-9b58-d6ff9b082b01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:55.421713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a8dfc-ee25-40bd-9b58-d6ff9b082b01 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:55.422203 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a8dfc-ee25-40bd-9b58-d6ff9b082b01 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:55.422752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a8dfc-ee25-40bd-9b58-d6ff9b082b01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:55.439164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a8dfc-ee25-40bd-9b58-d6ff9b082b01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:55.441558 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a8dfc-ee25-40bd-9b58-d6ff9b082b01 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:55.459237 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1137/2305] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:07:55.543715 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f592ff-3a4c-4864-8e1f-b291415d9b97 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:07:55.549704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b75ec-325c-4f20-806f-12ab0d578a72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:07:55.550381 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b75ec-325c-4f20-806f-12ab0d578a72 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:55.550666 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b75ec-325c-4f20-806f-12ab0d578a72 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:55.550984 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b75ec-325c-4f20-806f-12ab0d578a72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:55.639100 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b75ec-325c-4f20-806f-12ab0d578a72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:07:55.641186 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b75ec-325c-4f20-806f-12ab0d578a72 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:07:55.653593 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1169/2306] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:07:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:07:58.063076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7fab1-d36f-47c8-abda-c2ea6ad978f0 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:07:58.063971 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7fab1-d36f-47c8-abda-c2ea6ad978f0 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:07:58.064483 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7fab1-d36f-47c8-abda-c2ea6ad978f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:07:58.085094 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-aec7fab1-d36f-47c8-abda-c2ea6ad978f0 None None] MFA Rules not processed for user `5e51df81654f4ece9a90adaa1f7a5f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:07:58.086357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-aec7fab1-d36f-47c8-abda-c2ea6ad978f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:07:58.096188 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1138/2307] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:07:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:08:14.813806 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f086bd5-821e-4f5b-a930-96a7d9a9a30c None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:14.814650 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f086bd5-821e-4f5b-a930-96a7d9a9a30c None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:14.814650 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f086bd5-821e-4f5b-a930-96a7d9a9a30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:14.899941 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-8f086bd5-821e-4f5b-a930-96a7d9a9a30c None None] MFA Rules not processed for user `0c04f5fb770d49c0a50f2cfbd77e17e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:08:14.901611 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-8f086bd5-821e-4f5b-a930-96a7d9a9a30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:15.006877 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1170/2308] 10.222.0.73 () {58 vars in 1009 bytes} [Fri May 13 15:08:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:08:15.080399 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7fab1-d36f-47c8-abda-c2ea6ad978f0 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:15.081779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-aec7fab1-d36f-47c8-abda-c2ea6ad978f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:15.224085 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7fab1-d36f-47c8-abda-c2ea6ad978f0 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:15.229902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ba129-8920-4561-99af-41a73a9b3104 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27265a0c2e6b47c09f28b9cd3ac47d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:15.230658 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ba129-8920-4561-99af-41a73a9b3104 service swift] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:15.231000 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ba129-8920-4561-99af-41a73a9b3104 service swift] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:15.231272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ba129-8920-4561-99af-41a73a9b3104 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:15.241325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ba129-8920-4561-99af-41a73a9b3104 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:15.242973 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ba129-8920-4561-99af-41a73a9b3104 service swift] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:15.252407 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1139/2309] 10.222.0.73 () {60 vars in 1384 bytes} [Fri May 13 15:08:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 15:08:16.062493 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cf778-07d5-41f7-87de-3bd7f93d7339 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:16.062493 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cf778-07d5-41f7-87de-3bd7f93d7339 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:16.063543 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cf778-07d5-41f7-87de-3bd7f93d7339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:16.104142 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-673cf778-07d5-41f7-87de-3bd7f93d7339 None None] MFA Rules not processed for user `0c04f5fb770d49c0a50f2cfbd77e17e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:08:16.108760 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-673cf778-07d5-41f7-87de-3bd7f93d7339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:16.125767 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1171/2310] 10.222.0.73 () {58 vars in 967 bytes} [Fri May 13 15:08:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:08:16.154230 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ba129-8920-4561-99af-41a73a9b3104 service swift] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:16.181126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ba129-8920-4561-99af-41a73a9b3104 service swift] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:16.204826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbfa10-a1dd-43ef-a670-6792c78fba00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27265a0c2e6b47c09f28b9cd3ac47d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:16.205771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbfa10-a1dd-43ef-a670-6792c78fba00 service swift] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:16.206206 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbfa10-a1dd-43ef-a670-6792c78fba00 service swift] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:16.206628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbfa10-a1dd-43ef-a670-6792c78fba00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:16.220927 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbfa10-a1dd-43ef-a670-6792c78fba00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:16.222743 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbfa10-a1dd-43ef-a670-6792c78fba00 service swift] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:16.236626 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1140/2311] 10.222.0.73 () {60 vars in 1384 bytes} [Fri May 13 15:08:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 15:08:16.841094 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a1ef7-f3d5-4f17-b3b9-d151f5f0bb41 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:16.841509 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a1ef7-f3d5-4f17-b3b9-d151f5f0bb41 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:16.841925 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a1ef7-f3d5-4f17-b3b9-d151f5f0bb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:16.864796 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-5f2a1ef7-f3d5-4f17-b3b9-d151f5f0bb41 None None] MFA Rules not processed for user `0c04f5fb770d49c0a50f2cfbd77e17e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:08:16.867081 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-5f2a1ef7-f3d5-4f17-b3b9-d151f5f0bb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:16.878094 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1172/2312] 10.222.0.73 () {58 vars in 1009 bytes} [Fri May 13 15:08:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:08:16.903879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbfa10-a1dd-43ef-a670-6792c78fba00 service swift] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:16.924728 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbfa10-a1dd-43ef-a670-6792c78fba00 service swift] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:16.936530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e5d17-40c9-415a-b184-db6be65784a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27265a0c2e6b47c09f28b9cd3ac47d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:16.937531 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e5d17-40c9-415a-b184-db6be65784a4 service swift] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:16.937911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e5d17-40c9-415a-b184-db6be65784a4 service swift] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:16.938258 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e5d17-40c9-415a-b184-db6be65784a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:16.949211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e5d17-40c9-415a-b184-db6be65784a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:16.951241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e5d17-40c9-415a-b184-db6be65784a4 service swift] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:16.961091 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1141/2313] 10.222.0.73 () {60 vars in 1384 bytes} [Fri May 13 15:08:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 15:08:17.353390 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780a5ba-62fc-4ab8-bf48-79c8cb5edd54 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:17.353885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780a5ba-62fc-4ab8-bf48-79c8cb5edd54 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:17.354011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780a5ba-62fc-4ab8-bf48-79c8cb5edd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:17.373245 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-4780a5ba-62fc-4ab8-bf48-79c8cb5edd54 None None] MFA Rules not processed for user `0c04f5fb770d49c0a50f2cfbd77e17e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:08:17.374953 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-4780a5ba-62fc-4ab8-bf48-79c8cb5edd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:17.384481 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1173/2314] 10.222.0.73 () {58 vars in 967 bytes} [Fri May 13 15:08:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:08:17.399442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e5d17-40c9-415a-b184-db6be65784a4 service swift] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:17.411599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e5d17-40c9-415a-b184-db6be65784a4 service swift] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:17.418355 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bac875-8c44-4ef3-a25e-a989a9a0006d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27265a0c2e6b47c09f28b9cd3ac47d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:17.419274 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bac875-8c44-4ef3-a25e-a989a9a0006d service swift] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:17.419645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bac875-8c44-4ef3-a25e-a989a9a0006d service swift] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:17.420165 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bac875-8c44-4ef3-a25e-a989a9a0006d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:17.431176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bac875-8c44-4ef3-a25e-a989a9a0006d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:17.432790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bac875-8c44-4ef3-a25e-a989a9a0006d service swift] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:17.443653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1142/2315] 10.222.0.73 () {60 vars in 1384 bytes} [Fri May 13 15:08:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 15:08:21.303573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780a5ba-62fc-4ab8-bf48-79c8cb5edd54 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:21.305235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-4780a5ba-62fc-4ab8-bf48-79c8cb5edd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:21.473828 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780a5ba-62fc-4ab8-bf48-79c8cb5edd54 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:21.485008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b835e80-d9d2-4520-bb87-cea546ae92ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:21.487751 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b835e80-d9d2-4520-bb87-cea546ae92ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:21.488242 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b835e80-d9d2-4520-bb87-cea546ae92ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:21.503386 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b835e80-d9d2-4520-bb87-cea546ae92ec admin admin] PATH_INFO: `/v3/users/d1142677c500472ebe17dc205c40c0bf` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:21.508388 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b835e80-d9d2-4520-bb87-cea546ae92ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1142677c500472ebe17dc205c40c0bf)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:21.510730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b835e80-d9d2-4520-bb87-cea546ae92ec admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:21.583884 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1b835e80-d9d2-4520-bb87-cea546ae92ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1142677c500472ebe17dc205c40c0bf'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:21.600449 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1b835e80-d9d2-4520-bb87-cea546ae92ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1142677c500472ebe17dc205c40c0bf'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:21.601270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1b835e80-d9d2-4520-bb87-cea546ae92ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1142677c500472ebe17dc205c40c0bf'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:21.601929 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1b835e80-d9d2-4520-bb87-cea546ae92ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1142677c500472ebe17dc205c40c0bf'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:21.611556 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1b835e80-d9d2-4520-bb87-cea546ae92ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1142677c500472ebe17dc205c40c0bf'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:21.630049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1174/2316] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:08:21 2022] DELETE /identity/v3/users/d1142677c500472ebe17dc205c40c0bf => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:08:21.632442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9449aa-84c8-4c7e-baca-f6a06044cb83 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:21.632980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9449aa-84c8-4c7e-baca-f6a06044cb83 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:21.633236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9449aa-84c8-4c7e-baca-f6a06044cb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:21.652956 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-6c9449aa-84c8-4c7e-baca-f6a06044cb83 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:08:21.654775 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6c9449aa-84c8-4c7e-baca-f6a06044cb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:21.747016 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1143/2317] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:08:21.761851 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b835e80-d9d2-4520-bb87-cea546ae92ec admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:21.764071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-1b835e80-d9d2-4520-bb87-cea546ae92ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:21.814562 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9449aa-84c8-4c7e-baca-f6a06044cb83 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:21.817398 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6c9449aa-84c8-4c7e-baca-f6a06044cb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:21.833656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9449aa-84c8-4c7e-baca-f6a06044cb83 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:21.841540 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02859509-82cd-4af1-adcf-596f33a13d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:21.842949 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02859509-82cd-4af1-adcf-596f33a13d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:21.843830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02859509-82cd-4af1-adcf-596f33a13d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:21.844278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02859509-82cd-4af1-adcf-596f33a13d96 admin admin] PATH_INFO: `/v3/users/933db9887896416d8a0efe5cbd1dfb6d` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:21.846267 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02859509-82cd-4af1-adcf-596f33a13d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=933db9887896416d8a0efe5cbd1dfb6d)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:21.848866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02859509-82cd-4af1-adcf-596f33a13d96 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:21.879123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b835e80-d9d2-4520-bb87-cea546ae92ec admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:21.890124 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45cea9-a5a9-4e97-a3c1-be3575fb0942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:21.891043 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45cea9-a5a9-4e97-a3c1-be3575fb0942 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:21.892321 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45cea9-a5a9-4e97-a3c1-be3575fb0942 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:21.892690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45cea9-a5a9-4e97-a3c1-be3575fb0942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:21.929403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45cea9-a5a9-4e97-a3c1-be3575fb0942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:21.933475 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45cea9-a5a9-4e97-a3c1-be3575fb0942 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:21.937804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-02859509-82cd-4af1-adcf-596f33a13d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '933db9887896416d8a0efe5cbd1dfb6d'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:21.949252 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-02859509-82cd-4af1-adcf-596f33a13d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '933db9887896416d8a0efe5cbd1dfb6d'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:21.964081 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1175/2318] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:08:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:08:22.004059 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-02859509-82cd-4af1-adcf-596f33a13d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '933db9887896416d8a0efe5cbd1dfb6d'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:22.005663 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-02859509-82cd-4af1-adcf-596f33a13d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '933db9887896416d8a0efe5cbd1dfb6d'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:22.046384 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-02859509-82cd-4af1-adcf-596f33a13d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '933db9887896416d8a0efe5cbd1dfb6d'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:22.071596 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1144/2319] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:08:21 2022] DELETE /identity/v3/users/933db9887896416d8a0efe5cbd1dfb6d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:08:22.077098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147e6b2-a69a-4fe2-8a6e-05f465be0289 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:22.078376 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147e6b2-a69a-4fe2-8a6e-05f465be0289 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:22.079039 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147e6b2-a69a-4fe2-8a6e-05f465be0289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:22.138189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-2147e6b2-a69a-4fe2-8a6e-05f465be0289 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:08:22.140462 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-2147e6b2-a69a-4fe2-8a6e-05f465be0289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:22.225945 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1176/2320] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:08:22.236532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02859509-82cd-4af1-adcf-596f33a13d96 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:22.239023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-02859509-82cd-4af1-adcf-596f33a13d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:22.312353 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147e6b2-a69a-4fe2-8a6e-05f465be0289 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:22.314292 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-2147e6b2-a69a-4fe2-8a6e-05f465be0289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:22.316738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02859509-82cd-4af1-adcf-596f33a13d96 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:22.321182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00952d1-f55c-45bc-860c-e9b5f247710e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:22.321979 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00952d1-f55c-45bc-860c-e9b5f247710e service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:22.322338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00952d1-f55c-45bc-860c-e9b5f247710e service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:22.322624 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00952d1-f55c-45bc-860c-e9b5f247710e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:22.333377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00952d1-f55c-45bc-860c-e9b5f247710e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:22.334993 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00952d1-f55c-45bc-860c-e9b5f247710e service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:22.337384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147e6b2-a69a-4fe2-8a6e-05f465be0289 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:22.347292 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1145/2321] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:08:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:08:22.351349 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad55be-aae6-45ea-ada6-eedf049321f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:22.352325 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad55be-aae6-45ea-ada6-eedf049321f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:22.352674 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad55be-aae6-45ea-ada6-eedf049321f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:22.353030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad55be-aae6-45ea-ada6-eedf049321f8 admin admin] PATH_INFO: `/v3/projects/c1227782323e4c97b99f4bbb385ada1c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:22.354397 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad55be-aae6-45ea-ada6-eedf049321f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1227782323e4c97b99f4bbb385ada1c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:22.356676 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad55be-aae6-45ea-ada6-eedf049321f8 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:22.419185 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-fbad55be-aae6-45ea-ada6-eedf049321f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1227782323e4c97b99f4bbb385ada1c', 'request_id': 'req-fbad55be-aae6-45ea-ada6-eedf049321f8'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:22.431381 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-fbad55be-aae6-45ea-ada6-eedf049321f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1227782323e4c97b99f4bbb385ada1c', 'request_id': 'req-fbad55be-aae6-45ea-ada6-eedf049321f8'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:22.443084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-fbad55be-aae6-45ea-ada6-eedf049321f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1227782323e4c97b99f4bbb385ada1c', 'request_id': 'req-fbad55be-aae6-45ea-ada6-eedf049321f8'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:22.462313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-fbad55be-aae6-45ea-ada6-eedf049321f8 admin admin] The token cache is being invalidate because project c1227782323e4c97b99f4bbb385ada1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:08:22.462605 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-fbad55be-aae6-45ea-ada6-eedf049321f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:22.463400 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-fbad55be-aae6-45ea-ada6-eedf049321f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:22.465334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1177/2322] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:08:22 2022] DELETE /identity/v3/projects/c1227782323e4c97b99f4bbb385ada1c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:08:22.473758 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d697d1f-84ed-4456-bab1-e7fdb361e536 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:22.474420 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d697d1f-84ed-4456-bab1-e7fdb361e536 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:22.475029 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d697d1f-84ed-4456-bab1-e7fdb361e536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:22.501158 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-2d697d1f-84ed-4456-bab1-e7fdb361e536 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:08:22.502725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-2d697d1f-84ed-4456-bab1-e7fdb361e536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:22.569629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad55be-aae6-45ea-ada6-eedf049321f8 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:22.572008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-fbad55be-aae6-45ea-ada6-eedf049321f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:22.588832 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1146/2323] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:08:22.591642 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bdb14-279a-47a0-8dc4-84037aa42767 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:22.592154 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bdb14-279a-47a0-8dc4-84037aa42767 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:22.592633 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bdb14-279a-47a0-8dc4-84037aa42767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:22.600610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad55be-aae6-45ea-ada6-eedf049321f8 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:22.609082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9e128-8c34-4542-9f91-01428a8d7724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:22.610590 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9e128-8c34-4542-9f91-01428a8d7724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:22.611174 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9e128-8c34-4542-9f91-01428a8d7724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:22.611664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9e128-8c34-4542-9f91-01428a8d7724 admin admin] PATH_INFO: `/v3/projects/2f8abbaff1d64f80aaaee94cbcebbacc` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:22.614402 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9e128-8c34-4542-9f91-01428a8d7724 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f8abbaff1d64f80aaaee94cbcebbacc)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:22.617912 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-2f7bdb14-279a-47a0-8dc4-84037aa42767 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:08:22.619059 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9e128-8c34-4542-9f91-01428a8d7724 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:22.620278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-2f7bdb14-279a-47a0-8dc4-84037aa42767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:22.636041 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1147/2324] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:08:22.642928 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bdb14-279a-47a0-8dc4-84037aa42767 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:22.663785 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bdb14-279a-47a0-8dc4-84037aa42767 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:22.682681 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e5c9e128-8c34-4542-9f91-01428a8d7724 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f8abbaff1d64f80aaaee94cbcebbacc', 'request_id': 'req-e5c9e128-8c34-4542-9f91-01428a8d7724'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:22.695091 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e5c9e128-8c34-4542-9f91-01428a8d7724 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f8abbaff1d64f80aaaee94cbcebbacc', 'request_id': 'req-e5c9e128-8c34-4542-9f91-01428a8d7724'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:22.713056 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e5c9e128-8c34-4542-9f91-01428a8d7724 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f8abbaff1d64f80aaaee94cbcebbacc', 'request_id': 'req-e5c9e128-8c34-4542-9f91-01428a8d7724'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:22.730745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e5c9e128-8c34-4542-9f91-01428a8d7724 admin admin] The token cache is being invalidate because project 2f8abbaff1d64f80aaaee94cbcebbacc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:08:22.731297 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e5c9e128-8c34-4542-9f91-01428a8d7724 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:22.732316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e5c9e128-8c34-4542-9f91-01428a8d7724 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:22.734801 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1178/2325] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:08:22 2022] DELETE /identity/v3/projects/2f8abbaff1d64f80aaaee94cbcebbacc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:08:22.740301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ee113-266b-4d29-b51f-71338cbb1867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:22.740998 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ee113-266b-4d29-b51f-71338cbb1867 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:22.741281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ee113-266b-4d29-b51f-71338cbb1867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:22.741948 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ee113-266b-4d29-b51f-71338cbb1867 admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:22.742991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ee113-266b-4d29-b51f-71338cbb1867 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:08:22.743408 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ee113-266b-4d29-b51f-71338cbb1867 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:22.745515 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ee113-266b-4d29-b51f-71338cbb1867 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:22.771102 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1148/2326] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 15:08:22.777626 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9e128-8c34-4542-9f91-01428a8d7724 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:22.781544 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e5c9e128-8c34-4542-9f91-01428a8d7724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:22.806264 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9e128-8c34-4542-9f91-01428a8d7724 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:22.815634 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5474dce-e9b7-45b9-a47a-cc67e2e860e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:22.817448 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5474dce-e9b7-45b9-a47a-cc67e2e860e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:22.817988 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5474dce-e9b7-45b9-a47a-cc67e2e860e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:22.818561 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5474dce-e9b7-45b9-a47a-cc67e2e860e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:22.820190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5474dce-e9b7-45b9-a47a-cc67e2e860e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:22.824323 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5474dce-e9b7-45b9-a47a-cc67e2e860e8 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:22.892013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1179/2327] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:08:22 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:08:22.903273 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ee113-266b-4d29-b51f-71338cbb1867 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:22.943963 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ee113-266b-4d29-b51f-71338cbb1867 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:23.070865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f279d11-8295-46d0-9b08-5df5147ccece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:23.072250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f279d11-8295-46d0-9b08-5df5147ccece admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:23.072817 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f279d11-8295-46d0-9b08-5df5147ccece admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:23.073481 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f279d11-8295-46d0-9b08-5df5147ccece admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:23.074865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f279d11-8295-46d0-9b08-5df5147ccece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:23.079469 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f279d11-8295-46d0-9b08-5df5147ccece admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:23.132957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1149/2328] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:08:22 2022] POST /identity/v3/users => generated 288 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:08:23.134903 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5474dce-e9b7-45b9-a47a-cc67e2e860e8 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:23.154616 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5474dce-e9b7-45b9-a47a-cc67e2e860e8 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:23.164918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958bc15-1833-4bb8-bf64-f75c2e5d146f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:23.166167 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958bc15-1833-4bb8-bf64-f75c2e5d146f admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:23.166963 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958bc15-1833-4bb8-bf64-f75c2e5d146f admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:23.167389 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958bc15-1833-4bb8-bf64-f75c2e5d146f admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:23.168548 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958bc15-1833-4bb8-bf64-f75c2e5d146f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:23.171667 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958bc15-1833-4bb8-bf64-f75c2e5d146f admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:23.199348 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1180/2329] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:08:23.201468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f279d11-8295-46d0-9b08-5df5147ccece admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:23.227214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f279d11-8295-46d0-9b08-5df5147ccece admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:23.244497 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2acb5-d5da-4ef3-a637-41bca2a68a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:23.245194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2acb5-d5da-4ef3-a637-41bca2a68a7c admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:23.245555 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2acb5-d5da-4ef3-a637-41bca2a68a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:23.245931 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2acb5-d5da-4ef3-a637-41bca2a68a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:23.246605 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2acb5-d5da-4ef3-a637-41bca2a68a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:23.248308 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2acb5-d5da-4ef3-a637-41bca2a68a7c admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:23.266141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1150/2330] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:08:23.271345 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958bc15-1833-4bb8-bf64-f75c2e5d146f admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:23.292047 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958bc15-1833-4bb8-bf64-f75c2e5d146f admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:23.302929 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4be737-f54e-4e8f-ad41-44f4e60eefb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:23.304665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4be737-f54e-4e8f-ad41-44f4e60eefb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:23.305305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4be737-f54e-4e8f-ad41-44f4e60eefb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:23.305922 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4be737-f54e-4e8f-ad41-44f4e60eefb6 admin admin] PATH_INFO: `/v3/projects/5973a9c329054e4392d3d931c1de4692/users/cee81515fc154a4fa573fc0d689ff522/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:23.356194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4be737-f54e-4e8f-ad41-44f4e60eefb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5973a9c329054e4392d3d931c1de4692, user_id=cee81515fc154a4fa573fc0d689ff522, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:23.359123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4be737-f54e-4e8f-ad41-44f4e60eefb6 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:23.389357 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1181/2331] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:08:23 2022] PUT /identity/v3/projects/5973a9c329054e4392d3d931c1de4692/users/cee81515fc154a4fa573fc0d689ff522/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:08:23.390254 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48043d57-1583-4235-a74a-cdbd0371e693 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:23.390791 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48043d57-1583-4235-a74a-cdbd0371e693 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:23.391298 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48043d57-1583-4235-a74a-cdbd0371e693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:23.424331 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-48043d57-1583-4235-a74a-cdbd0371e693 None None] MFA Rules not processed for user `cee81515fc154a4fa573fc0d689ff522`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:08:23.427571 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-48043d57-1583-4235-a74a-cdbd0371e693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:23.515435 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1151/2332] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:08:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:08:23.520816 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4be737-f54e-4e8f-ad41-44f4e60eefb6 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:23.629649 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4be737-f54e-4e8f-ad41-44f4e60eefb6 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:23.636687 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c9528-f26c-4524-b485-ab676d2f5b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:23.637373 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c9528-f26c-4524-b485-ab676d2f5b08 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:23.637719 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c9528-f26c-4524-b485-ab676d2f5b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:23.637908 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c9528-f26c-4524-b485-ab676d2f5b08 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:23.638611 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c9528-f26c-4524-b485-ab676d2f5b08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:23.640832 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c9528-f26c-4524-b485-ab676d2f5b08 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:23.676204 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1182/2333] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:08:23 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:08:23.682768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48043d57-1583-4235-a74a-cdbd0371e693 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:23.705930 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48043d57-1583-4235-a74a-cdbd0371e693 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:23.787563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501740a4-4e4e-4af7-8862-a83c26d2ec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:23.789235 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501740a4-4e4e-4af7-8862-a83c26d2ec46 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:23.789703 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501740a4-4e4e-4af7-8862-a83c26d2ec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:23.790136 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501740a4-4e4e-4af7-8862-a83c26d2ec46 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:23.791114 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501740a4-4e4e-4af7-8862-a83c26d2ec46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:23.793481 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501740a4-4e4e-4af7-8862-a83c26d2ec46 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:23.828216 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1152/2334] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:08:23 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:08:23.830557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c9528-f26c-4524-b485-ab676d2f5b08 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:23.848757 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c9528-f26c-4524-b485-ab676d2f5b08 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:23.857753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7cfb2-96e1-4d30-a9b5-db58c8ce586e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:23.859448 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7cfb2-96e1-4d30-a9b5-db58c8ce586e admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:23.859938 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7cfb2-96e1-4d30-a9b5-db58c8ce586e admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:23.860421 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7cfb2-96e1-4d30-a9b5-db58c8ce586e admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:23.862670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7cfb2-96e1-4d30-a9b5-db58c8ce586e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:23.865118 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7cfb2-96e1-4d30-a9b5-db58c8ce586e admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:23.887670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1183/2335] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:08:23.893663 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501740a4-4e4e-4af7-8862-a83c26d2ec46 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:23.915775 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501740a4-4e4e-4af7-8862-a83c26d2ec46 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:23.923721 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234e0f6-1ea2-45e4-aae1-ef545decfade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:23.925219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234e0f6-1ea2-45e4-aae1-ef545decfade admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:23.925219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234e0f6-1ea2-45e4-aae1-ef545decfade admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:23.926031 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234e0f6-1ea2-45e4-aae1-ef545decfade admin admin] PATH_INFO: `/v3/projects/5c1cbd129bc1453f9573b8e1f3c1dfcd/users/3cd7f6c3ee904af0bf0f5d46841afcff/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:23.950415 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234e0f6-1ea2-45e4-aae1-ef545decfade admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1cbd129bc1453f9573b8e1f3c1dfcd, user_id=3cd7f6c3ee904af0bf0f5d46841afcff, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:23.953551 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234e0f6-1ea2-45e4-aae1-ef545decfade admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:23.978437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7cfb2-96e1-4d30-a9b5-db58c8ce586e admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:23.983168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1153/2336] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:08:23 2022] PUT /identity/v3/projects/5c1cbd129bc1453f9573b8e1f3c1dfcd/users/3cd7f6c3ee904af0bf0f5d46841afcff/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:08:23.992372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7cfb2-96e1-4d30-a9b5-db58c8ce586e admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:24.086974 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6ccbe-0df0-4a3c-a7b6-31cf904fbea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:24.088417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6ccbe-0df0-4a3c-a7b6-31cf904fbea6 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:24.089261 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6ccbe-0df0-4a3c-a7b6-31cf904fbea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:24.089729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6ccbe-0df0-4a3c-a7b6-31cf904fbea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:24.090755 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6ccbe-0df0-4a3c-a7b6-31cf904fbea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:24.093144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6ccbe-0df0-4a3c-a7b6-31cf904fbea6 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:24.113714 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1184/2337] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:08:24.116475 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234e0f6-1ea2-45e4-aae1-ef545decfade admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:24.138985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234e0f6-1ea2-45e4-aae1-ef545decfade admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:24.153535 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e9d55-fc2e-48fe-abe1-69ee98ec48b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:24.153883 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e9d55-fc2e-48fe-abe1-69ee98ec48b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:24.154062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e9d55-fc2e-48fe-abe1-69ee98ec48b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:24.154369 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e9d55-fc2e-48fe-abe1-69ee98ec48b9 admin admin] PATH_INFO: `/v3/projects/5c1cbd129bc1453f9573b8e1f3c1dfcd/users/3cd7f6c3ee904af0bf0f5d46841afcff/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:24.156794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e9d55-fc2e-48fe-abe1-69ee98ec48b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1cbd129bc1453f9573b8e1f3c1dfcd, user_id=3cd7f6c3ee904af0bf0f5d46841afcff, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:24.161512 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e9d55-fc2e-48fe-abe1-69ee98ec48b9 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:24.181188 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1154/2338] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:08:24 2022] PUT /identity/v3/projects/5c1cbd129bc1453f9573b8e1f3c1dfcd/users/3cd7f6c3ee904af0bf0f5d46841afcff/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:08:24.195161 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57a859-e602-4864-80b0-71a8deecedef None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:24.195546 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57a859-e602-4864-80b0-71a8deecedef None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:24.195987 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57a859-e602-4864-80b0-71a8deecedef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:24.236615 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-1f57a859-e602-4864-80b0-71a8deecedef None None] MFA Rules not processed for user `3cd7f6c3ee904af0bf0f5d46841afcff`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:08:24.238793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-1f57a859-e602-4864-80b0-71a8deecedef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:24.380458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1185/2339] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:08:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:08:24.406137 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e9d55-fc2e-48fe-abe1-69ee98ec48b9 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:24.409213 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-eb8e9d55-fc2e-48fe-abe1-69ee98ec48b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:24.500901 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e9d55-fc2e-48fe-abe1-69ee98ec48b9 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:24.506042 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e823b3a-856b-4df0-a7ce-4e5d4c071944 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:24.507223 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e823b3a-856b-4df0-a7ce-4e5d4c071944 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:24.507602 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e823b3a-856b-4df0-a7ce-4e5d4c071944 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:24.507973 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e823b3a-856b-4df0-a7ce-4e5d4c071944 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:24.631258 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e823b3a-856b-4df0-a7ce-4e5d4c071944 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:24.634851 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e823b3a-856b-4df0-a7ce-4e5d4c071944 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:24.655756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1155/2340] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:08:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:08:26.026799 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57a859-e602-4864-80b0-71a8deecedef None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:26.029387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-1f57a859-e602-4864-80b0-71a8deecedef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:26.141674 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57a859-e602-4864-80b0-71a8deecedef None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:26.149211 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2ae14-059c-495e-aa6f-01862171d281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:26.150212 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2ae14-059c-495e-aa6f-01862171d281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:26.150556 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2ae14-059c-495e-aa6f-01862171d281 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:26.150959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2ae14-059c-495e-aa6f-01862171d281 admin admin] PATH_INFO: `/v3/users/bc802fbde351424f8ed20485efb84a36` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:26.152788 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2ae14-059c-495e-aa6f-01862171d281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc802fbde351424f8ed20485efb84a36)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:26.155064 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2ae14-059c-495e-aa6f-01862171d281 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:26.241732 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7ce2ae14-059c-495e-aa6f-01862171d281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc802fbde351424f8ed20485efb84a36'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:26.265452 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7ce2ae14-059c-495e-aa6f-01862171d281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc802fbde351424f8ed20485efb84a36'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:26.266652 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7ce2ae14-059c-495e-aa6f-01862171d281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc802fbde351424f8ed20485efb84a36'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:26.267925 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7ce2ae14-059c-495e-aa6f-01862171d281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc802fbde351424f8ed20485efb84a36'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:26.282485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7ce2ae14-059c-495e-aa6f-01862171d281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc802fbde351424f8ed20485efb84a36'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:26.306272 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1186/2341] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:08:26 2022] DELETE /identity/v3/users/bc802fbde351424f8ed20485efb84a36 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:08:26.312721 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed46c2-0e0a-45ea-b855-a96fd9964699 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:26.313483 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed46c2-0e0a-45ea-b855-a96fd9964699 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:26.313483 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed46c2-0e0a-45ea-b855-a96fd9964699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:26.346341 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-b3ed46c2-0e0a-45ea-b855-a96fd9964699 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:08:26.349042 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-b3ed46c2-0e0a-45ea-b855-a96fd9964699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:26.487159 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1156/2342] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:08:26.496246 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2ae14-059c-495e-aa6f-01862171d281 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:26.498500 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-7ce2ae14-059c-495e-aa6f-01862171d281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:26.580076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2ae14-059c-495e-aa6f-01862171d281 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:26.584967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725dfc6-bdd3-4a70-8470-1887b576c104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:26.585756 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725dfc6-bdd3-4a70-8470-1887b576c104 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:26.586171 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725dfc6-bdd3-4a70-8470-1887b576c104 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:26.586534 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725dfc6-bdd3-4a70-8470-1887b576c104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:26.597699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725dfc6-bdd3-4a70-8470-1887b576c104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:26.599345 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725dfc6-bdd3-4a70-8470-1887b576c104 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:26.612130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1187/2343] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:08:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:08:27.032621 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed46c2-0e0a-45ea-b855-a96fd9964699 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:27.036336 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-b3ed46c2-0e0a-45ea-b855-a96fd9964699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:27.055161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed46c2-0e0a-45ea-b855-a96fd9964699 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:27.064662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940cb55-ceca-4c5d-acde-a4cc54f38b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:27.067083 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940cb55-ceca-4c5d-acde-a4cc54f38b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:27.067670 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940cb55-ceca-4c5d-acde-a4cc54f38b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:27.068163 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940cb55-ceca-4c5d-acde-a4cc54f38b51 admin admin] PATH_INFO: `/v3/projects/e7d272f291d244a7b8cd08df351918d2` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:27.070752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940cb55-ceca-4c5d-acde-a4cc54f38b51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7d272f291d244a7b8cd08df351918d2)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:27.075050 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940cb55-ceca-4c5d-acde-a4cc54f38b51 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:27.137860 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-0940cb55-ceca-4c5d-acde-a4cc54f38b51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7d272f291d244a7b8cd08df351918d2', 'request_id': 'req-0940cb55-ceca-4c5d-acde-a4cc54f38b51'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:27.147168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-0940cb55-ceca-4c5d-acde-a4cc54f38b51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7d272f291d244a7b8cd08df351918d2', 'request_id': 'req-0940cb55-ceca-4c5d-acde-a4cc54f38b51'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:27.154857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-0940cb55-ceca-4c5d-acde-a4cc54f38b51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7d272f291d244a7b8cd08df351918d2', 'request_id': 'req-0940cb55-ceca-4c5d-acde-a4cc54f38b51'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:27.172741 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-0940cb55-ceca-4c5d-acde-a4cc54f38b51 admin admin] The token cache is being invalidate because project e7d272f291d244a7b8cd08df351918d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:08:27.173033 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-0940cb55-ceca-4c5d-acde-a4cc54f38b51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:27.174020 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-0940cb55-ceca-4c5d-acde-a4cc54f38b51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:27.175739 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1157/2344] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:08:27 2022] DELETE /identity/v3/projects/e7d272f291d244a7b8cd08df351918d2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:08:27.632264 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725dfc6-bdd3-4a70-8470-1887b576c104 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:27.634672 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-9725dfc6-bdd3-4a70-8470-1887b576c104 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:27.656111 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725dfc6-bdd3-4a70-8470-1887b576c104 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:27.756113 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30381ab-89b8-40f0-8022-fab9ccabba91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:27.757646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30381ab-89b8-40f0-8022-fab9ccabba91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:27.758184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30381ab-89b8-40f0-8022-fab9ccabba91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:27.758724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30381ab-89b8-40f0-8022-fab9ccabba91 admin admin] PATH_INFO: `/v3/users/cee81515fc154a4fa573fc0d689ff522` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:27.764516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30381ab-89b8-40f0-8022-fab9ccabba91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cee81515fc154a4fa573fc0d689ff522)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:27.769697 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30381ab-89b8-40f0-8022-fab9ccabba91 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:27.871150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e30381ab-89b8-40f0-8022-fab9ccabba91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cee81515fc154a4fa573fc0d689ff522'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:27.889295 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e30381ab-89b8-40f0-8022-fab9ccabba91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cee81515fc154a4fa573fc0d689ff522'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:27.896984 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e30381ab-89b8-40f0-8022-fab9ccabba91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cee81515fc154a4fa573fc0d689ff522'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:27.897793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e30381ab-89b8-40f0-8022-fab9ccabba91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cee81515fc154a4fa573fc0d689ff522'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:27.906125 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e30381ab-89b8-40f0-8022-fab9ccabba91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cee81515fc154a4fa573fc0d689ff522'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:27.929834 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1188/2345] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:08:27 2022] DELETE /identity/v3/users/cee81515fc154a4fa573fc0d689ff522 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:08:27.934540 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1fc96-aa1a-4ac8-a2f8-45d98ad73a1f None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:27.935378 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1fc96-aa1a-4ac8-a2f8-45d98ad73a1f None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:27.935576 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1fc96-aa1a-4ac8-a2f8-45d98ad73a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:27.959753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-ead1fc96-aa1a-4ac8-a2f8-45d98ad73a1f None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:08:27.961479 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ead1fc96-aa1a-4ac8-a2f8-45d98ad73a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:28.042514 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1158/2346] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:08:28.053822 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30381ab-89b8-40f0-8022-fab9ccabba91 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:28.055407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e30381ab-89b8-40f0-8022-fab9ccabba91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:28.117647 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30381ab-89b8-40f0-8022-fab9ccabba91 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:28.121516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5f8c1-0c81-40fb-8e28-b60b990cd1da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:28.122178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5f8c1-0c81-40fb-8e28-b60b990cd1da service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:28.122453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5f8c1-0c81-40fb-8e28-b60b990cd1da service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:28.122725 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5f8c1-0c81-40fb-8e28-b60b990cd1da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:28.133199 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5f8c1-0c81-40fb-8e28-b60b990cd1da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:28.134655 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5f8c1-0c81-40fb-8e28-b60b990cd1da service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:28.146168 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1189/2347] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:08:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:08:28.493462 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1fc96-aa1a-4ac8-a2f8-45d98ad73a1f None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:28.496237 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ead1fc96-aa1a-4ac8-a2f8-45d98ad73a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:28.515838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1fc96-aa1a-4ac8-a2f8-45d98ad73a1f None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:28.522880 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45099bab-69c3-462d-9205-c71311bdff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:28.524046 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45099bab-69c3-462d-9205-c71311bdff66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:28.524480 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45099bab-69c3-462d-9205-c71311bdff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:28.524901 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45099bab-69c3-462d-9205-c71311bdff66 admin admin] PATH_INFO: `/v3/projects/5973a9c329054e4392d3d931c1de4692` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:28.526484 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45099bab-69c3-462d-9205-c71311bdff66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5973a9c329054e4392d3d931c1de4692)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:28.528865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45099bab-69c3-462d-9205-c71311bdff66 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:28.599380 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-45099bab-69c3-462d-9205-c71311bdff66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5973a9c329054e4392d3d931c1de4692', 'request_id': 'req-45099bab-69c3-462d-9205-c71311bdff66'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:28.606669 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-45099bab-69c3-462d-9205-c71311bdff66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5973a9c329054e4392d3d931c1de4692', 'request_id': 'req-45099bab-69c3-462d-9205-c71311bdff66'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:28.612578 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-45099bab-69c3-462d-9205-c71311bdff66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5973a9c329054e4392d3d931c1de4692', 'request_id': 'req-45099bab-69c3-462d-9205-c71311bdff66'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:28.626341 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-45099bab-69c3-462d-9205-c71311bdff66 admin admin] The token cache is being invalidate because project 5973a9c329054e4392d3d931c1de4692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:08:28.626626 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-45099bab-69c3-462d-9205-c71311bdff66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:28.627346 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-45099bab-69c3-462d-9205-c71311bdff66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:28.629462 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1159/2348] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:08:28 2022] DELETE /identity/v3/projects/5973a9c329054e4392d3d931c1de4692 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:08:28.635142 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5f8c1-0c81-40fb-8e28-b60b990cd1da service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:28.646345 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5f8c1-0c81-40fb-8e28-b60b990cd1da service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:28.709986 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0159f1e-eeb4-4302-8a3b-072fa5f5eb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:28.710906 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0159f1e-eeb4-4302-8a3b-072fa5f5eb8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:28.711182 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0159f1e-eeb4-4302-8a3b-072fa5f5eb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:28.711456 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0159f1e-eeb4-4302-8a3b-072fa5f5eb8b admin admin] PATH_INFO: `/v3/users/3cd7f6c3ee904af0bf0f5d46841afcff` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:28.712819 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0159f1e-eeb4-4302-8a3b-072fa5f5eb8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cd7f6c3ee904af0bf0f5d46841afcff)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:28.715093 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0159f1e-eeb4-4302-8a3b-072fa5f5eb8b admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:28.775806 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-b0159f1e-eeb4-4302-8a3b-072fa5f5eb8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cd7f6c3ee904af0bf0f5d46841afcff'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:28.791244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-b0159f1e-eeb4-4302-8a3b-072fa5f5eb8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cd7f6c3ee904af0bf0f5d46841afcff'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:28.792144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-b0159f1e-eeb4-4302-8a3b-072fa5f5eb8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cd7f6c3ee904af0bf0f5d46841afcff'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:28.792955 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-b0159f1e-eeb4-4302-8a3b-072fa5f5eb8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cd7f6c3ee904af0bf0f5d46841afcff'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:28.803435 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-b0159f1e-eeb4-4302-8a3b-072fa5f5eb8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cd7f6c3ee904af0bf0f5d46841afcff'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:28.822094 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1190/2349] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:08:28 2022] DELETE /identity/v3/users/3cd7f6c3ee904af0bf0f5d46841afcff => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:08:29.285771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45099bab-69c3-462d-9205-c71311bdff66 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:29.287572 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-45099bab-69c3-462d-9205-c71311bdff66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:29.309243 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45099bab-69c3-462d-9205-c71311bdff66 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:29.396587 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef94cb0-c131-4d96-9df6-7af193124ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:29.397385 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef94cb0-c131-4d96-9df6-7af193124ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:29.397669 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef94cb0-c131-4d96-9df6-7af193124ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:29.397937 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef94cb0-c131-4d96-9df6-7af193124ee2 admin admin] PATH_INFO: `/v3/projects/5c1cbd129bc1453f9573b8e1f3c1dfcd` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:29.399256 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef94cb0-c131-4d96-9df6-7af193124ee2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c1cbd129bc1453f9573b8e1f3c1dfcd)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:29.401225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef94cb0-c131-4d96-9df6-7af193124ee2 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:29.485296 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-7ef94cb0-c131-4d96-9df6-7af193124ee2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c1cbd129bc1453f9573b8e1f3c1dfcd', 'request_id': 'req-7ef94cb0-c131-4d96-9df6-7af193124ee2'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:29.500103 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-7ef94cb0-c131-4d96-9df6-7af193124ee2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c1cbd129bc1453f9573b8e1f3c1dfcd', 'request_id': 'req-7ef94cb0-c131-4d96-9df6-7af193124ee2'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:29.517837 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-7ef94cb0-c131-4d96-9df6-7af193124ee2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c1cbd129bc1453f9573b8e1f3c1dfcd', 'request_id': 'req-7ef94cb0-c131-4d96-9df6-7af193124ee2'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:29.537473 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-7ef94cb0-c131-4d96-9df6-7af193124ee2 admin admin] The token cache is being invalidate because project 5c1cbd129bc1453f9573b8e1f3c1dfcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:08:29.537764 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-7ef94cb0-c131-4d96-9df6-7af193124ee2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:29.538485 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-7ef94cb0-c131-4d96-9df6-7af193124ee2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:08:29.540143 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1160/2350] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:08:29 2022] DELETE /identity/v3/projects/5c1cbd129bc1453f9573b8e1f3c1dfcd => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:08:29.547206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f60f3-2fb1-4ff0-b9c3-07da24d960af None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:29.547628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f60f3-2fb1-4ff0-b9c3-07da24d960af None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:29.547974 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f60f3-2fb1-4ff0-b9c3-07da24d960af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:29.574853 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-d99f60f3-2fb1-4ff0-b9c3-07da24d960af None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:08:29.576642 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-d99f60f3-2fb1-4ff0-b9c3-07da24d960af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:29.649830 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1191/2351] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:08:29.659126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a3cf2-7b8f-4ed8-b9a8-49141d62f1d0 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:29.659458 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a3cf2-7b8f-4ed8-b9a8-49141d62f1d0 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:29.659814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a3cf2-7b8f-4ed8-b9a8-49141d62f1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:29.682964 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-af6a3cf2-7b8f-4ed8-b9a8-49141d62f1d0 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:08:29.684227 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-af6a3cf2-7b8f-4ed8-b9a8-49141d62f1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:29.698870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1161/2352] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:08:29.701439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f60f3-2fb1-4ff0-b9c3-07da24d960af None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:29.713074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f60f3-2fb1-4ff0-b9c3-07da24d960af None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:29.719483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd612449-9d78-4735-b203-44acc344b41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:29.720185 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd612449-9d78-4735-b203-44acc344b41a admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:29.720496 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd612449-9d78-4735-b203-44acc344b41a admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:29.720854 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd612449-9d78-4735-b203-44acc344b41a admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:29.721684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd612449-9d78-4735-b203-44acc344b41a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:08:29.722527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd612449-9d78-4735-b203-44acc344b41a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:29.724466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd612449-9d78-4735-b203-44acc344b41a admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:29.739669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1192/2353] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:08:29.746933 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a3cf2-7b8f-4ed8-b9a8-49141d62f1d0 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:29.763605 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a3cf2-7b8f-4ed8-b9a8-49141d62f1d0 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:29.774484 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c951549-d893-4628-898b-6a2c81f1bd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:29.775896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951549-d893-4628-898b-6a2c81f1bd72 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:29.776397 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951549-d893-4628-898b-6a2c81f1bd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:29.776942 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951549-d893-4628-898b-6a2c81f1bd72 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:29.778611 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c951549-d893-4628-898b-6a2c81f1bd72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:29.783845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c951549-d893-4628-898b-6a2c81f1bd72 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:29.844729 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1162/2354] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:08:29 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:08:29.845541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd612449-9d78-4735-b203-44acc344b41a admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:29.861793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd612449-9d78-4735-b203-44acc344b41a admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:29.962665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43910819-7287-49fb-a4b5-fabe100b781f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:29.963649 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43910819-7287-49fb-a4b5-fabe100b781f admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:29.964069 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43910819-7287-49fb-a4b5-fabe100b781f admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:29.964480 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43910819-7287-49fb-a4b5-fabe100b781f admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:29.965550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43910819-7287-49fb-a4b5-fabe100b781f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:29.968487 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43910819-7287-49fb-a4b5-fabe100b781f admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:30.002886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1193/2355] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:08:29 2022] POST /identity/v3/users => generated 284 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:08:30.007110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c951549-d893-4628-898b-6a2c81f1bd72 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:30.023631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c951549-d893-4628-898b-6a2c81f1bd72 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:30.029525 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43363dc-1871-4071-869c-70ab81b08fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:30.030733 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43363dc-1871-4071-869c-70ab81b08fff admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:30.030733 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43363dc-1871-4071-869c-70ab81b08fff admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:30.031215 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43363dc-1871-4071-869c-70ab81b08fff admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:30.031768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43363dc-1871-4071-869c-70ab81b08fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:30.035219 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43363dc-1871-4071-869c-70ab81b08fff admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:30.047245 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1163/2356] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:08:30.052366 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43910819-7287-49fb-a4b5-fabe100b781f admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:30.073273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43910819-7287-49fb-a4b5-fabe100b781f admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:30.083150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c9796-cc91-43f0-9034-34338dc3b4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:30.084065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c9796-cc91-43f0-9034-34338dc3b4db admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:30.084490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c9796-cc91-43f0-9034-34338dc3b4db admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:30.084955 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c9796-cc91-43f0-9034-34338dc3b4db admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:30.085782 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c9796-cc91-43f0-9034-34338dc3b4db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:30.088059 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c9796-cc91-43f0-9034-34338dc3b4db admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:30.102405 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1194/2357] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:08:30.106624 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43363dc-1871-4071-869c-70ab81b08fff admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:30.118345 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43363dc-1871-4071-869c-70ab81b08fff admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:30.123853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ce887-d08e-4fc0-98d3-5ef2734e780d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:30.124760 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ce887-d08e-4fc0-98d3-5ef2734e780d admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:30.125041 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ce887-d08e-4fc0-98d3-5ef2734e780d admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:30.125312 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ce887-d08e-4fc0-98d3-5ef2734e780d admin admin] PATH_INFO: `/v3/projects/475e407554474b5e9b7447e6f180f3dd/users/e25e93188012404189804e5f6565f684/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:30.146799 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ce887-d08e-4fc0-98d3-5ef2734e780d admin admin] RBAC: Authorizing `identity:create_grant(project_id=475e407554474b5e9b7447e6f180f3dd, user_id=e25e93188012404189804e5f6565f684, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:30.154906 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ce887-d08e-4fc0-98d3-5ef2734e780d admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:30.177279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1164/2358] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:08:30 2022] PUT /identity/v3/projects/475e407554474b5e9b7447e6f180f3dd/users/e25e93188012404189804e5f6565f684/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:08:30.189927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6368fd7-9941-4068-bb3a-d921625ac513 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:30.190252 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6368fd7-9941-4068-bb3a-d921625ac513 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:30.191304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6368fd7-9941-4068-bb3a-d921625ac513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:30.229538 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-c6368fd7-9941-4068-bb3a-d921625ac513 None None] MFA Rules not processed for user `e25e93188012404189804e5f6565f684`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:08:30.231317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-c6368fd7-9941-4068-bb3a-d921625ac513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:30.376714 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1195/2359] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:08:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:08:30.390691 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ce887-d08e-4fc0-98d3-5ef2734e780d admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:30.394288 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-b07ce887-d08e-4fc0-98d3-5ef2734e780d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:30.531612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ce887-d08e-4fc0-98d3-5ef2734e780d admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:30.539106 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15299df0-65f3-4d6b-becd-7127b4a129ac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdd8008619d4ee3b8fe45e0e5241878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:30.540453 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15299df0-65f3-4d6b-becd-7127b4a129ac service glance] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:30.541223 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15299df0-65f3-4d6b-becd-7127b4a129ac service glance] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:30.541722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15299df0-65f3-4d6b-becd-7127b4a129ac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:30.562553 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15299df0-65f3-4d6b-becd-7127b4a129ac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:30.565690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15299df0-65f3-4d6b-becd-7127b4a129ac service glance] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:30.584471 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1165/2360] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:08:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:08:33.889706 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03020dbd-aca4-4c68-bb70-493e722196db None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:33.890296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03020dbd-aca4-4c68-bb70-493e722196db None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:33.890296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03020dbd-aca4-4c68-bb70-493e722196db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:33.923530 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-03020dbd-aca4-4c68-bb70-493e722196db None None] MFA Rules not processed for user `c1627da761c74fc79523a0fa319176b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:08:33.926238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-03020dbd-aca4-4c68-bb70-493e722196db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:34.005029 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1196/2361] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:08:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:08:39.022241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15299df0-65f3-4d6b-becd-7127b4a129ac service glance] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:39.025036 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-15299df0-65f3-4d6b-becd-7127b4a129ac service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:39.181429 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15299df0-65f3-4d6b-becd-7127b4a129ac service glance] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:39.190458 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819c278-f723-4bed-9c98-77eadfeef3ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908d23b035f14756b438b3a61a63b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:39.191595 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819c278-f723-4bed-9c98-77eadfeef3ee service placement] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:39.192057 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819c278-f723-4bed-9c98-77eadfeef3ee service placement] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:39.192513 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819c278-f723-4bed-9c98-77eadfeef3ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:39.195670 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-7819c278-f723-4bed-9c98-77eadfeef3ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:39.217746 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819c278-f723-4bed-9c98-77eadfeef3ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:39.220894 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819c278-f723-4bed-9c98-77eadfeef3ee service placement] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:39.240004 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1166/2362] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:08:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:08:40.035611 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473bcdc-1304-4ec7-b10d-f1b7886252aa None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:40.037761 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473bcdc-1304-4ec7-b10d-f1b7886252aa None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:40.038736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473bcdc-1304-4ec7-b10d-f1b7886252aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:40.073944 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-5473bcdc-1304-4ec7-b10d-f1b7886252aa None None] MFA Rules not processed for user `0c04f5fb770d49c0a50f2cfbd77e17e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:08:40.076076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-5473bcdc-1304-4ec7-b10d-f1b7886252aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:40.220087 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1197/2363] 10.222.0.73 () {58 vars in 1009 bytes} [Fri May 13 15:08:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:08:40.242433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819c278-f723-4bed-9c98-77eadfeef3ee service placement] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:08:40.246209 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-7819c278-f723-4bed-9c98-77eadfeef3ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:08:40.384773 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819c278-f723-4bed-9c98-77eadfeef3ee service placement] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:08:40.398137 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537897c-8d6c-450e-b5bd-9e2723ac71c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27265a0c2e6b47c09f28b9cd3ac47d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:08:40.399872 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537897c-8d6c-450e-b5bd-9e2723ac71c3 service swift] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:08:40.400406 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537897c-8d6c-450e-b5bd-9e2723ac71c3 service swift] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:08:40.400908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537897c-8d6c-450e-b5bd-9e2723ac71c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:08:40.415845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537897c-8d6c-450e-b5bd-9e2723ac71c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:08:40.417992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537897c-8d6c-450e-b5bd-9e2723ac71c3 service swift] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:08:40.434529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1167/2364] 10.222.0.73 () {60 vars in 1384 bytes} [Fri May 13 15:08:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 15:09:02.138359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab920882-4f20-42ab-b4b6-e4a143b3e2ec None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:02.139001 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab920882-4f20-42ab-b4b6-e4a143b3e2ec None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:02.139001 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab920882-4f20-42ab-b4b6-e4a143b3e2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:02.158057 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-ab920882-4f20-42ab-b4b6-e4a143b3e2ec None None] MFA Rules not processed for user `0c04f5fb770d49c0a50f2cfbd77e17e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:09:02.159404 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ab920882-4f20-42ab-b4b6-e4a143b3e2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:02.166807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1198/2365] 10.222.0.73 () {58 vars in 967 bytes} [Fri May 13 15:09:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:09:02.179631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537897c-8d6c-450e-b5bd-9e2723ac71c3 service swift] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:02.191223 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537897c-8d6c-450e-b5bd-9e2723ac71c3 service swift] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:02.196972 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d2f51-8a3b-4289-84f8-3ffd9f0e8606 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27265a0c2e6b47c09f28b9cd3ac47d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:02.197631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d2f51-8a3b-4289-84f8-3ffd9f0e8606 service swift] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:02.197912 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d2f51-8a3b-4289-84f8-3ffd9f0e8606 service swift] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:02.198189 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d2f51-8a3b-4289-84f8-3ffd9f0e8606 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:02.208529 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d2f51-8a3b-4289-84f8-3ffd9f0e8606 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:02.210160 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d2f51-8a3b-4289-84f8-3ffd9f0e8606 service swift] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:02.220388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1168/2366] 10.222.0.73 () {60 vars in 1384 bytes} [Fri May 13 15:09:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 15:09:04.252350 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab920882-4f20-42ab-b4b6-e4a143b3e2ec None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:04.254486 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ab920882-4f20-42ab-b4b6-e4a143b3e2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:04.337704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab920882-4f20-42ab-b4b6-e4a143b3e2ec None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:04.343358 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662065c-50b7-41a6-974a-57b94c4d8ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:04.344269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662065c-50b7-41a6-974a-57b94c4d8ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:04.344614 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662065c-50b7-41a6-974a-57b94c4d8ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:04.344893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662065c-50b7-41a6-974a-57b94c4d8ff9 admin admin] PATH_INFO: `/v3/users/1a01e9f4844940af9d8b112eb8d9efdc` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:04.346138 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662065c-50b7-41a6-974a-57b94c4d8ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a01e9f4844940af9d8b112eb8d9efdc)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:04.348378 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662065c-50b7-41a6-974a-57b94c4d8ff9 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:04.408825 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-c662065c-50b7-41a6-974a-57b94c4d8ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a01e9f4844940af9d8b112eb8d9efdc'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:04.432806 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-c662065c-50b7-41a6-974a-57b94c4d8ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a01e9f4844940af9d8b112eb8d9efdc'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:04.433649 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-c662065c-50b7-41a6-974a-57b94c4d8ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a01e9f4844940af9d8b112eb8d9efdc'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:04.434347 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-c662065c-50b7-41a6-974a-57b94c4d8ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a01e9f4844940af9d8b112eb8d9efdc'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:04.445671 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-c662065c-50b7-41a6-974a-57b94c4d8ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a01e9f4844940af9d8b112eb8d9efdc'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:04.462844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1199/2367] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:09:04 2022] DELETE /identity/v3/users/1a01e9f4844940af9d8b112eb8d9efdc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:09:04.741735 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d2f51-8a3b-4289-84f8-3ffd9f0e8606 service swift] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:04.757745 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d2f51-8a3b-4289-84f8-3ffd9f0e8606 service swift] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:04.833670 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16f33e-0042-4878-b51c-55d674f01e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:04.834648 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16f33e-0042-4878-b51c-55d674f01e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:04.834978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16f33e-0042-4878-b51c-55d674f01e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:04.835257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16f33e-0042-4878-b51c-55d674f01e96 admin admin] PATH_INFO: `/v3/projects/9f120d52dd5b4fbf9c5226f1fa7a26ea` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:04.836481 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16f33e-0042-4878-b51c-55d674f01e96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f120d52dd5b4fbf9c5226f1fa7a26ea)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:04.839223 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16f33e-0042-4878-b51c-55d674f01e96 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:04.895895 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ec16f33e-0042-4878-b51c-55d674f01e96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f120d52dd5b4fbf9c5226f1fa7a26ea', 'request_id': 'req-ec16f33e-0042-4878-b51c-55d674f01e96'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:04.902232 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ec16f33e-0042-4878-b51c-55d674f01e96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f120d52dd5b4fbf9c5226f1fa7a26ea', 'request_id': 'req-ec16f33e-0042-4878-b51c-55d674f01e96'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:04.908518 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ec16f33e-0042-4878-b51c-55d674f01e96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f120d52dd5b4fbf9c5226f1fa7a26ea', 'request_id': 'req-ec16f33e-0042-4878-b51c-55d674f01e96'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:04.925752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ec16f33e-0042-4878-b51c-55d674f01e96 admin admin] The token cache is being invalidate because project 9f120d52dd5b4fbf9c5226f1fa7a26ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:09:04.926049 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ec16f33e-0042-4878-b51c-55d674f01e96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:04.926791 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-ec16f33e-0042-4878-b51c-55d674f01e96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:04.929827 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1169/2368] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:09:04 2022] DELETE /identity/v3/projects/9f120d52dd5b4fbf9c5226f1fa7a26ea => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:09:04.934839 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970301e3-0c22-41ec-8a9b-bbe85eb63bc2 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:04.935135 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970301e3-0c22-41ec-8a9b-bbe85eb63bc2 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:04.935412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970301e3-0c22-41ec-8a9b-bbe85eb63bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:04.960800 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-970301e3-0c22-41ec-8a9b-bbe85eb63bc2 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:09:04.962962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-970301e3-0c22-41ec-8a9b-bbe85eb63bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:05.060961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1200/2369] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:09:05.073958 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd68bdf-4af2-4db3-b3e6-1c105f4f30ca None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:05.074427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd68bdf-4af2-4db3-b3e6-1c105f4f30ca None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:05.075042 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd68bdf-4af2-4db3-b3e6-1c105f4f30ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:05.103575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-fdd68bdf-4af2-4db3-b3e6-1c105f4f30ca None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:09:05.105565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-fdd68bdf-4af2-4db3-b3e6-1c105f4f30ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:05.118588 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1170/2370] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:09:05.124453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970301e3-0c22-41ec-8a9b-bbe85eb63bc2 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:05.135134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970301e3-0c22-41ec-8a9b-bbe85eb63bc2 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:05.140385 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637acf6-70ba-44be-b577-95d9ad076686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:05.141057 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637acf6-70ba-44be-b577-95d9ad076686 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:05.141850 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637acf6-70ba-44be-b577-95d9ad076686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:05.142137 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637acf6-70ba-44be-b577-95d9ad076686 admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:05.142906 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637acf6-70ba-44be-b577-95d9ad076686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:09:05.143212 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637acf6-70ba-44be-b577-95d9ad076686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:05.144827 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637acf6-70ba-44be-b577-95d9ad076686 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:05.158675 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1201/2371] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 15:09:05.163590 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd68bdf-4af2-4db3-b3e6-1c105f4f30ca None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:05.174178 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd68bdf-4af2-4db3-b3e6-1c105f4f30ca None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:05.179556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18b6d0-c7e5-4914-bc98-ef29a2a86b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:05.180231 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18b6d0-c7e5-4914-bc98-ef29a2a86b60 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:05.180695 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18b6d0-c7e5-4914-bc98-ef29a2a86b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:05.181000 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18b6d0-c7e5-4914-bc98-ef29a2a86b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:05.181701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18b6d0-c7e5-4914-bc98-ef29a2a86b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:05.183862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18b6d0-c7e5-4914-bc98-ef29a2a86b60 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:05.216229 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1171/2372] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:09:05 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:09:05.221141 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637acf6-70ba-44be-b577-95d9ad076686 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:05.231583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637acf6-70ba-44be-b577-95d9ad076686 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:05.337238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb3d90-e743-4fa9-96fe-b1b2cb51a30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:05.338270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb3d90-e743-4fa9-96fe-b1b2cb51a30b admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:05.338764 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb3d90-e743-4fa9-96fe-b1b2cb51a30b admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:05.339292 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb3d90-e743-4fa9-96fe-b1b2cb51a30b admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:05.340679 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb3d90-e743-4fa9-96fe-b1b2cb51a30b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:05.344481 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb3d90-e743-4fa9-96fe-b1b2cb51a30b admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:05.379597 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1202/2373] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:09:05 2022] POST /identity/v3/users => generated 295 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:09:05.381760 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18b6d0-c7e5-4914-bc98-ef29a2a86b60 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:05.399870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18b6d0-c7e5-4914-bc98-ef29a2a86b60 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:05.407257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6616d-cb7b-4ec9-8d41-2a8ebffdc306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:05.408367 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6616d-cb7b-4ec9-8d41-2a8ebffdc306 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:05.408844 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6616d-cb7b-4ec9-8d41-2a8ebffdc306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:05.409313 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6616d-cb7b-4ec9-8d41-2a8ebffdc306 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:05.410613 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6616d-cb7b-4ec9-8d41-2a8ebffdc306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:05.413588 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6616d-cb7b-4ec9-8d41-2a8ebffdc306 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:05.429395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1172/2374] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:09:05.433918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb3d90-e743-4fa9-96fe-b1b2cb51a30b admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:05.446877 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb3d90-e743-4fa9-96fe-b1b2cb51a30b admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:05.452256 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb094a-ccb1-4238-888f-b9449cc9ebc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:05.452995 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb094a-ccb1-4238-888f-b9449cc9ebc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:05.453249 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb094a-ccb1-4238-888f-b9449cc9ebc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:05.453525 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb094a-ccb1-4238-888f-b9449cc9ebc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:05.454808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb094a-ccb1-4238-888f-b9449cc9ebc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:05.456455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb094a-ccb1-4238-888f-b9449cc9ebc6 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:05.467156 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1203/2375] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:09:05.471524 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6616d-cb7b-4ec9-8d41-2a8ebffdc306 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:05.481865 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6616d-cb7b-4ec9-8d41-2a8ebffdc306 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:05.487176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0122e53-41b2-4764-8ffb-dede49ba5bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:05.488115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0122e53-41b2-4764-8ffb-dede49ba5bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:05.488403 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0122e53-41b2-4764-8ffb-dede49ba5bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:05.488673 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0122e53-41b2-4764-8ffb-dede49ba5bd5 admin admin] PATH_INFO: `/v3/projects/d15b99342e84422497bbfa47227f072d/users/4e5c9b55b56b4d5f819319097965bcdd/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:05.505686 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0122e53-41b2-4764-8ffb-dede49ba5bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d15b99342e84422497bbfa47227f072d, user_id=4e5c9b55b56b4d5f819319097965bcdd, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:05.508449 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0122e53-41b2-4764-8ffb-dede49ba5bd5 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:05.528060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1173/2376] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:09:05 2022] PUT /identity/v3/projects/d15b99342e84422497bbfa47227f072d/users/4e5c9b55b56b4d5f819319097965bcdd/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:09:05.542494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd1e57-0323-428d-86bd-29b7b61a567a None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:05.542770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd1e57-0323-428d-86bd-29b7b61a567a None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:05.543103 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd1e57-0323-428d-86bd-29b7b61a567a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:05.573582 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-e7bd1e57-0323-428d-86bd-29b7b61a567a None None] MFA Rules not processed for user `4e5c9b55b56b4d5f819319097965bcdd`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:09:05.574809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e7bd1e57-0323-428d-86bd-29b7b61a567a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:05.644598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1204/2377] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:09:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:09:05.655785 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0122e53-41b2-4764-8ffb-dede49ba5bd5 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:05.657798 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c0122e53-41b2-4764-8ffb-dede49ba5bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:05.725003 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0122e53-41b2-4764-8ffb-dede49ba5bd5 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:05.731227 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380df17-47e4-4771-8b7d-e04d49daa5cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:05.732311 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380df17-47e4-4771-8b7d-e04d49daa5cf service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:05.732804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380df17-47e4-4771-8b7d-e04d49daa5cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:05.733289 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380df17-47e4-4771-8b7d-e04d49daa5cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:05.748698 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380df17-47e4-4771-8b7d-e04d49daa5cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:05.751983 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380df17-47e4-4771-8b7d-e04d49daa5cf service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:05.768258 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1174/2378] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:09:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:09:40.759189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd1e57-0323-428d-86bd-29b7b61a567a None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:40.821825 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd1e57-0323-428d-86bd-29b7b61a567a None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:40.826328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0d955-7e23-4510-a3d0-cb89bfc6958f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:40.827259 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0d955-7e23-4510-a3d0-cb89bfc6958f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:40.827538 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0d955-7e23-4510-a3d0-cb89bfc6958f admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:40.827807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0d955-7e23-4510-a3d0-cb89bfc6958f admin admin] PATH_INFO: `/v3/users/4e5c9b55b56b4d5f819319097965bcdd` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:40.829022 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0d955-7e23-4510-a3d0-cb89bfc6958f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e5c9b55b56b4d5f819319097965bcdd)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:40.831196 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0d955-7e23-4510-a3d0-cb89bfc6958f admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:40.884384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e2a0d955-7e23-4510-a3d0-cb89bfc6958f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e5c9b55b56b4d5f819319097965bcdd'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:40.897890 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e2a0d955-7e23-4510-a3d0-cb89bfc6958f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e5c9b55b56b4d5f819319097965bcdd'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:40.898750 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e2a0d955-7e23-4510-a3d0-cb89bfc6958f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e5c9b55b56b4d5f819319097965bcdd'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:40.899506 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e2a0d955-7e23-4510-a3d0-cb89bfc6958f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e5c9b55b56b4d5f819319097965bcdd'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:40.907930 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e2a0d955-7e23-4510-a3d0-cb89bfc6958f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e5c9b55b56b4d5f819319097965bcdd'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:40.928764 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1205/2379] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:09:40 2022] DELETE /identity/v3/users/4e5c9b55b56b4d5f819319097965bcdd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:09:40.934394 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9303f67-49d8-41ae-9e0b-8b61de64f1c3 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:40.935287 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9303f67-49d8-41ae-9e0b-8b61de64f1c3 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:40.935287 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9303f67-49d8-41ae-9e0b-8b61de64f1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:40.956740 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-a9303f67-49d8-41ae-9e0b-8b61de64f1c3 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:09:40.958396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-a9303f67-49d8-41ae-9e0b-8b61de64f1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:41.045453 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1175/2380] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:09:41.068387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0d955-7e23-4510-a3d0-cb89bfc6958f admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:41.069899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e2a0d955-7e23-4510-a3d0-cb89bfc6958f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:41.133766 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0d955-7e23-4510-a3d0-cb89bfc6958f admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:41.137466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e556ae-8fe2-4ae4-85ad-034fdcd3136a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:41.138131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e556ae-8fe2-4ae4-85ad-034fdcd3136a service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:41.138410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e556ae-8fe2-4ae4-85ad-034fdcd3136a service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:41.138688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e556ae-8fe2-4ae4-85ad-034fdcd3136a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:41.149261 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e556ae-8fe2-4ae4-85ad-034fdcd3136a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:41.150707 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e556ae-8fe2-4ae4-85ad-034fdcd3136a service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:41.161744 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1206/2381] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:09:41.500890 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9303f67-49d8-41ae-9e0b-8b61de64f1c3 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:41.502497 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-a9303f67-49d8-41ae-9e0b-8b61de64f1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:41.520053 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9303f67-49d8-41ae-9e0b-8b61de64f1c3 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:41.527085 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50f5c3-a9de-4781-a91b-5656b6d5c924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:41.528713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50f5c3-a9de-4781-a91b-5656b6d5c924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:41.529174 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50f5c3-a9de-4781-a91b-5656b6d5c924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:41.529653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50f5c3-a9de-4781-a91b-5656b6d5c924 admin admin] PATH_INFO: `/v3/projects/d15b99342e84422497bbfa47227f072d` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:41.532336 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50f5c3-a9de-4781-a91b-5656b6d5c924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d15b99342e84422497bbfa47227f072d)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:41.535164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50f5c3-a9de-4781-a91b-5656b6d5c924 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:41.593543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2d50f5c3-a9de-4781-a91b-5656b6d5c924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd15b99342e84422497bbfa47227f072d', 'request_id': 'req-2d50f5c3-a9de-4781-a91b-5656b6d5c924'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:41.600074 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2d50f5c3-a9de-4781-a91b-5656b6d5c924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd15b99342e84422497bbfa47227f072d', 'request_id': 'req-2d50f5c3-a9de-4781-a91b-5656b6d5c924'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:41.605983 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2d50f5c3-a9de-4781-a91b-5656b6d5c924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd15b99342e84422497bbfa47227f072d', 'request_id': 'req-2d50f5c3-a9de-4781-a91b-5656b6d5c924'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:41.619695 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2d50f5c3-a9de-4781-a91b-5656b6d5c924 admin admin] The token cache is being invalidate because project d15b99342e84422497bbfa47227f072d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:09:41.620189 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2d50f5c3-a9de-4781-a91b-5656b6d5c924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:41.621017 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2d50f5c3-a9de-4781-a91b-5656b6d5c924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:41.622692 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1176/2382] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:09:41 2022] DELETE /identity/v3/projects/d15b99342e84422497bbfa47227f072d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:09:41.629230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0eea3-ce1e-4491-884d-b67ba8414091 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:41.629521 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0eea3-ce1e-4491-884d-b67ba8414091 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:41.629798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0eea3-ce1e-4491-884d-b67ba8414091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:41.648936 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-89e0eea3-ce1e-4491-884d-b67ba8414091 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:09:41.650243 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-89e0eea3-ce1e-4491-884d-b67ba8414091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:41.715813 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1207/2383] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:09:41.725214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cea392-7ba7-4e44-ad0b-5c0cc7acb76b None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:41.725619 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cea392-7ba7-4e44-ad0b-5c0cc7acb76b None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:41.725916 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cea392-7ba7-4e44-ad0b-5c0cc7acb76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:41.745099 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-c8cea392-7ba7-4e44-ad0b-5c0cc7acb76b None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:09:41.746332 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c8cea392-7ba7-4e44-ad0b-5c0cc7acb76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:41.754764 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1177/2384] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:09:41.759262 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0eea3-ce1e-4491-884d-b67ba8414091 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:41.770176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0eea3-ce1e-4491-884d-b67ba8414091 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:41.774972 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb32bac-7a3d-4571-a401-53c17d3c64f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:41.775651 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb32bac-7a3d-4571-a401-53c17d3c64f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:41.775933 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb32bac-7a3d-4571-a401-53c17d3c64f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:41.776208 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb32bac-7a3d-4571-a401-53c17d3c64f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:41.776943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb32bac-7a3d-4571-a401-53c17d3c64f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:09:41.777251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb32bac-7a3d-4571-a401-53c17d3c64f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:41.778908 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb32bac-7a3d-4571-a401-53c17d3c64f3 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:41.794501 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1208/2385] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:09:41.799533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cea392-7ba7-4e44-ad0b-5c0cc7acb76b None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:41.809505 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cea392-7ba7-4e44-ad0b-5c0cc7acb76b None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:41.814337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107042d-58ae-49ae-a88c-582e7f5c3c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:41.815047 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107042d-58ae-49ae-a88c-582e7f5c3c8d admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:41.815326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107042d-58ae-49ae-a88c-582e7f5c3c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:41.815599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107042d-58ae-49ae-a88c-582e7f5c3c8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:41.816305 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107042d-58ae-49ae-a88c-582e7f5c3c8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:41.818234 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107042d-58ae-49ae-a88c-582e7f5c3c8d admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:41.848119 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1178/2386] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:09:41 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:09:41.852337 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb32bac-7a3d-4571-a401-53c17d3c64f3 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:41.862436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb32bac-7a3d-4571-a401-53c17d3c64f3 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:41.920616 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7a40a-27bd-4a96-9042-fc0e2d46058c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:41.921307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7a40a-27bd-4a96-9042-fc0e2d46058c admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:41.921584 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7a40a-27bd-4a96-9042-fc0e2d46058c admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:41.921856 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7a40a-27bd-4a96-9042-fc0e2d46058c admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:41.922549 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7a40a-27bd-4a96-9042-fc0e2d46058c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:41.924796 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7a40a-27bd-4a96-9042-fc0e2d46058c admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:41.945554 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1209/2387] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:09:41 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:09:41.949922 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107042d-58ae-49ae-a88c-582e7f5c3c8d admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:41.961206 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107042d-58ae-49ae-a88c-582e7f5c3c8d admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:41.966058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b9bac-0eef-4458-94bf-a9325ac388a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:41.966737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b9bac-0eef-4458-94bf-a9325ac388a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:41.967060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b9bac-0eef-4458-94bf-a9325ac388a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:41.967388 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b9bac-0eef-4458-94bf-a9325ac388a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:41.968637 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b9bac-0eef-4458-94bf-a9325ac388a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:41.970246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b9bac-0eef-4458-94bf-a9325ac388a6 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:41.981424 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1179/2388] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:09:41.986440 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7a40a-27bd-4a96-9042-fc0e2d46058c admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:41.996650 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7a40a-27bd-4a96-9042-fc0e2d46058c admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:42.001401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840b365-d905-4844-a170-d624cac03d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:42.002078 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840b365-d905-4844-a170-d624cac03d13 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:42.002352 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840b365-d905-4844-a170-d624cac03d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:42.002624 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840b365-d905-4844-a170-d624cac03d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:42.003388 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840b365-d905-4844-a170-d624cac03d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:42.004996 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840b365-d905-4844-a170-d624cac03d13 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:42.016365 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1210/2389] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:09:42.020803 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b9bac-0eef-4458-94bf-a9325ac388a6 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:42.032146 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b9bac-0eef-4458-94bf-a9325ac388a6 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:42.036944 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341627f-77ef-4a81-bbc7-e307bd810367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:42.037878 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341627f-77ef-4a81-bbc7-e307bd810367 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:42.038158 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341627f-77ef-4a81-bbc7-e307bd810367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:42.038432 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341627f-77ef-4a81-bbc7-e307bd810367 admin admin] PATH_INFO: `/v3/projects/afca0c5c318c44c9aabae057a856ff86/users/37ad5c3cff984893a1207635de0418f6/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:42.055585 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341627f-77ef-4a81-bbc7-e307bd810367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afca0c5c318c44c9aabae057a856ff86, user_id=37ad5c3cff984893a1207635de0418f6, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:42.058212 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341627f-77ef-4a81-bbc7-e307bd810367 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:42.073981 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1180/2390] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:09:42 2022] PUT /identity/v3/projects/afca0c5c318c44c9aabae057a856ff86/users/37ad5c3cff984893a1207635de0418f6/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:09:42.080452 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9465d2-b542-41bd-895e-e73a93e26ba2 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:42.080848 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9465d2-b542-41bd-895e-e73a93e26ba2 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:42.081143 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9465d2-b542-41bd-895e-e73a93e26ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:42.105785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-6e9465d2-b542-41bd-895e-e73a93e26ba2 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:09:42.107787 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-6e9465d2-b542-41bd-895e-e73a93e26ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:42.193297 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1211/2391] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:09:42.205519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341627f-77ef-4a81-bbc7-e307bd810367 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:42.209891 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-2341627f-77ef-4a81-bbc7-e307bd810367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:42.295752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341627f-77ef-4a81-bbc7-e307bd810367 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:42.300632 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24250917-baac-4e47-a48c-63d2bd79d500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:42.302490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24250917-baac-4e47-a48c-63d2bd79d500 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:42.302490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24250917-baac-4e47-a48c-63d2bd79d500 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:42.302490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24250917-baac-4e47-a48c-63d2bd79d500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:42.315429 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24250917-baac-4e47-a48c-63d2bd79d500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:42.317296 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24250917-baac-4e47-a48c-63d2bd79d500 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:42.329191 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1181/2392] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:09:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:09:43.274725 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9465d2-b542-41bd-895e-e73a93e26ba2 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:43.276463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-6e9465d2-b542-41bd-895e-e73a93e26ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:43.292188 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9465d2-b542-41bd-895e-e73a93e26ba2 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:43.298221 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb5265-82ae-453a-8de7-85721e0e7584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:43.299495 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb5265-82ae-453a-8de7-85721e0e7584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:43.299795 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb5265-82ae-453a-8de7-85721e0e7584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:43.300067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb5265-82ae-453a-8de7-85721e0e7584 admin admin] PATH_INFO: `/v3/users/e25e93188012404189804e5f6565f684` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:43.301339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb5265-82ae-453a-8de7-85721e0e7584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e25e93188012404189804e5f6565f684)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:43.303526 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb5265-82ae-453a-8de7-85721e0e7584 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:43.391056 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-a3eb5265-82ae-453a-8de7-85721e0e7584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e25e93188012404189804e5f6565f684'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:43.415097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-a3eb5265-82ae-453a-8de7-85721e0e7584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e25e93188012404189804e5f6565f684'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:43.415971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-a3eb5265-82ae-453a-8de7-85721e0e7584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e25e93188012404189804e5f6565f684'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:43.416648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-a3eb5265-82ae-453a-8de7-85721e0e7584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e25e93188012404189804e5f6565f684'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:43.425334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-a3eb5265-82ae-453a-8de7-85721e0e7584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e25e93188012404189804e5f6565f684'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:43.440082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1212/2393] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:09:43 2022] DELETE /identity/v3/users/e25e93188012404189804e5f6565f684 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:09:43.445987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa403aa9-ac5d-4798-b9cf-9e226abc16c0 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:43.446574 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa403aa9-ac5d-4798-b9cf-9e226abc16c0 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:43.446691 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa403aa9-ac5d-4798-b9cf-9e226abc16c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:43.465271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-fa403aa9-ac5d-4798-b9cf-9e226abc16c0 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:09:43.466523 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-fa403aa9-ac5d-4798-b9cf-9e226abc16c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:43.541081 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1182/2394] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:09:43.554722 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb5265-82ae-453a-8de7-85721e0e7584 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:43.556636 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a3eb5265-82ae-453a-8de7-85721e0e7584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:43.656986 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb5265-82ae-453a-8de7-85721e0e7584 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:43.662731 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca62124-0e5e-4e32-b388-f7179456ed88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:43.664313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca62124-0e5e-4e32-b388-f7179456ed88 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:43.664313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca62124-0e5e-4e32-b388-f7179456ed88 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:43.664696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca62124-0e5e-4e32-b388-f7179456ed88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:43.677838 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca62124-0e5e-4e32-b388-f7179456ed88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:43.679936 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca62124-0e5e-4e32-b388-f7179456ed88 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:43.693524 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1213/2395] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:09:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:09:44.292576 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa403aa9-ac5d-4798-b9cf-9e226abc16c0 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:44.294544 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-fa403aa9-ac5d-4798-b9cf-9e226abc16c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:44.310662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa403aa9-ac5d-4798-b9cf-9e226abc16c0 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:44.317850 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28258224-4a72-4a7c-a0b8-0fc0abaad9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:44.318767 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28258224-4a72-4a7c-a0b8-0fc0abaad9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:44.319088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28258224-4a72-4a7c-a0b8-0fc0abaad9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:44.319361 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28258224-4a72-4a7c-a0b8-0fc0abaad9cc admin admin] PATH_INFO: `/v3/projects/475e407554474b5e9b7447e6f180f3dd` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:44.320683 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28258224-4a72-4a7c-a0b8-0fc0abaad9cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=475e407554474b5e9b7447e6f180f3dd)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:44.322806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28258224-4a72-4a7c-a0b8-0fc0abaad9cc admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:44.388363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-28258224-4a72-4a7c-a0b8-0fc0abaad9cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '475e407554474b5e9b7447e6f180f3dd', 'request_id': 'req-28258224-4a72-4a7c-a0b8-0fc0abaad9cc'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:44.407415 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-28258224-4a72-4a7c-a0b8-0fc0abaad9cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '475e407554474b5e9b7447e6f180f3dd', 'request_id': 'req-28258224-4a72-4a7c-a0b8-0fc0abaad9cc'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:44.414677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-28258224-4a72-4a7c-a0b8-0fc0abaad9cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '475e407554474b5e9b7447e6f180f3dd', 'request_id': 'req-28258224-4a72-4a7c-a0b8-0fc0abaad9cc'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:44.432064 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-28258224-4a72-4a7c-a0b8-0fc0abaad9cc admin admin] The token cache is being invalidate because project 475e407554474b5e9b7447e6f180f3dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:09:44.432396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-28258224-4a72-4a7c-a0b8-0fc0abaad9cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:44.433153 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-28258224-4a72-4a7c-a0b8-0fc0abaad9cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:09:44.435383 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1183/2396] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:09:44 2022] DELETE /identity/v3/projects/475e407554474b5e9b7447e6f180f3dd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:09:44.445077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21165bbd-7bab-4ca4-8358-d04b606d2754 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:44.446681 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21165bbd-7bab-4ca4-8358-d04b606d2754 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:44.447105 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21165bbd-7bab-4ca4-8358-d04b606d2754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:44.479343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-21165bbd-7bab-4ca4-8358-d04b606d2754 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:09:44.480871 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-21165bbd-7bab-4ca4-8358-d04b606d2754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:44.562772 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1214/2397] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:09:44.572338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65372f80-5560-4fb0-a55d-2dd85eb927df None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:44.572932 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65372f80-5560-4fb0-a55d-2dd85eb927df None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:44.573351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65372f80-5560-4fb0-a55d-2dd85eb927df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:44.619321 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-65372f80-5560-4fb0-a55d-2dd85eb927df None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:09:44.622656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-65372f80-5560-4fb0-a55d-2dd85eb927df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:44.639040 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1184/2398] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:09:44.644246 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21165bbd-7bab-4ca4-8358-d04b606d2754 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:44.663556 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21165bbd-7bab-4ca4-8358-d04b606d2754 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:44.671278 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f167c0-564c-42c0-9769-a822dd34b01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:44.672095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f167c0-564c-42c0-9769-a822dd34b01b admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:44.672448 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f167c0-564c-42c0-9769-a822dd34b01b admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:44.672797 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f167c0-564c-42c0-9769-a822dd34b01b admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:44.673674 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f167c0-564c-42c0-9769-a822dd34b01b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:09:44.674313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f167c0-564c-42c0-9769-a822dd34b01b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:44.676110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f167c0-564c-42c0-9769-a822dd34b01b admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:44.691088 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1215/2399] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:09:44.697375 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65372f80-5560-4fb0-a55d-2dd85eb927df None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:44.708726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65372f80-5560-4fb0-a55d-2dd85eb927df None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:44.713844 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9b671-d77f-4b4d-aed9-567dc4299342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:44.715103 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9b671-d77f-4b4d-aed9-567dc4299342 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:44.715539 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9b671-d77f-4b4d-aed9-567dc4299342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:44.715830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9b671-d77f-4b4d-aed9-567dc4299342 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:44.716627 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9b671-d77f-4b4d-aed9-567dc4299342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:44.719279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9b671-d77f-4b4d-aed9-567dc4299342 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:44.763137 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1185/2400] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:09:44 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:09:44.768542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f167c0-564c-42c0-9769-a822dd34b01b admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:44.785930 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f167c0-564c-42c0-9769-a822dd34b01b admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:44.872477 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80155bb5-8cd0-415d-bc24-caf135a9b0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:44.873207 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80155bb5-8cd0-415d-bc24-caf135a9b0aa admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:44.873543 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80155bb5-8cd0-415d-bc24-caf135a9b0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:44.873814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80155bb5-8cd0-415d-bc24-caf135a9b0aa admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:44.874507 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80155bb5-8cd0-415d-bc24-caf135a9b0aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:44.876534 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80155bb5-8cd0-415d-bc24-caf135a9b0aa admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:44.903104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1216/2401] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:09:44 2022] POST /identity/v3/users => generated 291 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:09:44.908448 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9b671-d77f-4b4d-aed9-567dc4299342 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:44.929033 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9b671-d77f-4b4d-aed9-567dc4299342 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:44.937588 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2c141-df6c-46d1-b0ee-7934c71748bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:44.938989 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2c141-df6c-46d1-b0ee-7934c71748bd admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:44.939600 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2c141-df6c-46d1-b0ee-7934c71748bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:44.940187 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2c141-df6c-46d1-b0ee-7934c71748bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:44.941697 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2c141-df6c-46d1-b0ee-7934c71748bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:44.945039 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2c141-df6c-46d1-b0ee-7934c71748bd admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:44.966778 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1186/2402] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:09:44.971111 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80155bb5-8cd0-415d-bc24-caf135a9b0aa admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:44.982869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80155bb5-8cd0-415d-bc24-caf135a9b0aa admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:44.988089 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e3658-b612-47be-9560-b23190369b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:44.988836 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e3658-b612-47be-9560-b23190369b6f admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:44.989250 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e3658-b612-47be-9560-b23190369b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:44.989447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e3658-b612-47be-9560-b23190369b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:44.990262 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e3658-b612-47be-9560-b23190369b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:44.992243 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e3658-b612-47be-9560-b23190369b6f admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:45.004156 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1217/2403] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:09:45.010881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2c141-df6c-46d1-b0ee-7934c71748bd admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:45.031255 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2c141-df6c-46d1-b0ee-7934c71748bd admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:45.041754 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa4651-79fe-4959-9627-bb66f0e77f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:45.043442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa4651-79fe-4959-9627-bb66f0e77f15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:45.044085 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa4651-79fe-4959-9627-bb66f0e77f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:45.044738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa4651-79fe-4959-9627-bb66f0e77f15 admin admin] PATH_INFO: `/v3/projects/96f8297688b74593b49fe8317741dc63/users/99fb6525fa854bc885f9966f5fc80407/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:45.080398 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa4651-79fe-4959-9627-bb66f0e77f15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f8297688b74593b49fe8317741dc63, user_id=99fb6525fa854bc885f9966f5fc80407, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:45.086110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa4651-79fe-4959-9627-bb66f0e77f15 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:45.145848 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1187/2404] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:09:45 2022] PUT /identity/v3/projects/96f8297688b74593b49fe8317741dc63/users/99fb6525fa854bc885f9966f5fc80407/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:09:45.148916 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e37ce8-4cf2-4e3b-9702-dda0909cb4fd None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:45.149578 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e37ce8-4cf2-4e3b-9702-dda0909cb4fd None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:45.150434 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e37ce8-4cf2-4e3b-9702-dda0909cb4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:45.184113 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-74e37ce8-4cf2-4e3b-9702-dda0909cb4fd None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:09:45.185771 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-74e37ce8-4cf2-4e3b-9702-dda0909cb4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:45.313507 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1218/2405] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:09:45.325920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa4651-79fe-4959-9627-bb66f0e77f15 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:45.328511 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-84aa4651-79fe-4959-9627-bb66f0e77f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:45.450078 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa4651-79fe-4959-9627-bb66f0e77f15 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:45.459195 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7a006-4788-45aa-a84a-850604eb9804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:45.462444 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7a006-4788-45aa-a84a-850604eb9804 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:45.463461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7a006-4788-45aa-a84a-850604eb9804 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:45.464335 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7a006-4788-45aa-a84a-850604eb9804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:45.487789 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7a006-4788-45aa-a84a-850604eb9804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:45.490205 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7a006-4788-45aa-a84a-850604eb9804 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:45.509478 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1188/2406] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:09:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:09:46.789542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c3ff9-ea96-4007-a828-e81b4fa0856c None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:46.790471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c3ff9-ea96-4007-a828-e81b4fa0856c None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:46.790471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c3ff9-ea96-4007-a828-e81b4fa0856c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:46.849231 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-e66c3ff9-ea96-4007-a828-e81b4fa0856c None None] MFA Rules not processed for user `99fb6525fa854bc885f9966f5fc80407`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:09:46.851772 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e66c3ff9-ea96-4007-a828-e81b4fa0856c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:47.020966 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1219/2407] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:09:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:09:47.038175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7a006-4788-45aa-a84a-850604eb9804 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:47.039730 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-79e7a006-4788-45aa-a84a-850604eb9804 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:47.156392 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7a006-4788-45aa-a84a-850604eb9804 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:47.160330 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf4efd-37aa-4d32-82ea-48a2286b9d81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:47.161007 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf4efd-37aa-4d32-82ea-48a2286b9d81 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:47.161281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf4efd-37aa-4d32-82ea-48a2286b9d81 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:47.161760 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf4efd-37aa-4d32-82ea-48a2286b9d81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:47.177184 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf4efd-37aa-4d32-82ea-48a2286b9d81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:47.179627 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf4efd-37aa-4d32-82ea-48a2286b9d81 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:47.199290 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1189/2408] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:09:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:09:48.375972 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda10650-1e11-40d0-bd1f-ab32c2e7b283 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:48.376868 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda10650-1e11-40d0-bd1f-ab32c2e7b283 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:48.377031 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda10650-1e11-40d0-bd1f-ab32c2e7b283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:48.418472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-cda10650-1e11-40d0-bd1f-ab32c2e7b283 None None] MFA Rules not processed for user `37ad5c3cff984893a1207635de0418f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:09:48.421524 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-cda10650-1e11-40d0-bd1f-ab32c2e7b283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:48.530800 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1220/2409] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:09:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:09:48.533053 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf4efd-37aa-4d32-82ea-48a2286b9d81 service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:48.535756 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-fcbf4efd-37aa-4d32-82ea-48a2286b9d81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:48.572100 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf4efd-37aa-4d32-82ea-48a2286b9d81 service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:48.585107 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb4f75-9755-4ea5-a113-2b4effead8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:48.586683 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb4f75-9755-4ea5-a113-2b4effead8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:48.587197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb4f75-9755-4ea5-a113-2b4effead8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:48.587809 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb4f75-9755-4ea5-a113-2b4effead8d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:48.589218 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb4f75-9755-4ea5-a113-2b4effead8d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:48.591509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb4f75-9755-4ea5-a113-2b4effead8d0 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:48.631555 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1190/2410] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:09:48 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:09:48.635825 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda10650-1e11-40d0-bd1f-ab32c2e7b283 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:48.654297 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda10650-1e11-40d0-bd1f-ab32c2e7b283 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:48.752288 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e6798-ef43-4091-9a81-71088688f8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:48.753252 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e6798-ef43-4091-9a81-71088688f8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:48.753591 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e6798-ef43-4091-9a81-71088688f8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:48.753998 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e6798-ef43-4091-9a81-71088688f8d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:48.755382 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e6798-ef43-4091-9a81-71088688f8d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:48.758002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e6798-ef43-4091-9a81-71088688f8d0 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:48.783308 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1221/2411] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:09:48 2022] POST /identity/v3/users => generated 298 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:09:48.788098 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb4f75-9755-4ea5-a113-2b4effead8d0 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:48.807430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb4f75-9755-4ea5-a113-2b4effead8d0 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:48.814545 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0cee3-ed64-45dd-a0b5-76e827e3a036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:48.815294 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0cee3-ed64-45dd-a0b5-76e827e3a036 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:48.815862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0cee3-ed64-45dd-a0b5-76e827e3a036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:48.815862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0cee3-ed64-45dd-a0b5-76e827e3a036 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:48.816553 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0cee3-ed64-45dd-a0b5-76e827e3a036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:48.818692 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0cee3-ed64-45dd-a0b5-76e827e3a036 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:48.832378 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1191/2412] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:09:48.838079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e6798-ef43-4091-9a81-71088688f8d0 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:48.850933 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e6798-ef43-4091-9a81-71088688f8d0 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:48.856025 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb9469-718b-436b-93df-a9df2cc53259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:48.856952 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb9469-718b-436b-93df-a9df2cc53259 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:48.857231 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb9469-718b-436b-93df-a9df2cc53259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:48.858216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb9469-718b-436b-93df-a9df2cc53259 admin admin] PATH_INFO: `/v3/projects/bf2f40a7dfad4278961a5e29cfccaf29/users/106526b6d8bc442a86f6e3be27a042c5/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:48.878855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb9469-718b-436b-93df-a9df2cc53259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2f40a7dfad4278961a5e29cfccaf29, user_id=106526b6d8bc442a86f6e3be27a042c5, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:48.881791 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb9469-718b-436b-93df-a9df2cc53259 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:48.900857 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1222/2413] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:09:48 2022] PUT /identity/v3/projects/bf2f40a7dfad4278961a5e29cfccaf29/users/106526b6d8bc442a86f6e3be27a042c5/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:09:48.906031 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0cee3-ed64-45dd-a0b5-76e827e3a036 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:48.919147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0cee3-ed64-45dd-a0b5-76e827e3a036 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:48.996474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba8741-0530-4965-b865-bbfecb5e5fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:48.997158 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba8741-0530-4965-b865-bbfecb5e5fdb admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:48.997440 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba8741-0530-4965-b865-bbfecb5e5fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:48.997715 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba8741-0530-4965-b865-bbfecb5e5fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:48.998521 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba8741-0530-4965-b865-bbfecb5e5fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:49.000216 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba8741-0530-4965-b865-bbfecb5e5fdb admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:49.011402 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1192/2414] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:09:49.017266 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb9469-718b-436b-93df-a9df2cc53259 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:49.028344 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb9469-718b-436b-93df-a9df2cc53259 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:49.033904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca5d36-437d-4f61-b57a-c5ac51e2f49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:49.034844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca5d36-437d-4f61-b57a-c5ac51e2f49d admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:49.035207 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca5d36-437d-4f61-b57a-c5ac51e2f49d admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:49.035487 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca5d36-437d-4f61-b57a-c5ac51e2f49d admin admin] PATH_INFO: `/v3/projects/bf2f40a7dfad4278961a5e29cfccaf29/users/106526b6d8bc442a86f6e3be27a042c5/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:49.037591 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca5d36-437d-4f61-b57a-c5ac51e2f49d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2f40a7dfad4278961a5e29cfccaf29, user_id=106526b6d8bc442a86f6e3be27a042c5, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:49.040327 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca5d36-437d-4f61-b57a-c5ac51e2f49d admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:49.052080 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1223/2415] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:09:49 2022] PUT /identity/v3/projects/bf2f40a7dfad4278961a5e29cfccaf29/users/106526b6d8bc442a86f6e3be27a042c5/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:09:49.874377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e742a-df48-462a-8ebf-4a5a9a7ff81d None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:49.875010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e742a-df48-462a-8ebf-4a5a9a7ff81d None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:49.875010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e742a-df48-462a-8ebf-4a5a9a7ff81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:49.905321 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-9a7e742a-df48-462a-8ebf-4a5a9a7ff81d None None] MFA Rules not processed for user `99fb6525fa854bc885f9966f5fc80407`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:09:49.908504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-9a7e742a-df48-462a-8ebf-4a5a9a7ff81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:50.019770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1193/2416] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:09:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:09:57.559540 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec5cc2-0095-4128-8a33-5833042e741d None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:57.566179 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec5cc2-0095-4128-8a33-5833042e741d None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:57.567127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec5cc2-0095-4128-8a33-5833042e741d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:57.609988 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-00ec5cc2-0095-4128-8a33-5833042e741d None None] MFA Rules not processed for user `106526b6d8bc442a86f6e3be27a042c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:09:57.612445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-00ec5cc2-0095-4128-8a33-5833042e741d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:57.769960 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1224/2417] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:09:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:09:57.791378 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e742a-df48-462a-8ebf-4a5a9a7ff81d None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:57.792947 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-9a7e742a-df48-462a-8ebf-4a5a9a7ff81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:57.873225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e742a-df48-462a-8ebf-4a5a9a7ff81d None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:57.877566 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a98184-af7e-4b04-8f0f-d54342194fe6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdd8008619d4ee3b8fe45e0e5241878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:57.878223 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a98184-af7e-4b04-8f0f-d54342194fe6 service glance] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:57.878499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a98184-af7e-4b04-8f0f-d54342194fe6 service glance] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:57.879041 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a98184-af7e-4b04-8f0f-d54342194fe6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:57.979772 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a98184-af7e-4b04-8f0f-d54342194fe6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:57.982625 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a98184-af7e-4b04-8f0f-d54342194fe6 service glance] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:58.001477 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1194/2418] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:09:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:09:58.139701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa20e14-d12e-41a5-a1fd-85dd9c93cd20 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:58.139989 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa20e14-d12e-41a5-a1fd-85dd9c93cd20 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:58.140267 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa20e14-d12e-41a5-a1fd-85dd9c93cd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:58.159739 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-6aa20e14-d12e-41a5-a1fd-85dd9c93cd20 None None] MFA Rules not processed for user `0c04f5fb770d49c0a50f2cfbd77e17e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:09:58.161058 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-6aa20e14-d12e-41a5-a1fd-85dd9c93cd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:58.249842 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1225/2419] 10.222.0.73 () {58 vars in 1009 bytes} [Fri May 13 15:09:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:09:58.277199 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a98184-af7e-4b04-8f0f-d54342194fe6 service glance] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:09:58.278810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-15a98184-af7e-4b04-8f0f-d54342194fe6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:09:58.368557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a98184-af7e-4b04-8f0f-d54342194fe6 service glance] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:09:58.377470 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0672caa-1335-456a-a49f-ecf92f34705c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27265a0c2e6b47c09f28b9cd3ac47d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:09:58.378605 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0672caa-1335-456a-a49f-ecf92f34705c service swift] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:09:58.379140 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0672caa-1335-456a-a49f-ecf92f34705c service swift] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:09:58.379648 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0672caa-1335-456a-a49f-ecf92f34705c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:09:58.395204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0672caa-1335-456a-a49f-ecf92f34705c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:09:58.398235 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0672caa-1335-456a-a49f-ecf92f34705c service swift] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:09:58.412244 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1195/2420] 10.222.0.73 () {60 vars in 1384 bytes} [Fri May 13 15:09:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 13 15:10:08.965330 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2591a-b8fa-4a17-af0c-4cd02407622a None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:10:08.966556 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2591a-b8fa-4a17-af0c-4cd02407622a None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:10:08.966556 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2591a-b8fa-4a17-af0c-4cd02407622a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:10:08.984827 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-9ea2591a-b8fa-4a17-af0c-4cd02407622a None None] MFA Rules not processed for user `37ad5c3cff984893a1207635de0418f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:10:08.986053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-9ea2591a-b8fa-4a17-af0c-4cd02407622a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:10:08.993032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1226/2421] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:10:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:10:11.701679 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120af171-1a22-49e5-8bc0-77462edd32c9 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:10:11.702559 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120af171-1a22-49e5-8bc0-77462edd32c9 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:10:11.702559 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120af171-1a22-49e5-8bc0-77462edd32c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:10:11.723269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-120af171-1a22-49e5-8bc0-77462edd32c9 None None] MFA Rules not processed for user `0c04f5fb770d49c0a50f2cfbd77e17e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:10:11.727900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-120af171-1a22-49e5-8bc0-77462edd32c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:10:11.739351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1196/2422] 10.222.0.73 () {58 vars in 1009 bytes} [Fri May 13 15:10:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:10:11.757453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2591a-b8fa-4a17-af0c-4cd02407622a None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:10:11.773775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2591a-b8fa-4a17-af0c-4cd02407622a None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:10:11.782498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3ab8c-bf53-4f5b-be38-b3ac8391dd70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27265a0c2e6b47c09f28b9cd3ac47d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:10:11.784316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3ab8c-bf53-4f5b-be38-b3ac8391dd70 service swift] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:10:11.785123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3ab8c-bf53-4f5b-be38-b3ac8391dd70 service swift] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:10:11.785804 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3ab8c-bf53-4f5b-be38-b3ac8391dd70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:10:11.801426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3ab8c-bf53-4f5b-be38-b3ac8391dd70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:10:11.804436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3ab8c-bf53-4f5b-be38-b3ac8391dd70 service swift] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:10:11.819395 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1227/2423] 10.222.0.73 () {60 vars in 1384 bytes} [Fri May 13 15:10:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 15:10:37.041116 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120af171-1a22-49e5-8bc0-77462edd32c9 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:10:37.159803 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120af171-1a22-49e5-8bc0-77462edd32c9 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:10:37.173079 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b354974-456c-41e9-aab9-64c872863066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:10:37.174766 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b354974-456c-41e9-aab9-64c872863066 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:10:37.175834 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b354974-456c-41e9-aab9-64c872863066 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:10:37.180691 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b354974-456c-41e9-aab9-64c872863066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:10:37.185518 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6b354974-456c-41e9-aab9-64c872863066 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:10:37.314268 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b354974-456c-41e9-aab9-64c872863066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:10:37.317099 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b354974-456c-41e9-aab9-64c872863066 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:10:37.359808 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1197/2424] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:10:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:10:37.548110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecde5f-7561-4bf3-990c-1ee28833548e None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:10:37.548709 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecde5f-7561-4bf3-990c-1ee28833548e None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:10:37.549207 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecde5f-7561-4bf3-990c-1ee28833548e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:10:37.577058 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-94ecde5f-7561-4bf3-990c-1ee28833548e None None] MFA Rules not processed for user `0c04f5fb770d49c0a50f2cfbd77e17e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:10:37.578526 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-94ecde5f-7561-4bf3-990c-1ee28833548e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:10:37.586781 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1228/2425] 10.222.0.73 () {58 vars in 1009 bytes} [Fri May 13 15:10:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:10:37.607738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b354974-456c-41e9-aab9-64c872863066 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:10:37.627649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b354974-456c-41e9-aab9-64c872863066 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:10:37.634869 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71f727-a934-4d5e-ab37-0bc424683bda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27265a0c2e6b47c09f28b9cd3ac47d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:10:37.635488 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71f727-a934-4d5e-ab37-0bc424683bda service swift] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:10:37.635822 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71f727-a934-4d5e-ab37-0bc424683bda service swift] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:10:37.636115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71f727-a934-4d5e-ab37-0bc424683bda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:10:37.646049 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71f727-a934-4d5e-ab37-0bc424683bda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:10:37.647780 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71f727-a934-4d5e-ab37-0bc424683bda service swift] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:10:37.657207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1198/2426] 10.222.0.73 () {60 vars in 1384 bytes} [Fri May 13 15:10:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 15:10:38.340646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ecde5f-7561-4bf3-990c-1ee28833548e None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:10:38.362899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ecde5f-7561-4bf3-990c-1ee28833548e None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:10:38.371425 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80dcce7-661a-4d2e-b77d-31a47c5b270f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:10:38.372654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dcce7-661a-4d2e-b77d-31a47c5b270f service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:10:38.373130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dcce7-661a-4d2e-b77d-31a47c5b270f service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:10:38.373575 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dcce7-661a-4d2e-b77d-31a47c5b270f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:10:38.376056 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-f80dcce7-661a-4d2e-b77d-31a47c5b270f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:10:38.398479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80dcce7-661a-4d2e-b77d-31a47c5b270f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:10:38.400492 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80dcce7-661a-4d2e-b77d-31a47c5b270f service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:10:38.418194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1229/2427] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:10:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:10:48.046045 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71f727-a934-4d5e-ab37-0bc424683bda service swift] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:10:48.056666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71f727-a934-4d5e-ab37-0bc424683bda service swift] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:10:48.062878 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badbd0a3-18f1-4121-8ad1-1063a1708ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:10:48.064126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbd0a3-18f1-4121-8ad1-1063a1708ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:10:48.064628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbd0a3-18f1-4121-8ad1-1063a1708ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:10:48.065127 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbd0a3-18f1-4121-8ad1-1063a1708ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:10:48.068827 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-badbd0a3-18f1-4121-8ad1-1063a1708ef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:10:48.206148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badbd0a3-18f1-4121-8ad1-1063a1708ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:10:48.209227 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badbd0a3-18f1-4121-8ad1-1063a1708ef4 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:10:48.241543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1199/2428] 10.222.0.73 () {60 vars in 1396 bytes} [Fri May 13 15:10:48 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:10:59.880724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80dcce7-661a-4d2e-b77d-31a47c5b270f service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:10:59.890371 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80dcce7-661a-4d2e-b77d-31a47c5b270f service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:10:59.894196 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0661f58-5ed7-4b4f-9b0f-b261475b6862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:10:59.894925 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0661f58-5ed7-4b4f-9b0f-b261475b6862 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:10:59.895291 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0661f58-5ed7-4b4f-9b0f-b261475b6862 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:10:59.895604 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0661f58-5ed7-4b4f-9b0f-b261475b6862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:10:59.897494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a0661f58-5ed7-4b4f-9b0f-b261475b6862 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:10:59.908292 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0661f58-5ed7-4b4f-9b0f-b261475b6862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:10:59.909640 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0661f58-5ed7-4b4f-9b0f-b261475b6862 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:10:59.918317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1230/2429] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:10:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:11:00.038029 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd90077-dcf6-4b3e-b9ec-a4d2e0b72575 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:11:00.039014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd90077-dcf6-4b3e-b9ec-a4d2e0b72575 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:11:00.039162 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd90077-dcf6-4b3e-b9ec-a4d2e0b72575 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:11:00.042512 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1200/2430] 10.222.0.73 () {54 vars in 921 bytes} [Fri May 13 15:11:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 15:11:00.052366 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39996389-b830-4b40-8243-64ee7cb70f37 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:11:00.052932 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39996389-b830-4b40-8243-64ee7cb70f37 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:11:00.053222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39996389-b830-4b40-8243-64ee7cb70f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:11:00.104895 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-39996389-b830-4b40-8243-64ee7cb70f37 None None] MFA Rules not processed for user `52d539202cfb40a48b231713e16a599a`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:11:00.107401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-39996389-b830-4b40-8243-64ee7cb70f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:11:00.125257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1231/2431] 10.222.0.73 () {58 vars in 1018 bytes} [Fri May 13 15:11:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:11:00.146194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd90077-dcf6-4b3e-b9ec-a4d2e0b72575 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:11:00.149184 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-bfd90077-dcf6-4b3e-b9ec-a4d2e0b72575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:11:00.172564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd90077-dcf6-4b3e-b9ec-a4d2e0b72575 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:11:00.178888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273e588-268d-4f48-aa12-457594887647 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdd8008619d4ee3b8fe45e0e5241878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:11:00.180004 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273e588-268d-4f48-aa12-457594887647 service glance] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:11:00.180510 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273e588-268d-4f48-aa12-457594887647 service glance] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:11:00.181050 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273e588-268d-4f48-aa12-457594887647 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:11:00.201433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273e588-268d-4f48-aa12-457594887647 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:11:00.204436 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273e588-268d-4f48-aa12-457594887647 service glance] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:11:00.225575 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1201/2432] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:11:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:11:00.299196 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95c3f6-c1df-4512-9098-7b0ee8304d80 None None] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:11:00.299606 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95c3f6-c1df-4512-9098-7b0ee8304d80 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:11:00.299972 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95c3f6-c1df-4512-9098-7b0ee8304d80 None None] PATH_INFO: `/` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:11:00.301599 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1232/2433] 10.222.0.73 () {54 vars in 921 bytes} [Fri May 13 15:11:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 15:11:00.307751 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653efc9-c104-4b1e-8b35-8c45adce132b None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:11:00.308021 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653efc9-c104-4b1e-8b35-8c45adce132b None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:11:00.308303 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653efc9-c104-4b1e-8b35-8c45adce132b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:11:00.329892 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-b653efc9-c104-4b1e-8b35-8c45adce132b None None] MFA Rules not processed for user `ee97a542470644f89cd665dfdf2f9e92`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:11:00.331173 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-b653efc9-c104-4b1e-8b35-8c45adce132b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:11:00.337959 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1202/2434] 10.222.0.73 () {58 vars in 1018 bytes} [Fri May 13 15:11:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:11:00.350770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95c3f6-c1df-4512-9098-7b0ee8304d80 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:11:00.352684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-0c95c3f6-c1df-4512-9098-7b0ee8304d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:11:00.365946 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95c3f6-c1df-4512-9098-7b0ee8304d80 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:11:00.370069 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b680b2b-43e2-4cf7-ac3b-e79a924adf4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:11:00.370727 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b680b2b-43e2-4cf7-ac3b-e79a924adf4f service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:11:00.371051 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b680b2b-43e2-4cf7-ac3b-e79a924adf4f service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:11:00.371323 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b680b2b-43e2-4cf7-ac3b-e79a924adf4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:11:00.379135 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b680b2b-43e2-4cf7-ac3b-e79a924adf4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:11:00.380585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b680b2b-43e2-4cf7-ac3b-e79a924adf4f service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:11:00.389609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1233/2435] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:11:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:11:00.492903 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d09ec-f13e-4a87-afb4-06c91815890c None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:11:00.493188 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d09ec-f13e-4a87-afb4-06c91815890c None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:11:00.493470 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d09ec-f13e-4a87-afb4-06c91815890c None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:11:00.495614 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1203/2436] 10.222.0.73 () {54 vars in 921 bytes} [Fri May 13 15:11:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 15:11:00.504238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849c28f-7558-4bd0-89f2-0679d68dd5bd None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:11:00.504531 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849c28f-7558-4bd0-89f2-0679d68dd5bd None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:11:00.504814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849c28f-7558-4bd0-89f2-0679d68dd5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:11:00.524408 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-1849c28f-7558-4bd0-89f2-0679d68dd5bd None None] MFA Rules not processed for user `52d539202cfb40a48b231713e16a599a`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:11:00.525648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-1849c28f-7558-4bd0-89f2-0679d68dd5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:11:00.535438 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1234/2437] 10.222.0.73 () {58 vars in 1018 bytes} [Fri May 13 15:11:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:11:00.547351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d09ec-f13e-4a87-afb4-06c91815890c None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:11:00.564158 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d09ec-f13e-4a87-afb4-06c91815890c None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:11:00.568179 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfd538-49c5-4ea8-a22c-aa958bfbddc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:11:00.568909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfd538-49c5-4ea8-a22c-aa958bfbddc0 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:11:00.569293 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfd538-49c5-4ea8-a22c-aa958bfbddc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:11:00.569680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfd538-49c5-4ea8-a22c-aa958bfbddc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:11:00.581821 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfd538-49c5-4ea8-a22c-aa958bfbddc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:11:00.583398 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfd538-49c5-4ea8-a22c-aa958bfbddc0 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:11:00.595239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1204/2438] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:11:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:11:00.661330 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849c28f-7558-4bd0-89f2-0679d68dd5bd None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:11:00.662751 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-1849c28f-7558-4bd0-89f2-0679d68dd5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:11:00.735843 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849c28f-7558-4bd0-89f2-0679d68dd5bd None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:11:00.741122 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9f275-86ca-49d1-9d43-f7f1b2058f84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908d23b035f14756b438b3a61a63b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:11:00.741794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9f275-86ca-49d1-9d43-f7f1b2058f84 service placement] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:11:00.742077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9f275-86ca-49d1-9d43-f7f1b2058f84 service placement] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:11:00.742348 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9f275-86ca-49d1-9d43-f7f1b2058f84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:11:00.744350 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-b4f9f275-86ca-49d1-9d43-f7f1b2058f84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:11:00.757817 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9f275-86ca-49d1-9d43-f7f1b2058f84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:11:00.760242 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9f275-86ca-49d1-9d43-f7f1b2058f84 service placement] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:11:00.772539 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1235/2439] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:11:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:11:29.522337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfd538-49c5-4ea8-a22c-aa958bfbddc0 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:11:29.523673 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c7bfd538-49c5-4ea8-a22c-aa958bfbddc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:11:29.538171 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfd538-49c5-4ea8-a22c-aa958bfbddc0 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:11:29.543962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4af0e-8dd0-492c-9de4-5539596417be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:11:29.544621 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4af0e-8dd0-492c-9de4-5539596417be service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:11:29.544897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4af0e-8dd0-492c-9de4-5539596417be service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:11:29.545165 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4af0e-8dd0-492c-9de4-5539596417be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:11:29.547464 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-4df4af0e-8dd0-492c-9de4-5539596417be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:11:29.610772 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4af0e-8dd0-492c-9de4-5539596417be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:11:29.612568 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4af0e-8dd0-492c-9de4-5539596417be service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:11:29.623693 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1205/2440] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:11:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:11:48.129628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9f275-86ca-49d1-9d43-f7f1b2058f84 service placement] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:11:48.141487 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9f275-86ca-49d1-9d43-f7f1b2058f84 service placement] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:11:48.147134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d8a4f-dc9f-4c69-a165-244787f2ad8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:11:48.148169 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d8a4f-dc9f-4c69-a165-244787f2ad8e service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:11:48.148682 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d8a4f-dc9f-4c69-a165-244787f2ad8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:11:48.148958 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d8a4f-dc9f-4c69-a165-244787f2ad8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:11:48.151147 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-4c2d8a4f-dc9f-4c69-a165-244787f2ad8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:11:48.162995 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d8a4f-dc9f-4c69-a165-244787f2ad8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:11:48.164506 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d8a4f-dc9f-4c69-a165-244787f2ad8e service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:11:48.175388 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1236/2441] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:11:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:11:49.895636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4af0e-8dd0-492c-9de4-5539596417be service nova] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:11:49.905726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4af0e-8dd0-492c-9de4-5539596417be service nova] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:11:49.909494 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac00d2-41a9-42e8-bd29-bdbcff687df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:11:49.910202 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac00d2-41a9-42e8-bd29-bdbcff687df4 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:11:49.910533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac00d2-41a9-42e8-bd29-bdbcff687df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:11:49.910873 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac00d2-41a9-42e8-bd29-bdbcff687df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:11:49.922142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac00d2-41a9-42e8-bd29-bdbcff687df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:11:49.923641 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac00d2-41a9-42e8-bd29-bdbcff687df4 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:11:49.935410 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1206/2442] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:11:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:11:52.347790 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d8a4f-dc9f-4c69-a165-244787f2ad8e service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:11:52.350232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-4c2d8a4f-dc9f-4c69-a165-244787f2ad8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:11:52.383476 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d8a4f-dc9f-4c69-a165-244787f2ad8e service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:11:52.389915 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210da18-f94a-475c-ae33-5dd422807727 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:11:52.390657 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210da18-f94a-475c-ae33-5dd422807727 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:11:52.391939 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210da18-f94a-475c-ae33-5dd422807727 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:11:52.392231 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210da18-f94a-475c-ae33-5dd422807727 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:11:52.394472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-9210da18-f94a-475c-ae33-5dd422807727 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:11:52.423056 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210da18-f94a-475c-ae33-5dd422807727 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:11:52.427972 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210da18-f94a-475c-ae33-5dd422807727 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:11:52.459284 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1237/2443] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:11:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:11:54.707164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac00d2-41a9-42e8-bd29-bdbcff687df4 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:11:54.740487 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac00d2-41a9-42e8-bd29-bdbcff687df4 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:11:54.747792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b21cc7-7b81-417f-97ae-33641ffe6c84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:11:54.748742 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b21cc7-7b81-417f-97ae-33641ffe6c84 service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:11:54.749187 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b21cc7-7b81-417f-97ae-33641ffe6c84 service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:11:54.749622 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b21cc7-7b81-417f-97ae-33641ffe6c84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:11:54.751913 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-75b21cc7-7b81-417f-97ae-33641ffe6c84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:11:54.784404 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b21cc7-7b81-417f-97ae-33641ffe6c84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:11:54.786343 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b21cc7-7b81-417f-97ae-33641ffe6c84 service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:11:54.815255 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1207/2444] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:11:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:12:56.154229 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210da18-f94a-475c-ae33-5dd422807727 service nova] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:12:56.154229 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-9210da18-f94a-475c-ae33-5dd422807727 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:12:56.205941 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210da18-f94a-475c-ae33-5dd422807727 service nova] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:12:56.209787 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cf26e-f176-44c5-a91d-5540ef9b0855 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:12:56.210969 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cf26e-f176-44c5-a91d-5540ef9b0855 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:12:56.211253 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cf26e-f176-44c5-a91d-5540ef9b0855 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:12:56.211528 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cf26e-f176-44c5-a91d-5540ef9b0855 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:12:56.213422 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-092cf26e-f176-44c5-a91d-5540ef9b0855 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:12:56.272167 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cf26e-f176-44c5-a91d-5540ef9b0855 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:12:56.274160 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cf26e-f176-44c5-a91d-5540ef9b0855 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:12:56.283872 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1238/2445] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:12:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:13:40.815230 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b21cc7-7b81-417f-97ae-33641ffe6c84 service nova] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:13:40.817275 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-75b21cc7-7b81-417f-97ae-33641ffe6c84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:13:40.840687 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b21cc7-7b81-417f-97ae-33641ffe6c84 service nova] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:13:40.847558 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fa65c-183b-4f3c-ab66-26ea2f6282cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908d23b035f14756b438b3a61a63b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:13:40.848484 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fa65c-183b-4f3c-ab66-26ea2f6282cd service placement] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:13:40.848887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fa65c-183b-4f3c-ab66-26ea2f6282cd service placement] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:13:40.849284 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fa65c-183b-4f3c-ab66-26ea2f6282cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:13:40.852015 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-be9fa65c-183b-4f3c-ab66-26ea2f6282cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:13:40.868988 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fa65c-183b-4f3c-ab66-26ea2f6282cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:13:40.871396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fa65c-183b-4f3c-ab66-26ea2f6282cd service placement] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:13:40.885938 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1208/2446] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:13:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:14:47.148145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cf26e-f176-44c5-a91d-5540ef9b0855 service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:14:47.157608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cf26e-f176-44c5-a91d-5540ef9b0855 service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:14:47.161576 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efc798-9b6d-481c-8d52-7668b8b737b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:14:47.162220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efc798-9b6d-481c-8d52-7668b8b737b5 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:14:47.162497 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efc798-9b6d-481c-8d52-7668b8b737b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:14:47.162774 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efc798-9b6d-481c-8d52-7668b8b737b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:14:47.172446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efc798-9b6d-481c-8d52-7668b8b737b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:14:47.174138 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efc798-9b6d-481c-8d52-7668b8b737b5 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:14:47.184025 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1239/2447] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:14:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:14:58.170467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fa65c-183b-4f3c-ab66-26ea2f6282cd service placement] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:14:58.184192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fa65c-183b-4f3c-ab66-26ea2f6282cd service placement] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:14:58.189603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d7644-5846-4d4f-b8e0-7e1e5162becc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:14:58.190246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d7644-5846-4d4f-b8e0-7e1e5162becc service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:14:58.190528 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d7644-5846-4d4f-b8e0-7e1e5162becc service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:14:58.190813 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d7644-5846-4d4f-b8e0-7e1e5162becc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:14:58.199504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d7644-5846-4d4f-b8e0-7e1e5162becc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:14:58.201098 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d7644-5846-4d4f-b8e0-7e1e5162becc service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:14:58.211799 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1209/2448] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:14:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:15:37.156497 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efc798-9b6d-481c-8d52-7668b8b737b5 service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:15:37.165646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efc798-9b6d-481c-8d52-7668b8b737b5 service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:15:37.169234 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a92ed4-93d9-4bd1-a55b-b4af84183222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:15:37.169907 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a92ed4-93d9-4bd1-a55b-b4af84183222 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:15:37.170188 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a92ed4-93d9-4bd1-a55b-b4af84183222 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:15:37.170453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a92ed4-93d9-4bd1-a55b-b4af84183222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:15:37.181412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a92ed4-93d9-4bd1-a55b-b4af84183222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:15:37.182759 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a92ed4-93d9-4bd1-a55b-b4af84183222 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:15:37.194088 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1240/2449] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:15:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:15:48.953005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d7644-5846-4d4f-b8e0-7e1e5162becc service nova] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:15:48.964211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d7644-5846-4d4f-b8e0-7e1e5162becc service nova] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:15:48.970002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14def312-2259-43af-96c2-bb132906c4a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:15:48.970576 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14def312-2259-43af-96c2-bb132906c4a6 service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:15:48.970882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14def312-2259-43af-96c2-bb132906c4a6 service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:15:48.971157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14def312-2259-43af-96c2-bb132906c4a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:15:48.979378 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14def312-2259-43af-96c2-bb132906c4a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:15:48.980949 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14def312-2259-43af-96c2-bb132906c4a6 service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:15:49.009325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1210/2450] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:15:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:16:30.233942 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a92ed4-93d9-4bd1-a55b-b4af84183222 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:16:30.243315 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a92ed4-93d9-4bd1-a55b-b4af84183222 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:16:30.246914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b8aac-bea6-4060-aba7-e0593803bf80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:16:30.247554 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b8aac-bea6-4060-aba7-e0593803bf80 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:16:30.247835 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b8aac-bea6-4060-aba7-e0593803bf80 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:16:30.248165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b8aac-bea6-4060-aba7-e0593803bf80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:16:30.271634 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b8aac-bea6-4060-aba7-e0593803bf80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:16:30.273097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b8aac-bea6-4060-aba7-e0593803bf80 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:16:30.304118 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1241/2451] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:16:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:16:59.892036 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14def312-2259-43af-96c2-bb132906c4a6 service nova] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:16:59.911117 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14def312-2259-43af-96c2-bb132906c4a6 service nova] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:16:59.914727 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475309b1-8127-4f62-b7be-fdbf489bc721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:16:59.915464 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475309b1-8127-4f62-b7be-fdbf489bc721 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:16:59.915783 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475309b1-8127-4f62-b7be-fdbf489bc721 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:16:59.916061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475309b1-8127-4f62-b7be-fdbf489bc721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:16:59.935156 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475309b1-8127-4f62-b7be-fdbf489bc721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:16:59.937158 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475309b1-8127-4f62-b7be-fdbf489bc721 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:16:59.949590 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1211/2452] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:16:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:17:01.538511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba3f87-6166-4d63-82fd-9900675b8838 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:17:01.539221 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba3f87-6166-4d63-82fd-9900675b8838 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:17:01.539336 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba3f87-6166-4d63-82fd-9900675b8838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:17:01.569611 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-cbba3f87-6166-4d63-82fd-9900675b8838 None None] MFA Rules not processed for user `0c04f5fb770d49c0a50f2cfbd77e17e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:17:01.570948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-cbba3f87-6166-4d63-82fd-9900675b8838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:17:01.588409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1242/2453] 10.222.0.73 () {58 vars in 967 bytes} [Fri May 13 15:17:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:17:01.636587 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475309b1-8127-4f62-b7be-fdbf489bc721 service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:17:01.648306 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475309b1-8127-4f62-b7be-fdbf489bc721 service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:17:01.653329 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05248b1-088f-4ef9-900a-f79853e5261e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27265a0c2e6b47c09f28b9cd3ac47d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:17:01.653978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05248b1-088f-4ef9-900a-f79853e5261e service swift] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:17:01.654261 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05248b1-088f-4ef9-900a-f79853e5261e service swift] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:17:01.654536 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05248b1-088f-4ef9-900a-f79853e5261e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:17:01.663854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05248b1-088f-4ef9-900a-f79853e5261e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:17:01.665445 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05248b1-088f-4ef9-900a-f79853e5261e service swift] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:17:01.673517 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1212/2454] 10.222.0.73 () {60 vars in 1384 bytes} [Fri May 13 15:17:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 13 15:17:03.228882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba3f87-6166-4d63-82fd-9900675b8838 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:17:03.243002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba3f87-6166-4d63-82fd-9900675b8838 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:17:03.249846 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15f433-ce4a-4214-b615-bc58a9c36211 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:17:03.252370 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15f433-ce4a-4214-b615-bc58a9c36211 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:17:03.252370 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15f433-ce4a-4214-b615-bc58a9c36211 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:17:03.252370 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15f433-ce4a-4214-b615-bc58a9c36211 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:17:03.260978 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15f433-ce4a-4214-b615-bc58a9c36211 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:17:03.262556 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15f433-ce4a-4214-b615-bc58a9c36211 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:17:03.272418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dd7c3-e044-4b9c-a344-c367a637f996 None None] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:17:03.273321 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dd7c3-e044-4b9c-a344-c367a637f996 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:17:03.273808 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dd7c3-e044-4b9c-a344-c367a637f996 None None] PATH_INFO: `/` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:17:03.274120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1243/2455] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:17:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:17:03.275569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1213/2456] 10.222.0.73 () {54 vars in 912 bytes} [Fri May 13 15:17:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 15:17:03.281221 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f27d1b-0067-4040-b2fb-f8141bbd5857 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:17:03.281742 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f27d1b-0067-4040-b2fb-f8141bbd5857 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:17:03.282022 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f27d1b-0067-4040-b2fb-f8141bbd5857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:17:03.338059 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-d5f27d1b-0067-4040-b2fb-f8141bbd5857 None None] MFA Rules not processed for user `908d23b035f14756b438b3a61a63b2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:17:03.339871 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-d5f27d1b-0067-4040-b2fb-f8141bbd5857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:17:03.350872 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1244/2457] 10.222.0.73 () {58 vars in 1009 bytes} [Fri May 13 15:17:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:17:03.373799 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dd7c3-e044-4b9c-a344-c367a637f996 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:17:03.388151 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dd7c3-e044-4b9c-a344-c367a637f996 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:17:03.393854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4408a-7396-4a28-9af4-e8bd2441d635 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908d23b035f14756b438b3a61a63b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:17:03.394492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4408a-7396-4a28-9af4-e8bd2441d635 service placement] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:17:03.394780 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4408a-7396-4a28-9af4-e8bd2441d635 service placement] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:17:03.395080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4408a-7396-4a28-9af4-e8bd2441d635 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:17:03.403669 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4408a-7396-4a28-9af4-e8bd2441d635 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:17:03.405279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4408a-7396-4a28-9af4-e8bd2441d635 service placement] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:17:03.414832 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1214/2458] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:17:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:17:05.706582 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba1f4e-480e-43ae-9198-f203fd6397af None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:17:05.707194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba1f4e-480e-43ae-9198-f203fd6397af None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:17:05.707194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba1f4e-480e-43ae-9198-f203fd6397af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:17:05.744172 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-b1ba1f4e-480e-43ae-9198-f203fd6397af None None] MFA Rules not processed for user `477e3c3f65f6407c9c7a932c9650334d`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:17:05.745360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-b1ba1f4e-480e-43ae-9198-f203fd6397af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:17:05.752991 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1245/2459] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:17:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:17:06.066841 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4408a-7396-4a28-9af4-e8bd2441d635 service placement] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:17:06.086224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4408a-7396-4a28-9af4-e8bd2441d635 service placement] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:17:06.089793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af6f7b-7bff-4f9c-9866-6a713ecf9703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:17:06.090420 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af6f7b-7bff-4f9c-9866-6a713ecf9703 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:17:06.090703 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af6f7b-7bff-4f9c-9866-6a713ecf9703 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:17:06.091015 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af6f7b-7bff-4f9c-9866-6a713ecf9703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:17:06.098936 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af6f7b-7bff-4f9c-9866-6a713ecf9703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:17:06.100365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af6f7b-7bff-4f9c-9866-6a713ecf9703 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:17:06.108617 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1215/2460] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:17:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:17:06.429178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba1f4e-480e-43ae-9198-f203fd6397af None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:17:06.441782 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba1f4e-480e-43ae-9198-f203fd6397af None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:17:06.447074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4bd9e-479c-42a7-a9f2-59eddcf19d39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908d23b035f14756b438b3a61a63b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:17:06.447765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4bd9e-479c-42a7-a9f2-59eddcf19d39 service placement] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:17:06.448046 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4bd9e-479c-42a7-a9f2-59eddcf19d39 service placement] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:17:06.448317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4bd9e-479c-42a7-a9f2-59eddcf19d39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:17:06.457907 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4bd9e-479c-42a7-a9f2-59eddcf19d39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:17:06.460293 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4bd9e-479c-42a7-a9f2-59eddcf19d39 service placement] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:17:06.487161 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1246/2461] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:17:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:17:08.335879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af6f7b-7bff-4f9c-9866-6a713ecf9703 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:17:08.345495 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af6f7b-7bff-4f9c-9866-6a713ecf9703 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:17:08.349239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca3439-73b7-48ab-a01d-155690e569c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:17:08.349911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca3439-73b7-48ab-a01d-155690e569c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:17:08.350194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca3439-73b7-48ab-a01d-155690e569c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:17:08.350556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca3439-73b7-48ab-a01d-155690e569c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:17:08.358807 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca3439-73b7-48ab-a01d-155690e569c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:17:08.360280 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca3439-73b7-48ab-a01d-155690e569c4 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:17:08.369168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1216/2462] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:17:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:17:09.048055 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4bd9e-479c-42a7-a9f2-59eddcf19d39 service placement] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:17:09.062566 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4bd9e-479c-42a7-a9f2-59eddcf19d39 service placement] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:17:09.069358 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c9fe6-6e47-4ac6-a436-e60934133480 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:17:09.069944 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c9fe6-6e47-4ac6-a436-e60934133480 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:17:09.070541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c9fe6-6e47-4ac6-a436-e60934133480 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:17:09.070760 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c9fe6-6e47-4ac6-a436-e60934133480 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:17:09.080702 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c9fe6-6e47-4ac6-a436-e60934133480 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:17:09.082296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c9fe6-6e47-4ac6-a436-e60934133480 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:17:09.094211 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1247/2463] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:17:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:17:16.441795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca3439-73b7-48ab-a01d-155690e569c4 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:17:16.457040 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca3439-73b7-48ab-a01d-155690e569c4 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:17:16.463933 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfe634-f915-4287-be7f-bddb6f1734de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:17:16.465167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfe634-f915-4287-be7f-bddb6f1734de service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:17:16.465969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfe634-f915-4287-be7f-bddb6f1734de service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:17:16.466438 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfe634-f915-4287-be7f-bddb6f1734de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:17:16.469174 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-dccfe634-f915-4287-be7f-bddb6f1734de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:17:16.492242 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfe634-f915-4287-be7f-bddb6f1734de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:17:16.494581 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfe634-f915-4287-be7f-bddb6f1734de service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:17:16.519328 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1217/2464] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:17:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:17:17.449438 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a06c1b-bf9b-49c1-bded-0ee2e3a7d7f7 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:17:17.449964 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a06c1b-bf9b-49c1-bded-0ee2e3a7d7f7 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:17:17.449964 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a06c1b-bf9b-49c1-bded-0ee2e3a7d7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:17:17.469345 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-f6a06c1b-bf9b-49c1-bded-0ee2e3a7d7f7 None None] MFA Rules not processed for user `5e51df81654f4ece9a90adaa1f7a5f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:17:17.470539 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-f6a06c1b-bf9b-49c1-bded-0ee2e3a7d7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:17:17.477421 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1248/2465] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:17:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:18:46.807954 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfe634-f915-4287-be7f-bddb6f1734de service nova] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:18:46.830664 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfe634-f915-4287-be7f-bddb6f1734de service nova] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:18:46.835759 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac0313-e7c7-41a8-b800-721b7289283f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908d23b035f14756b438b3a61a63b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:18:46.836403 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac0313-e7c7-41a8-b800-721b7289283f service placement] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:18:46.836700 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac0313-e7c7-41a8-b800-721b7289283f service placement] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:18:46.836963 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac0313-e7c7-41a8-b800-721b7289283f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:18:46.846167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac0313-e7c7-41a8-b800-721b7289283f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:18:46.847785 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac0313-e7c7-41a8-b800-721b7289283f service placement] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:18:46.857755 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1218/2466] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:18:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:19:00.546344 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a06c1b-bf9b-49c1-bded-0ee2e3a7d7f7 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:19:00.575342 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a06c1b-bf9b-49c1-bded-0ee2e3a7d7f7 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:19:00.581475 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071fb97-676e-44a6-bb7d-3444fedae432 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:19:00.582201 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071fb97-676e-44a6-bb7d-3444fedae432 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:19:00.582661 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071fb97-676e-44a6-bb7d-3444fedae432 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:19:00.583189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071fb97-676e-44a6-bb7d-3444fedae432 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:19:00.593478 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071fb97-676e-44a6-bb7d-3444fedae432 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:19:00.595091 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071fb97-676e-44a6-bb7d-3444fedae432 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:19:00.621024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1249/2467] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:19:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:19:47.283161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac0313-e7c7-41a8-b800-721b7289283f service placement] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:19:47.303414 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac0313-e7c7-41a8-b800-721b7289283f service placement] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:19:47.307095 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578392d-91b0-48c8-af3e-75e1ad6d96d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:19:47.307731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578392d-91b0-48c8-af3e-75e1ad6d96d7 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:19:47.308014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578392d-91b0-48c8-af3e-75e1ad6d96d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:19:47.308285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578392d-91b0-48c8-af3e-75e1ad6d96d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:19:47.310168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6578392d-91b0-48c8-af3e-75e1ad6d96d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:19:47.343591 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578392d-91b0-48c8-af3e-75e1ad6d96d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:19:47.345561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578392d-91b0-48c8-af3e-75e1ad6d96d7 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:19:47.364161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1219/2468] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:19:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:19:58.255926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071fb97-676e-44a6-bb7d-3444fedae432 service nova] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:19:58.267536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071fb97-676e-44a6-bb7d-3444fedae432 service nova] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:19:58.273198 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b159d-5d12-459d-adcc-99a2219501b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:19:58.273840 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b159d-5d12-459d-adcc-99a2219501b2 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:19:58.274117 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b159d-5d12-459d-adcc-99a2219501b2 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:19:58.274390 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b159d-5d12-459d-adcc-99a2219501b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:19:58.276340 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-514b159d-5d12-459d-adcc-99a2219501b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:19:58.357942 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b159d-5d12-459d-adcc-99a2219501b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:19:58.359614 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b159d-5d12-459d-adcc-99a2219501b2 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:19:58.379802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1250/2469] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:19:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:20:48.718310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578392d-91b0-48c8-af3e-75e1ad6d96d7 service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:20:48.720509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6578392d-91b0-48c8-af3e-75e1ad6d96d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:20:48.745494 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578392d-91b0-48c8-af3e-75e1ad6d96d7 service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:20:48.749512 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48783af6-b307-4481-991d-5abc163f8589 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:20:48.750162 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48783af6-b307-4481-991d-5abc163f8589 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:20:48.750449 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48783af6-b307-4481-991d-5abc163f8589 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:20:48.750723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48783af6-b307-4481-991d-5abc163f8589 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:20:48.752733 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-48783af6-b307-4481-991d-5abc163f8589 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:20:48.811973 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48783af6-b307-4481-991d-5abc163f8589 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:20:48.814213 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48783af6-b307-4481-991d-5abc163f8589 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:20:48.824062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1220/2470] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:20:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:21:28.678607 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b159d-5d12-459d-adcc-99a2219501b2 service nova] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:21:28.689148 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b159d-5d12-459d-adcc-99a2219501b2 service nova] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:21:28.695382 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c470e-f84b-4f4d-8d39-19509d1d004e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:21:28.695382 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c470e-f84b-4f4d-8d39-19509d1d004e service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:21:28.695382 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c470e-f84b-4f4d-8d39-19509d1d004e service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:21:28.695382 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c470e-f84b-4f4d-8d39-19509d1d004e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:21:28.705553 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c470e-f84b-4f4d-8d39-19509d1d004e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:21:28.707033 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c470e-f84b-4f4d-8d39-19509d1d004e service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:21:28.716643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1251/2471] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:21:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:22:51.187345 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48783af6-b307-4481-991d-5abc163f8589 service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:22:51.188921 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-48783af6-b307-4481-991d-5abc163f8589 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:22:51.258404 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48783af6-b307-4481-991d-5abc163f8589 service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:22:51.261990 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abf234-10fc-466e-bdff-3d956b12c3f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:22:51.262690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abf234-10fc-466e-bdff-3d956b12c3f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:22:51.263007 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abf234-10fc-466e-bdff-3d956b12c3f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:22:51.263281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abf234-10fc-466e-bdff-3d956b12c3f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:22:51.265162 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c9abf234-10fc-466e-bdff-3d956b12c3f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:22:51.274282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abf234-10fc-466e-bdff-3d956b12c3f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:22:51.275729 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abf234-10fc-466e-bdff-3d956b12c3f0 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:22:51.284497 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1221/2472] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:22:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:23:00.750278 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c470e-f84b-4f4d-8d39-19509d1d004e service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:23:00.752239 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-294c470e-f84b-4f4d-8d39-19509d1d004e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:23:00.765110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c470e-f84b-4f4d-8d39-19509d1d004e service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:23:00.769706 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4333a7-3810-48bb-a8ed-81c560f839e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:23:00.769978 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4333a7-3810-48bb-a8ed-81c560f839e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:23:00.770260 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4333a7-3810-48bb-a8ed-81c560f839e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:23:00.771777 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4333a7-3810-48bb-a8ed-81c560f839e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:23:00.772644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-3f4333a7-3810-48bb-a8ed-81c560f839e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:23:00.859904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4333a7-3810-48bb-a8ed-81c560f839e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:23:00.861345 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4333a7-3810-48bb-a8ed-81c560f839e6 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:23:00.872028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1252/2473] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:23:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:23:02.050143 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abf234-10fc-466e-bdff-3d956b12c3f0 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:23:02.058674 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abf234-10fc-466e-bdff-3d956b12c3f0 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:23:02.062339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f065a06-a1e3-4f0a-a91b-67ba774f0966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:23:02.063001 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f065a06-a1e3-4f0a-a91b-67ba774f0966 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:23:02.063282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f065a06-a1e3-4f0a-a91b-67ba774f0966 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:23:02.063585 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f065a06-a1e3-4f0a-a91b-67ba774f0966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:23:02.065428 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-1f065a06-a1e3-4f0a-a91b-67ba774f0966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:23:02.078920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f065a06-a1e3-4f0a-a91b-67ba774f0966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:23:02.080328 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f065a06-a1e3-4f0a-a91b-67ba774f0966 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:23:02.090939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1222/2474] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:23:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:23:52.452809 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4333a7-3810-48bb-a8ed-81c560f839e6 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:23:52.454433 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-3f4333a7-3810-48bb-a8ed-81c560f839e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:23:52.534370 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4333a7-3810-48bb-a8ed-81c560f839e6 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:23:52.539370 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a61ce-f651-4572-b765-2d696206a4bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908d23b035f14756b438b3a61a63b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:23:52.540015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a61ce-f651-4572-b765-2d696206a4bd service placement] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:23:52.540298 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a61ce-f651-4572-b765-2d696206a4bd service placement] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:23:52.540588 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a61ce-f651-4572-b765-2d696206a4bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:23:52.542449 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-d34a61ce-f651-4572-b765-2d696206a4bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:23:52.554013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a61ce-f651-4572-b765-2d696206a4bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:23:52.555636 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a61ce-f651-4572-b765-2d696206a4bd service placement] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:23:52.565907 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1253/2475] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:23:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:24:00.479589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f065a06-a1e3-4f0a-a91b-67ba774f0966 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:24:00.539780 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f065a06-a1e3-4f0a-a91b-67ba774f0966 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:24:00.543591 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f7212-d4c6-4063-9237-88921e0d0c80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:24:00.544347 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f7212-d4c6-4063-9237-88921e0d0c80 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:24:00.544925 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f7212-d4c6-4063-9237-88921e0d0c80 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:24:00.545206 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f7212-d4c6-4063-9237-88921e0d0c80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:24:00.547239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ff3f7212-d4c6-4063-9237-88921e0d0c80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:24:00.621159 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f7212-d4c6-4063-9237-88921e0d0c80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:24:00.623275 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f7212-d4c6-4063-9237-88921e0d0c80 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:24:00.633813 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1223/2476] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:24:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:24:47.767402 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a61ce-f651-4572-b765-2d696206a4bd service placement] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:24:47.769135 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-d34a61ce-f651-4572-b765-2d696206a4bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:24:47.784697 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a61ce-f651-4572-b765-2d696206a4bd service placement] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:24:47.790167 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26840913-cfec-4a1c-ab27-9a12d91f61eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:24:47.790847 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26840913-cfec-4a1c-ab27-9a12d91f61eb service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:24:47.791142 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26840913-cfec-4a1c-ab27-9a12d91f61eb service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:24:47.791417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26840913-cfec-4a1c-ab27-9a12d91f61eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:24:47.852959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26840913-cfec-4a1c-ab27-9a12d91f61eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:24:47.854547 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26840913-cfec-4a1c-ab27-9a12d91f61eb service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:24:47.864940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1254/2477] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:24:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:24:50.199767 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f7212-d4c6-4063-9237-88921e0d0c80 service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:24:50.201355 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ff3f7212-d4c6-4063-9237-88921e0d0c80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:24:50.220025 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f7212-d4c6-4063-9237-88921e0d0c80 service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:24:50.231785 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b1f1b-fd82-4911-b5d1-0b7cf8412d8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:24:50.233632 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b1f1b-fd82-4911-b5d1-0b7cf8412d8f service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:24:50.234375 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b1f1b-fd82-4911-b5d1-0b7cf8412d8f service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:24:50.234915 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b1f1b-fd82-4911-b5d1-0b7cf8412d8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:24:50.239251 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-2f2b1f1b-fd82-4911-b5d1-0b7cf8412d8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:24:50.276864 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b1f1b-fd82-4911-b5d1-0b7cf8412d8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:24:50.282566 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b1f1b-fd82-4911-b5d1-0b7cf8412d8f service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:24:50.298647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1224/2478] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:24:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:24:59.183531 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26840913-cfec-4a1c-ab27-9a12d91f61eb service nova] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:24:59.195101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26840913-cfec-4a1c-ab27-9a12d91f61eb service nova] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:24:59.198742 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb822cd-9983-4e9e-992e-66f1e733ec37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:24:59.199426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb822cd-9983-4e9e-992e-66f1e733ec37 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:24:59.199702 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb822cd-9983-4e9e-992e-66f1e733ec37 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:24:59.199984 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb822cd-9983-4e9e-992e-66f1e733ec37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:24:59.209371 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb822cd-9983-4e9e-992e-66f1e733ec37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:24:59.210810 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb822cd-9983-4e9e-992e-66f1e733ec37 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:24:59.220703 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1255/2479] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:24:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:25:05.474925 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ea9cd-8cb5-4257-8e3a-ed1cb8ac6483 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:25:05.475479 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ea9cd-8cb5-4257-8e3a-ed1cb8ac6483 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:25:05.475479 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ea9cd-8cb5-4257-8e3a-ed1cb8ac6483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:25:05.507863 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-c31ea9cd-8cb5-4257-8e3a-ed1cb8ac6483 None None] MFA Rules not processed for user `5e51df81654f4ece9a90adaa1f7a5f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:25:05.510463 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c31ea9cd-8cb5-4257-8e3a-ed1cb8ac6483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:25:05.516238 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1225/2480] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:25:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:25:05.863098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb822cd-9983-4e9e-992e-66f1e733ec37 service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:25:05.872540 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb822cd-9983-4e9e-992e-66f1e733ec37 service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:25:05.876155 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addf794-d854-42ba-a8cb-5121a5c922ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:25:05.876803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addf794-d854-42ba-a8cb-5121a5c922ff service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:25:05.877081 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addf794-d854-42ba-a8cb-5121a5c922ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:25:05.877354 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addf794-d854-42ba-a8cb-5121a5c922ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:25:05.879398 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-5addf794-d854-42ba-a8cb-5121a5c922ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:25:05.892092 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addf794-d854-42ba-a8cb-5121a5c922ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:25:05.893534 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addf794-d854-42ba-a8cb-5121a5c922ff service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:25:05.902410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1256/2481] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:25:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:25:06.331474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ea9cd-8cb5-4257-8e3a-ed1cb8ac6483 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:25:06.356826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ea9cd-8cb5-4257-8e3a-ed1cb8ac6483 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:25:06.370727 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330dce23-99de-466b-ace0-4ad39cf5c360 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908d23b035f14756b438b3a61a63b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:25:06.370727 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330dce23-99de-466b-ace0-4ad39cf5c360 service placement] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:25:06.370727 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330dce23-99de-466b-ace0-4ad39cf5c360 service placement] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:25:06.370727 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330dce23-99de-466b-ace0-4ad39cf5c360 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:25:06.372923 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-330dce23-99de-466b-ace0-4ad39cf5c360 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:25:06.385649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330dce23-99de-466b-ace0-4ad39cf5c360 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:25:06.387304 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330dce23-99de-466b-ace0-4ad39cf5c360 service placement] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:25:06.398261 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1226/2482] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:25:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:25:14.903290 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addf794-d854-42ba-a8cb-5121a5c922ff service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:25:14.929153 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addf794-d854-42ba-a8cb-5121a5c922ff service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:25:14.935140 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871a0f1-a4d0-489e-a36f-f69f9ed68b7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:25:14.936087 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871a0f1-a4d0-489e-a36f-f69f9ed68b7f service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:25:14.936573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871a0f1-a4d0-489e-a36f-f69f9ed68b7f service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:25:14.937625 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871a0f1-a4d0-489e-a36f-f69f9ed68b7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:25:14.951314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871a0f1-a4d0-489e-a36f-f69f9ed68b7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:25:14.952925 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871a0f1-a4d0-489e-a36f-f69f9ed68b7f service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:25:14.964547 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1257/2483] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:25:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:25:19.809097 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330dce23-99de-466b-ace0-4ad39cf5c360 service placement] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:25:19.823590 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330dce23-99de-466b-ace0-4ad39cf5c360 service placement] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:25:19.830235 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8240687-b3cd-4823-9693-205e8423cee3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:25:19.830958 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8240687-b3cd-4823-9693-205e8423cee3 service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:25:19.831244 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8240687-b3cd-4823-9693-205e8423cee3 service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:25:19.831540 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8240687-b3cd-4823-9693-205e8423cee3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:25:19.833494 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-f8240687-b3cd-4823-9693-205e8423cee3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:25:19.846403 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8240687-b3cd-4823-9693-205e8423cee3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:25:19.848060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8240687-b3cd-4823-9693-205e8423cee3 service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:25:19.860535 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1227/2484] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:25:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:25:48.396355 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871a0f1-a4d0-489e-a36f-f69f9ed68b7f service nova] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:25:48.407967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871a0f1-a4d0-489e-a36f-f69f9ed68b7f service nova] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:25:48.412259 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab83b82-8781-4439-83b0-e2a73d19c074 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:25:48.416259 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab83b82-8781-4439-83b0-e2a73d19c074 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:25:48.416259 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab83b82-8781-4439-83b0-e2a73d19c074 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:25:48.416259 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab83b82-8781-4439-83b0-e2a73d19c074 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:25:48.426264 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab83b82-8781-4439-83b0-e2a73d19c074 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:25:48.427806 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab83b82-8781-4439-83b0-e2a73d19c074 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:25:48.438008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1258/2485] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:25:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:27:51.012002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8240687-b3cd-4823-9693-205e8423cee3 service nova] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:27:51.013593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-f8240687-b3cd-4823-9693-205e8423cee3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:27:51.055422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8240687-b3cd-4823-9693-205e8423cee3 service nova] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:27:51.059188 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a4b55-a72d-405c-bfa1-976851b5e887 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:27:51.060006 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a4b55-a72d-405c-bfa1-976851b5e887 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:27:51.060301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a4b55-a72d-405c-bfa1-976851b5e887 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:27:51.060576 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a4b55-a72d-405c-bfa1-976851b5e887 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:27:51.062640 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-619a4b55-a72d-405c-bfa1-976851b5e887 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:27:51.157605 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a4b55-a72d-405c-bfa1-976851b5e887 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:27:51.159156 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a4b55-a72d-405c-bfa1-976851b5e887 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:27:51.180386 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1228/2486] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:27:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:28:00.929456 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab83b82-8781-4439-83b0-e2a73d19c074 service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:28:00.957896 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab83b82-8781-4439-83b0-e2a73d19c074 service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:28:00.961486 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb8acb-5f38-44f2-9028-5ac72864462d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:28:00.962124 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb8acb-5f38-44f2-9028-5ac72864462d service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:28:00.962400 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb8acb-5f38-44f2-9028-5ac72864462d service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:28:00.963210 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb8acb-5f38-44f2-9028-5ac72864462d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:28:00.981072 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb8acb-5f38-44f2-9028-5ac72864462d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:28:00.982414 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb8acb-5f38-44f2-9028-5ac72864462d service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:28:00.993876 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1259/2487] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:28:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:28:02.176674 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a4b55-a72d-405c-bfa1-976851b5e887 service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:28:02.186435 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a4b55-a72d-405c-bfa1-976851b5e887 service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:28:02.189976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81a7c2-793f-41b6-8c56-779cbf5fb9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:28:02.190628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81a7c2-793f-41b6-8c56-779cbf5fb9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:28:02.190930 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81a7c2-793f-41b6-8c56-779cbf5fb9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:28:02.191215 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81a7c2-793f-41b6-8c56-779cbf5fb9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:28:02.201574 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81a7c2-793f-41b6-8c56-779cbf5fb9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:28:02.202967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81a7c2-793f-41b6-8c56-779cbf5fb9f8 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:28:02.213786 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1229/2488] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:28:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:28:53.472717 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb8acb-5f38-44f2-9028-5ac72864462d service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:28:53.480047 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb8acb-5f38-44f2-9028-5ac72864462d service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:28:53.483709 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a42ce7-9a49-4ff8-a916-476668236955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:28:53.484346 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a42ce7-9a49-4ff8-a916-476668236955 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:28:53.484623 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a42ce7-9a49-4ff8-a916-476668236955 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:28:53.484896 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a42ce7-9a49-4ff8-a916-476668236955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:28:53.492181 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a42ce7-9a49-4ff8-a916-476668236955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:28:53.493595 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a42ce7-9a49-4ff8-a916-476668236955 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:28:53.501991 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1260/2489] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:28:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:28:55.770387 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81a7c2-793f-41b6-8c56-779cbf5fb9f8 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:28:55.792543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81a7c2-793f-41b6-8c56-779cbf5fb9f8 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:28:55.797488 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8d956-a6fa-431d-a4df-ab9ff5e7ebcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908d23b035f14756b438b3a61a63b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:28:55.798119 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8d956-a6fa-431d-a4df-ab9ff5e7ebcc service placement] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:28:55.798398 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8d956-a6fa-431d-a4df-ab9ff5e7ebcc service placement] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:28:55.798667 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8d956-a6fa-431d-a4df-ab9ff5e7ebcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:28:55.807626 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8d956-a6fa-431d-a4df-ab9ff5e7ebcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:28:55.809190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8d956-a6fa-431d-a4df-ab9ff5e7ebcc service placement] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:28:55.823507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1230/2490] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:28:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:29:51.597359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a42ce7-9a49-4ff8-a916-476668236955 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:29:51.617952 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a42ce7-9a49-4ff8-a916-476668236955 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:29:51.622189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c68a0-f439-41ba-88b8-84da14531eb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:29:51.622928 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c68a0-f439-41ba-88b8-84da14531eb9 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:29:51.623139 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c68a0-f439-41ba-88b8-84da14531eb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:29:51.623375 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c68a0-f439-41ba-88b8-84da14531eb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:29:51.632328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c68a0-f439-41ba-88b8-84da14531eb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:29:51.633752 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c68a0-f439-41ba-88b8-84da14531eb9 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:29:51.661321 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1261/2491] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:29:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:29:51.778288 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8d956-a6fa-431d-a4df-ab9ff5e7ebcc service placement] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:29:51.787488 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8d956-a6fa-431d-a4df-ab9ff5e7ebcc service placement] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:29:51.791636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c208c-942b-4bc4-8f5a-7aafdc58488b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:29:51.792262 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c208c-942b-4bc4-8f5a-7aafdc58488b service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:29:51.792540 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c208c-942b-4bc4-8f5a-7aafdc58488b service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:29:51.792811 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c208c-942b-4bc4-8f5a-7aafdc58488b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:29:51.794982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-e17c208c-942b-4bc4-8f5a-7aafdc58488b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:29:51.831740 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c208c-942b-4bc4-8f5a-7aafdc58488b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:29:51.833192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c208c-942b-4bc4-8f5a-7aafdc58488b service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:29:51.857863 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1231/2492] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:29:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:29:53.894039 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c68a0-f439-41ba-88b8-84da14531eb9 service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:29:53.929869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c68a0-f439-41ba-88b8-84da14531eb9 service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:29:53.937498 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8bd22-e226-44a6-82fe-b58d66ef69f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:29:53.938385 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8bd22-e226-44a6-82fe-b58d66ef69f1 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:29:53.938728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8bd22-e226-44a6-82fe-b58d66ef69f1 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:29:53.939046 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8bd22-e226-44a6-82fe-b58d66ef69f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:29:53.950034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8bd22-e226-44a6-82fe-b58d66ef69f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:29:53.951737 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8bd22-e226-44a6-82fe-b58d66ef69f1 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:29:53.962946 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1262/2493] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:29:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:29:57.172790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c208c-942b-4bc4-8f5a-7aafdc58488b service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:29:57.182989 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c208c-942b-4bc4-8f5a-7aafdc58488b service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:29:57.186535 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce571ca0-5b26-43ee-a3bb-b030e82590db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:29:57.187215 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce571ca0-5b26-43ee-a3bb-b030e82590db service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:29:57.187516 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce571ca0-5b26-43ee-a3bb-b030e82590db service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:29:57.187770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce571ca0-5b26-43ee-a3bb-b030e82590db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:29:57.189549 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ce571ca0-5b26-43ee-a3bb-b030e82590db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:29:57.279128 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce571ca0-5b26-43ee-a3bb-b030e82590db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:29:57.280571 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce571ca0-5b26-43ee-a3bb-b030e82590db service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:29:57.299761 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1232/2494] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:29:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:29:57.775205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8bd22-e226-44a6-82fe-b58d66ef69f1 service nova] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:29:57.791868 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8bd22-e226-44a6-82fe-b58d66ef69f1 service nova] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:29:57.798891 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b2a86-bfa0-4bf0-9801-792e4690b3b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:29:57.799630 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b2a86-bfa0-4bf0-9801-792e4690b3b5 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:29:57.800076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b2a86-bfa0-4bf0-9801-792e4690b3b5 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:29:57.800400 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b2a86-bfa0-4bf0-9801-792e4690b3b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:29:57.809826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b2a86-bfa0-4bf0-9801-792e4690b3b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:29:57.811858 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b2a86-bfa0-4bf0-9801-792e4690b3b5 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:29:57.822189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1263/2495] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:29:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:30:01.135503 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce571ca0-5b26-43ee-a3bb-b030e82590db service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:30:01.137248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ce571ca0-5b26-43ee-a3bb-b030e82590db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:30:01.151901 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce571ca0-5b26-43ee-a3bb-b030e82590db service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:30:01.157086 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbc390-76da-4d3b-95bc-5d13e4110d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:30:01.158030 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbc390-76da-4d3b-95bc-5d13e4110d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:30:01.158316 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbc390-76da-4d3b-95bc-5d13e4110d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:30:01.158595 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbc390-76da-4d3b-95bc-5d13e4110d5b admin admin] PATH_INFO: `/v3/users/c1627da761c74fc79523a0fa319176b4` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:30:01.159894 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbc390-76da-4d3b-95bc-5d13e4110d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1627da761c74fc79523a0fa319176b4)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:30:01.162202 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbc390-76da-4d3b-95bc-5d13e4110d5b admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:30:01.223129 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-58bbc390-76da-4d3b-95bc-5d13e4110d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1627da761c74fc79523a0fa319176b4'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:30:01.234149 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-58bbc390-76da-4d3b-95bc-5d13e4110d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1627da761c74fc79523a0fa319176b4'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:30:01.247709 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-58bbc390-76da-4d3b-95bc-5d13e4110d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1627da761c74fc79523a0fa319176b4'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:30:01.248491 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-58bbc390-76da-4d3b-95bc-5d13e4110d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1627da761c74fc79523a0fa319176b4'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:30:01.255372 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-58bbc390-76da-4d3b-95bc-5d13e4110d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1627da761c74fc79523a0fa319176b4'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:30:01.262306 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1233/2496] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:30:01 2022] DELETE /identity/v3/users/c1627da761c74fc79523a0fa319176b4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:30:01.463540 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b2a86-bfa0-4bf0-9801-792e4690b3b5 service nova] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:30:01.478239 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b2a86-bfa0-4bf0-9801-792e4690b3b5 service nova] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:30:01.543161 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13bd1f-739e-4d74-86ea-6636fb8b2cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:30:01.544018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13bd1f-739e-4d74-86ea-6636fb8b2cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:30:01.544557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13bd1f-739e-4d74-86ea-6636fb8b2cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:30:01.544818 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13bd1f-739e-4d74-86ea-6636fb8b2cf4 admin admin] PATH_INFO: `/v3/projects/111be86266874d2ebfa7f6bd36125719` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:30:01.546050 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13bd1f-739e-4d74-86ea-6636fb8b2cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=111be86266874d2ebfa7f6bd36125719)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:30:01.548008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13bd1f-739e-4d74-86ea-6636fb8b2cf4 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:30:01.596942 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4e13bd1f-739e-4d74-86ea-6636fb8b2cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '111be86266874d2ebfa7f6bd36125719', 'request_id': 'req-4e13bd1f-739e-4d74-86ea-6636fb8b2cf4'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:30:01.604515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4e13bd1f-739e-4d74-86ea-6636fb8b2cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '111be86266874d2ebfa7f6bd36125719', 'request_id': 'req-4e13bd1f-739e-4d74-86ea-6636fb8b2cf4'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:30:01.613973 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4e13bd1f-739e-4d74-86ea-6636fb8b2cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '111be86266874d2ebfa7f6bd36125719', 'request_id': 'req-4e13bd1f-739e-4d74-86ea-6636fb8b2cf4'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:30:01.627680 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4e13bd1f-739e-4d74-86ea-6636fb8b2cf4 admin admin] The token cache is being invalidate because project 111be86266874d2ebfa7f6bd36125719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:30:01.628097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4e13bd1f-739e-4d74-86ea-6636fb8b2cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:30:01.628912 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-4e13bd1f-739e-4d74-86ea-6636fb8b2cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:30:01.631047 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1264/2497] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:30:01 2022] DELETE /identity/v3/projects/111be86266874d2ebfa7f6bd36125719 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:30:01.636795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6511b-573c-455a-bc46-7efec7d9c4bd None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:30:01.637175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6511b-573c-455a-bc46-7efec7d9c4bd None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:30:01.637516 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6511b-573c-455a-bc46-7efec7d9c4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:30:01.699996 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-0eb6511b-573c-455a-bc46-7efec7d9c4bd None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:30:01.701218 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-0eb6511b-573c-455a-bc46-7efec7d9c4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:30:01.762329 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1234/2498] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:30:01.771269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8241277-b838-4e57-b190-43f32c679d58 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:30:01.771649 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8241277-b838-4e57-b190-43f32c679d58 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:30:01.772002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8241277-b838-4e57-b190-43f32c679d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:30:01.791612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-f8241277-b838-4e57-b190-43f32c679d58 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:30:01.792922 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-f8241277-b838-4e57-b190-43f32c679d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:30:01.801295 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1265/2499] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:30:01.805588 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6511b-573c-455a-bc46-7efec7d9c4bd None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:30:01.815321 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6511b-573c-455a-bc46-7efec7d9c4bd None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:30:01.819971 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54797621-c38d-4cfc-a8b6-05b5790f7ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:30:01.820624 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54797621-c38d-4cfc-a8b6-05b5790f7ffd admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:30:01.820909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54797621-c38d-4cfc-a8b6-05b5790f7ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:30:01.821184 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54797621-c38d-4cfc-a8b6-05b5790f7ffd admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:30:01.821908 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54797621-c38d-4cfc-a8b6-05b5790f7ffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:30:01.822211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54797621-c38d-4cfc-a8b6-05b5790f7ffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:30:01.823835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54797621-c38d-4cfc-a8b6-05b5790f7ffd admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:30:01.835789 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1235/2500] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:30:01.840645 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8241277-b838-4e57-b190-43f32c679d58 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:30:01.850579 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8241277-b838-4e57-b190-43f32c679d58 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:30:01.855981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd1519-123a-4b54-82b6-931462d34ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:30:01.856660 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd1519-123a-4b54-82b6-931462d34ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:30:01.856943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd1519-123a-4b54-82b6-931462d34ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:30:01.857242 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd1519-123a-4b54-82b6-931462d34ed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:30:01.857949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd1519-123a-4b54-82b6-931462d34ed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:30:01.859941 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd1519-123a-4b54-82b6-931462d34ed2 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:30:01.910130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1266/2501] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:30:01 2022] POST /identity/v3/projects => generated 403 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:30:01.914753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54797621-c38d-4cfc-a8b6-05b5790f7ffd admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:30:01.928071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54797621-c38d-4cfc-a8b6-05b5790f7ffd admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:30:02.000283 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24caf8d1-d4a2-4942-89cd-f409e77fa11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:30:02.000968 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24caf8d1-d4a2-4942-89cd-f409e77fa11d admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:30:02.001253 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24caf8d1-d4a2-4942-89cd-f409e77fa11d admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:30:02.001530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24caf8d1-d4a2-4942-89cd-f409e77fa11d admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:30:02.002236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24caf8d1-d4a2-4942-89cd-f409e77fa11d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:30:02.004231 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24caf8d1-d4a2-4942-89cd-f409e77fa11d admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:30:02.027054 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1236/2502] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:30:01 2022] POST /identity/v3/users => generated 302 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:30:02.030505 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd1519-123a-4b54-82b6-931462d34ed2 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:30:02.041533 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd1519-123a-4b54-82b6-931462d34ed2 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:30:02.046788 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461da6df-f467-43e6-8c4f-2cd78341a676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:30:02.047522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461da6df-f467-43e6-8c4f-2cd78341a676 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:30:02.047796 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461da6df-f467-43e6-8c4f-2cd78341a676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:30:02.048084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461da6df-f467-43e6-8c4f-2cd78341a676 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:30:02.048791 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461da6df-f467-43e6-8c4f-2cd78341a676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:30:02.050388 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461da6df-f467-43e6-8c4f-2cd78341a676 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:30:02.061006 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1267/2503] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:30:02.065037 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24caf8d1-d4a2-4942-89cd-f409e77fa11d admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:30:02.075749 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24caf8d1-d4a2-4942-89cd-f409e77fa11d admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:30:02.080863 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfc149-2683-4952-9f43-b4cfcfe4ce2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:30:02.081821 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfc149-2683-4952-9f43-b4cfcfe4ce2f admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:30:02.082314 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfc149-2683-4952-9f43-b4cfcfe4ce2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:30:02.082787 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfc149-2683-4952-9f43-b4cfcfe4ce2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:30:02.083899 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfc149-2683-4952-9f43-b4cfcfe4ce2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:30:02.086636 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfc149-2683-4952-9f43-b4cfcfe4ce2f admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:30:02.100629 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1237/2504] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:30:02.105292 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461da6df-f467-43e6-8c4f-2cd78341a676 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:30:02.115833 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461da6df-f467-43e6-8c4f-2cd78341a676 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:30:02.120897 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73436059-db5c-4adb-83eb-9de21215f57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:30:02.121804 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73436059-db5c-4adb-83eb-9de21215f57a admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:30:02.122078 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73436059-db5c-4adb-83eb-9de21215f57a admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:30:02.122345 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73436059-db5c-4adb-83eb-9de21215f57a admin admin] PATH_INFO: `/v3/projects/76d1be1ae1e84f20862113ac3d91f008/users/f00c6344a5114cd4870741f5e7829033/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:30:02.139504 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73436059-db5c-4adb-83eb-9de21215f57a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d1be1ae1e84f20862113ac3d91f008, user_id=f00c6344a5114cd4870741f5e7829033, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:30:02.142282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73436059-db5c-4adb-83eb-9de21215f57a admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:30:02.157935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1268/2505] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:30:02 2022] PUT /identity/v3/projects/76d1be1ae1e84f20862113ac3d91f008/users/f00c6344a5114cd4870741f5e7829033/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:30:02.174928 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c881428-5194-4d23-a73e-7332a99b8da0 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:30:02.175548 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c881428-5194-4d23-a73e-7332a99b8da0 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:30:02.175548 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c881428-5194-4d23-a73e-7332a99b8da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:30:02.204732 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-3c881428-5194-4d23-a73e-7332a99b8da0 None None] MFA Rules not processed for user `f00c6344a5114cd4870741f5e7829033`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:30:02.205939 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-3c881428-5194-4d23-a73e-7332a99b8da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:30:02.272540 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1238/2506] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:30:02.277556 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73436059-db5c-4adb-83eb-9de21215f57a admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:30:02.344047 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73436059-db5c-4adb-83eb-9de21215f57a admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:30:02.349270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bf5bc-f401-4682-a3d5-92a24aef96a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:30:02.349884 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bf5bc-f401-4682-a3d5-92a24aef96a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:30:02.350163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bf5bc-f401-4682-a3d5-92a24aef96a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:30:02.350565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bf5bc-f401-4682-a3d5-92a24aef96a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:30:02.351306 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8bf5bc-f401-4682-a3d5-92a24aef96a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:30:02.353278 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8bf5bc-f401-4682-a3d5-92a24aef96a9 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:30:02.382191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1269/2507] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:30:02 2022] POST /identity/v3/projects => generated 405 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:30:02.385788 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c881428-5194-4d23-a73e-7332a99b8da0 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:30:02.403017 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c881428-5194-4d23-a73e-7332a99b8da0 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:30:02.465507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c276d-f84e-4a2f-ac41-172245cbacb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:30:02.466176 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c276d-f84e-4a2f-ac41-172245cbacb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:30:02.466450 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c276d-f84e-4a2f-ac41-172245cbacb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:30:02.466716 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c276d-f84e-4a2f-ac41-172245cbacb5 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:30:02.467438 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c276d-f84e-4a2f-ac41-172245cbacb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:30:02.469360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c276d-f84e-4a2f-ac41-172245cbacb5 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:30:02.491760 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1239/2508] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:30:02 2022] POST /identity/v3/users => generated 309 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:30:02.494456 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bf5bc-f401-4682-a3d5-92a24aef96a9 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:30:02.505277 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bf5bc-f401-4682-a3d5-92a24aef96a9 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:30:02.510707 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d804c-8668-4778-bb9e-5942889e94b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:30:02.511400 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d804c-8668-4778-bb9e-5942889e94b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:30:02.511678 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d804c-8668-4778-bb9e-5942889e94b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:30:02.511947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d804c-8668-4778-bb9e-5942889e94b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:30:02.512670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d804c-8668-4778-bb9e-5942889e94b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:30:02.514256 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d804c-8668-4778-bb9e-5942889e94b8 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:30:02.525466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1270/2509] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:30:02.529952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c276d-f84e-4a2f-ac41-172245cbacb5 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:30:02.540469 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c276d-f84e-4a2f-ac41-172245cbacb5 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:30:02.545668 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92212370-6c9c-4fd5-84d6-a965e7b24c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:30:02.546563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92212370-6c9c-4fd5-84d6-a965e7b24c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:30:02.546859 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92212370-6c9c-4fd5-84d6-a965e7b24c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:30:02.547148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92212370-6c9c-4fd5-84d6-a965e7b24c89 admin admin] PATH_INFO: `/v3/projects/698f0ee6cefb47218a597ebd6f2f5e07/users/c637118b5c814502bfddaa26da3ad9ce/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:30:02.563630 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92212370-6c9c-4fd5-84d6-a965e7b24c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698f0ee6cefb47218a597ebd6f2f5e07, user_id=c637118b5c814502bfddaa26da3ad9ce, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:30:02.566297 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92212370-6c9c-4fd5-84d6-a965e7b24c89 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:30:02.583252 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1240/2510] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:30:02 2022] PUT /identity/v3/projects/698f0ee6cefb47218a597ebd6f2f5e07/users/c637118b5c814502bfddaa26da3ad9ce/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:30:02.587973 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d804c-8668-4778-bb9e-5942889e94b8 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:30:02.598896 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d804c-8668-4778-bb9e-5942889e94b8 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:30:02.668873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb4152-92ed-4d99-a744-7fa4538de2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:30:02.669721 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb4152-92ed-4d99-a744-7fa4538de2af admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:30:02.670016 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb4152-92ed-4d99-a744-7fa4538de2af admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:30:02.670274 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb4152-92ed-4d99-a744-7fa4538de2af admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:30:02.671049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb4152-92ed-4d99-a744-7fa4538de2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:30:02.672724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb4152-92ed-4d99-a744-7fa4538de2af admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:30:02.684827 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1271/2511] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:30:02.689599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92212370-6c9c-4fd5-84d6-a965e7b24c89 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:30:02.701058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92212370-6c9c-4fd5-84d6-a965e7b24c89 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:30:02.706243 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea7414-e76d-4a00-a03b-9d9ba940cd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:30:02.707328 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea7414-e76d-4a00-a03b-9d9ba940cd04 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:30:02.707605 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea7414-e76d-4a00-a03b-9d9ba940cd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:30:02.707878 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea7414-e76d-4a00-a03b-9d9ba940cd04 admin admin] PATH_INFO: `/v3/projects/698f0ee6cefb47218a597ebd6f2f5e07/users/c637118b5c814502bfddaa26da3ad9ce/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:30:02.709941 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea7414-e76d-4a00-a03b-9d9ba940cd04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698f0ee6cefb47218a597ebd6f2f5e07, user_id=c637118b5c814502bfddaa26da3ad9ce, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:30:02.712838 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea7414-e76d-4a00-a03b-9d9ba940cd04 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:30:02.724236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1241/2512] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:30:02 2022] PUT /identity/v3/projects/698f0ee6cefb47218a597ebd6f2f5e07/users/c637118b5c814502bfddaa26da3ad9ce/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:30:02.736610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f8930-5e6c-4e4b-bb5b-283192881123 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:30:02.736888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f8930-5e6c-4e4b-bb5b-283192881123 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:30:02.737164 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f8930-5e6c-4e4b-bb5b-283192881123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:30:02.763639 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-f29f8930-5e6c-4e4b-bb5b-283192881123 None None] MFA Rules not processed for user `c637118b5c814502bfddaa26da3ad9ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:30:02.764857 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-f29f8930-5e6c-4e4b-bb5b-283192881123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:30:02.835643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1272/2513] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:30:11.916517 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea7414-e76d-4a00-a03b-9d9ba940cd04 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:30:11.919344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c4ea7414-e76d-4a00-a03b-9d9ba940cd04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:30:11.985408 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea7414-e76d-4a00-a03b-9d9ba940cd04 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:30:11.990310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf638f9-a989-427b-89e0-69d255216a18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:30:11.991008 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf638f9-a989-427b-89e0-69d255216a18 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:30:11.991287 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf638f9-a989-427b-89e0-69d255216a18 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:30:11.991555 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf638f9-a989-427b-89e0-69d255216a18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:30:12.005626 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf638f9-a989-427b-89e0-69d255216a18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:30:12.008436 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf638f9-a989-427b-89e0-69d255216a18 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:30:12.025869 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1242/2514] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:30:11 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:31:52.220357 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f8930-5e6c-4e4b-bb5b-283192881123 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:31:52.221833 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-f29f8930-5e6c-4e4b-bb5b-283192881123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:31:52.245320 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f8930-5e6c-4e4b-bb5b-283192881123 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:31:52.248841 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963aaaf-06df-4d3f-b5eb-3ac3860a641f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:31:52.249470 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963aaaf-06df-4d3f-b5eb-3ac3860a641f service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:31:52.249745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963aaaf-06df-4d3f-b5eb-3ac3860a641f service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:31:52.250012 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963aaaf-06df-4d3f-b5eb-3ac3860a641f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:31:52.251739 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-1963aaaf-06df-4d3f-b5eb-3ac3860a641f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:31:52.329383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963aaaf-06df-4d3f-b5eb-3ac3860a641f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:31:52.330957 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963aaaf-06df-4d3f-b5eb-3ac3860a641f service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:31:52.349462 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1273/2515] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:31:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:32:10.581881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89828627-87db-4bea-b0a1-9cc8882a8eff None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:32:10.582415 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89828627-87db-4bea-b0a1-9cc8882a8eff None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:32:10.582415 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89828627-87db-4bea-b0a1-9cc8882a8eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:32:10.639383 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-89828627-87db-4bea-b0a1-9cc8882a8eff None None] MFA Rules not processed for user `0c04f5fb770d49c0a50f2cfbd77e17e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:32:10.640596 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-89828627-87db-4bea-b0a1-9cc8882a8eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:32:10.703559 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1243/2516] 10.222.0.73 () {58 vars in 967 bytes} [Fri May 13 15:32:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:32:10.748313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963aaaf-06df-4d3f-b5eb-3ac3860a641f service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:32:10.749698 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-1963aaaf-06df-4d3f-b5eb-3ac3860a641f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:32:10.842106 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963aaaf-06df-4d3f-b5eb-3ac3860a641f service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:32:10.847146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc1869-6ab0-4743-bff7-aec47c07559a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27265a0c2e6b47c09f28b9cd3ac47d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:32:10.847791 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc1869-6ab0-4743-bff7-aec47c07559a service swift] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:32:10.848071 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc1869-6ab0-4743-bff7-aec47c07559a service swift] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:32:10.848344 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc1869-6ab0-4743-bff7-aec47c07559a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:32:10.856463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc1869-6ab0-4743-bff7-aec47c07559a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:32:10.858031 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc1869-6ab0-4743-bff7-aec47c07559a service swift] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:32:10.866007 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1274/2517] 10.222.0.73 () {60 vars in 1384 bytes} [Fri May 13 15:32:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 13 15:32:11.419896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89828627-87db-4bea-b0a1-9cc8882a8eff None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:32:11.421340 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-89828627-87db-4bea-b0a1-9cc8882a8eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:32:11.481348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89828627-87db-4bea-b0a1-9cc8882a8eff None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:32:11.485017 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0be8c-800a-464b-b48e-53ab86b35397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:32:11.485668 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0be8c-800a-464b-b48e-53ab86b35397 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:32:11.485975 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0be8c-800a-464b-b48e-53ab86b35397 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:32:11.486251 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0be8c-800a-464b-b48e-53ab86b35397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:32:11.488024 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-7ad0be8c-800a-464b-b48e-53ab86b35397 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:32:11.549596 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0be8c-800a-464b-b48e-53ab86b35397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:32:11.551097 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0be8c-800a-464b-b48e-53ab86b35397 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:32:11.563645 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1244/2518] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:32:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:32:18.235309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc1869-6ab0-4743-bff7-aec47c07559a service swift] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:32:18.236892 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-d4cc1869-6ab0-4743-bff7-aec47c07559a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:32:18.250570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc1869-6ab0-4743-bff7-aec47c07559a service swift] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:32:18.255963 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400f1bb-a082-4d97-aca8-7578011e47d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:32:18.256831 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400f1bb-a082-4d97-aca8-7578011e47d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:32:18.257118 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400f1bb-a082-4d97-aca8-7578011e47d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:32:18.257387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400f1bb-a082-4d97-aca8-7578011e47d4 admin admin] PATH_INFO: `/v3/users/37ad5c3cff984893a1207635de0418f6` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:32:18.271700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400f1bb-a082-4d97-aca8-7578011e47d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37ad5c3cff984893a1207635de0418f6)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:32:18.273624 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400f1bb-a082-4d97-aca8-7578011e47d4 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:32:18.317588 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e400f1bb-a082-4d97-aca8-7578011e47d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37ad5c3cff984893a1207635de0418f6'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:32:18.329280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e400f1bb-a082-4d97-aca8-7578011e47d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37ad5c3cff984893a1207635de0418f6'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:32:18.329861 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e400f1bb-a082-4d97-aca8-7578011e47d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37ad5c3cff984893a1207635de0418f6'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:32:18.330462 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e400f1bb-a082-4d97-aca8-7578011e47d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37ad5c3cff984893a1207635de0418f6'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:32:18.337500 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e400f1bb-a082-4d97-aca8-7578011e47d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37ad5c3cff984893a1207635de0418f6'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:32:18.350683 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1275/2519] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:32:18 2022] DELETE /identity/v3/users/37ad5c3cff984893a1207635de0418f6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:32:18.522337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0be8c-800a-464b-b48e-53ab86b35397 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:32:18.533417 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0be8c-800a-464b-b48e-53ab86b35397 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:32:18.590258 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c4c2f-9612-44eb-995c-333cc59b27e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:32:18.591150 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c4c2f-9612-44eb-995c-333cc59b27e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:32:18.591429 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c4c2f-9612-44eb-995c-333cc59b27e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:32:18.591710 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c4c2f-9612-44eb-995c-333cc59b27e6 admin admin] PATH_INFO: `/v3/projects/afca0c5c318c44c9aabae057a856ff86` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:32:18.601929 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c4c2f-9612-44eb-995c-333cc59b27e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afca0c5c318c44c9aabae057a856ff86)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:32:18.604014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c4c2f-9612-44eb-995c-333cc59b27e6 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:32:18.651664 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-232c4c2f-9612-44eb-995c-333cc59b27e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afca0c5c318c44c9aabae057a856ff86', 'request_id': 'req-232c4c2f-9612-44eb-995c-333cc59b27e6'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:32:18.658456 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-232c4c2f-9612-44eb-995c-333cc59b27e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afca0c5c318c44c9aabae057a856ff86', 'request_id': 'req-232c4c2f-9612-44eb-995c-333cc59b27e6'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:32:18.663743 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-232c4c2f-9612-44eb-995c-333cc59b27e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afca0c5c318c44c9aabae057a856ff86', 'request_id': 'req-232c4c2f-9612-44eb-995c-333cc59b27e6'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:32:18.677291 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-232c4c2f-9612-44eb-995c-333cc59b27e6 admin admin] The token cache is being invalidate because project afca0c5c318c44c9aabae057a856ff86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:32:18.677605 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-232c4c2f-9612-44eb-995c-333cc59b27e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:32:18.678247 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-232c4c2f-9612-44eb-995c-333cc59b27e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:32:18.679823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1245/2520] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:32:18 2022] DELETE /identity/v3/projects/afca0c5c318c44c9aabae057a856ff86 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:32:18.684385 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400f1bb-a082-4d97-aca8-7578011e47d4 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:32:18.685782 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e400f1bb-a082-4d97-aca8-7578011e47d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:32:18.699252 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400f1bb-a082-4d97-aca8-7578011e47d4 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:32:18.753094 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ecabd-5c3a-48ce-a8d6-eea09da92068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:32:18.753956 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ecabd-5c3a-48ce-a8d6-eea09da92068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:32:18.754235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ecabd-5c3a-48ce-a8d6-eea09da92068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:32:18.754510 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ecabd-5c3a-48ce-a8d6-eea09da92068 admin admin] PATH_INFO: `/v3/users/106526b6d8bc442a86f6e3be27a042c5` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:32:18.767900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ecabd-5c3a-48ce-a8d6-eea09da92068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=106526b6d8bc442a86f6e3be27a042c5)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:32:18.769844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ecabd-5c3a-48ce-a8d6-eea09da92068 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:32:18.815135 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-f60ecabd-5c3a-48ce-a8d6-eea09da92068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '106526b6d8bc442a86f6e3be27a042c5'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:32:18.826681 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-f60ecabd-5c3a-48ce-a8d6-eea09da92068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '106526b6d8bc442a86f6e3be27a042c5'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:32:18.827361 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-f60ecabd-5c3a-48ce-a8d6-eea09da92068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '106526b6d8bc442a86f6e3be27a042c5'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:32:18.827958 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-f60ecabd-5c3a-48ce-a8d6-eea09da92068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '106526b6d8bc442a86f6e3be27a042c5'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:32:18.834479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-f60ecabd-5c3a-48ce-a8d6-eea09da92068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '106526b6d8bc442a86f6e3be27a042c5'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:32:18.847437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1276/2521] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:32:18 2022] DELETE /identity/v3/users/106526b6d8bc442a86f6e3be27a042c5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:32:19.020872 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c4c2f-9612-44eb-995c-333cc59b27e6 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:32:19.022404 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-232c4c2f-9612-44eb-995c-333cc59b27e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:32:19.036115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c4c2f-9612-44eb-995c-333cc59b27e6 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:32:19.094635 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41123f0-9bab-4eb8-b67e-b17be0ef5e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:32:19.095506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41123f0-9bab-4eb8-b67e-b17be0ef5e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:32:19.095781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41123f0-9bab-4eb8-b67e-b17be0ef5e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:32:19.096050 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41123f0-9bab-4eb8-b67e-b17be0ef5e2c admin admin] PATH_INFO: `/v3/projects/bf2f40a7dfad4278961a5e29cfccaf29` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:32:19.107217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41123f0-9bab-4eb8-b67e-b17be0ef5e2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf2f40a7dfad4278961a5e29cfccaf29)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:32:19.109073 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41123f0-9bab-4eb8-b67e-b17be0ef5e2c admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:32:19.153857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-b41123f0-9bab-4eb8-b67e-b17be0ef5e2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf2f40a7dfad4278961a5e29cfccaf29', 'request_id': 'req-b41123f0-9bab-4eb8-b67e-b17be0ef5e2c'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:32:19.160672 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-b41123f0-9bab-4eb8-b67e-b17be0ef5e2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf2f40a7dfad4278961a5e29cfccaf29', 'request_id': 'req-b41123f0-9bab-4eb8-b67e-b17be0ef5e2c'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:32:19.167087 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-b41123f0-9bab-4eb8-b67e-b17be0ef5e2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf2f40a7dfad4278961a5e29cfccaf29', 'request_id': 'req-b41123f0-9bab-4eb8-b67e-b17be0ef5e2c'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:32:19.179250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-b41123f0-9bab-4eb8-b67e-b17be0ef5e2c admin admin] The token cache is being invalidate because project bf2f40a7dfad4278961a5e29cfccaf29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:32:19.179535 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-b41123f0-9bab-4eb8-b67e-b17be0ef5e2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:32:19.180148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-b41123f0-9bab-4eb8-b67e-b17be0ef5e2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:32:19.181666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1246/2522] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:32:19 2022] DELETE /identity/v3/projects/bf2f40a7dfad4278961a5e29cfccaf29 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:33:52.701098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ecabd-5c3a-48ce-a8d6-eea09da92068 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:33:52.702521 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-f60ecabd-5c3a-48ce-a8d6-eea09da92068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:33:52.715867 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ecabd-5c3a-48ce-a8d6-eea09da92068 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:33:52.773102 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123a044-c43d-487d-87e1-363d37fc0ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:33:52.773983 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123a044-c43d-487d-87e1-363d37fc0ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:33:52.774264 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123a044-c43d-487d-87e1-363d37fc0ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:33:52.774537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123a044-c43d-487d-87e1-363d37fc0ef1 admin admin] PATH_INFO: `/v3/users/f00c6344a5114cd4870741f5e7829033` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:33:52.775768 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123a044-c43d-487d-87e1-363d37fc0ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f00c6344a5114cd4870741f5e7829033)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:33:52.777658 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123a044-c43d-487d-87e1-363d37fc0ef1 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:33:52.828159 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2123a044-c43d-487d-87e1-363d37fc0ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f00c6344a5114cd4870741f5e7829033'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:33:52.844548 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2123a044-c43d-487d-87e1-363d37fc0ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f00c6344a5114cd4870741f5e7829033'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:33:52.844548 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2123a044-c43d-487d-87e1-363d37fc0ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f00c6344a5114cd4870741f5e7829033'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:33:52.845031 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2123a044-c43d-487d-87e1-363d37fc0ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f00c6344a5114cd4870741f5e7829033'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:33:52.852154 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2123a044-c43d-487d-87e1-363d37fc0ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f00c6344a5114cd4870741f5e7829033'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:33:52.866008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1277/2523] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:33:52 2022] DELETE /identity/v3/users/f00c6344a5114cd4870741f5e7829033 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:33:52.870560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3814d21-4f16-4504-a89e-4d8dbfefca42 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:33:52.871105 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3814d21-4f16-4504-a89e-4d8dbfefca42 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:33:52.871235 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3814d21-4f16-4504-a89e-4d8dbfefca42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:33:52.890932 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-b3814d21-4f16-4504-a89e-4d8dbfefca42 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:33:52.892125 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-b3814d21-4f16-4504-a89e-4d8dbfefca42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:33:52.956519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1247/2524] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:33:52.968399 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123a044-c43d-487d-87e1-363d37fc0ef1 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:33:52.969854 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-2123a044-c43d-487d-87e1-363d37fc0ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:33:53.036504 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123a044-c43d-487d-87e1-363d37fc0ef1 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:33:53.040305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0fa2d-0521-4908-950f-70df4b879118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:33:53.040937 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0fa2d-0521-4908-950f-70df4b879118 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:33:53.041213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0fa2d-0521-4908-950f-70df4b879118 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:33:53.041483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0fa2d-0521-4908-950f-70df4b879118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:33:53.050348 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0fa2d-0521-4908-950f-70df4b879118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:33:53.051778 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0fa2d-0521-4908-950f-70df4b879118 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:33:53.061091 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1278/2525] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:33:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:33:53.343795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3814d21-4f16-4504-a89e-4d8dbfefca42 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:33:53.345425 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-b3814d21-4f16-4504-a89e-4d8dbfefca42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:33:53.358030 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3814d21-4f16-4504-a89e-4d8dbfefca42 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:33:53.363064 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51412a-0d40-4094-b548-21f6f1b4e556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:33:53.364984 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51412a-0d40-4094-b548-21f6f1b4e556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:33:53.365378 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51412a-0d40-4094-b548-21f6f1b4e556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:33:53.365753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51412a-0d40-4094-b548-21f6f1b4e556 admin admin] PATH_INFO: `/v3/projects/76d1be1ae1e84f20862113ac3d91f008` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:33:53.367121 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51412a-0d40-4094-b548-21f6f1b4e556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d1be1ae1e84f20862113ac3d91f008)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:33:53.369175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51412a-0d40-4094-b548-21f6f1b4e556 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:33:53.416861 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-cd51412a-0d40-4094-b548-21f6f1b4e556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d1be1ae1e84f20862113ac3d91f008', 'request_id': 'req-cd51412a-0d40-4094-b548-21f6f1b4e556'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:33:53.423038 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-cd51412a-0d40-4094-b548-21f6f1b4e556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d1be1ae1e84f20862113ac3d91f008', 'request_id': 'req-cd51412a-0d40-4094-b548-21f6f1b4e556'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:33:53.428568 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-cd51412a-0d40-4094-b548-21f6f1b4e556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d1be1ae1e84f20862113ac3d91f008', 'request_id': 'req-cd51412a-0d40-4094-b548-21f6f1b4e556'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:33:53.440742 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-cd51412a-0d40-4094-b548-21f6f1b4e556 admin admin] The token cache is being invalidate because project 76d1be1ae1e84f20862113ac3d91f008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:33:53.441029 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-cd51412a-0d40-4094-b548-21f6f1b4e556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:33:53.441644 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-cd51412a-0d40-4094-b548-21f6f1b4e556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:33:53.443209 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1248/2526] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:33:53 2022] DELETE /identity/v3/projects/76d1be1ae1e84f20862113ac3d91f008 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:33:53.447109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0fa2d-0521-4908-950f-70df4b879118 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:33:53.457108 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0fa2d-0521-4908-950f-70df4b879118 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:33:53.515158 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e3cbd-df51-4c14-861c-a256e7967ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:33:53.516147 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e3cbd-df51-4c14-861c-a256e7967ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:33:53.516466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e3cbd-df51-4c14-861c-a256e7967ead admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:33:53.516740 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e3cbd-df51-4c14-861c-a256e7967ead admin admin] PATH_INFO: `/v3/users/c637118b5c814502bfddaa26da3ad9ce` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:33:53.517928 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e3cbd-df51-4c14-861c-a256e7967ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=c637118b5c814502bfddaa26da3ad9ce)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:33:53.519906 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e3cbd-df51-4c14-861c-a256e7967ead admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:33:53.566305 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-3c2e3cbd-df51-4c14-861c-a256e7967ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c637118b5c814502bfddaa26da3ad9ce'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:33:53.578043 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-3c2e3cbd-df51-4c14-861c-a256e7967ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c637118b5c814502bfddaa26da3ad9ce'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:33:53.578701 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-3c2e3cbd-df51-4c14-861c-a256e7967ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c637118b5c814502bfddaa26da3ad9ce'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:33:53.579335 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-3c2e3cbd-df51-4c14-861c-a256e7967ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c637118b5c814502bfddaa26da3ad9ce'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:33:53.585889 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-3c2e3cbd-df51-4c14-861c-a256e7967ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c637118b5c814502bfddaa26da3ad9ce'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:33:53.598307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1279/2527] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:33:53 2022] DELETE /identity/v3/users/c637118b5c814502bfddaa26da3ad9ce => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:33:53.865815 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51412a-0d40-4094-b548-21f6f1b4e556 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:33:53.867320 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-cd51412a-0d40-4094-b548-21f6f1b4e556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:33:53.880883 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51412a-0d40-4094-b548-21f6f1b4e556 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:33:53.938948 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8d948-2a70-4ea0-a93e-a5cd9bcdc6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:33:53.939809 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8d948-2a70-4ea0-a93e-a5cd9bcdc6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:33:53.940085 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8d948-2a70-4ea0-a93e-a5cd9bcdc6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:33:53.940354 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8d948-2a70-4ea0-a93e-a5cd9bcdc6f4 admin admin] PATH_INFO: `/v3/projects/698f0ee6cefb47218a597ebd6f2f5e07` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:33:53.941522 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8d948-2a70-4ea0-a93e-a5cd9bcdc6f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=698f0ee6cefb47218a597ebd6f2f5e07)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:33:53.943467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8d948-2a70-4ea0-a93e-a5cd9bcdc6f4 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:33:53.989581 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d4a8d948-2a70-4ea0-a93e-a5cd9bcdc6f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698f0ee6cefb47218a597ebd6f2f5e07', 'request_id': 'req-d4a8d948-2a70-4ea0-a93e-a5cd9bcdc6f4'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:33:53.995625 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d4a8d948-2a70-4ea0-a93e-a5cd9bcdc6f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698f0ee6cefb47218a597ebd6f2f5e07', 'request_id': 'req-d4a8d948-2a70-4ea0-a93e-a5cd9bcdc6f4'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:33:54.001755 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d4a8d948-2a70-4ea0-a93e-a5cd9bcdc6f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698f0ee6cefb47218a597ebd6f2f5e07', 'request_id': 'req-d4a8d948-2a70-4ea0-a93e-a5cd9bcdc6f4'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:33:54.013807 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d4a8d948-2a70-4ea0-a93e-a5cd9bcdc6f4 admin admin] The token cache is being invalidate because project 698f0ee6cefb47218a597ebd6f2f5e07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:33:54.014098 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d4a8d948-2a70-4ea0-a93e-a5cd9bcdc6f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:33:54.014716 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d4a8d948-2a70-4ea0-a93e-a5cd9bcdc6f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:33:54.016262 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1249/2528] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:33:53 2022] DELETE /identity/v3/projects/698f0ee6cefb47218a597ebd6f2f5e07 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:33:54.021110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481215fb-8364-4698-adb2-4a13a57981f7 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:33:54.021601 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481215fb-8364-4698-adb2-4a13a57981f7 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:33:54.021719 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481215fb-8364-4698-adb2-4a13a57981f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:33:54.039704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-481215fb-8364-4698-adb2-4a13a57981f7 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:33:54.041183 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-481215fb-8364-4698-adb2-4a13a57981f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:33:54.097952 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1280/2529] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:33:54.106239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef54a4-9424-46c5-bd7b-d6dd32b5b63a None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:33:54.106539 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef54a4-9424-46c5-bd7b-d6dd32b5b63a None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:33:54.106836 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef54a4-9424-46c5-bd7b-d6dd32b5b63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:33:54.125184 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-4cef54a4-9424-46c5-bd7b-d6dd32b5b63a None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:33:54.126302 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-4cef54a4-9424-46c5-bd7b-d6dd32b5b63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:33:54.134451 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1250/2530] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:33:54.138489 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481215fb-8364-4698-adb2-4a13a57981f7 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:33:54.147926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481215fb-8364-4698-adb2-4a13a57981f7 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:33:54.152453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832b9eb-9f70-4cdd-bb27-910afae1f19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:33:54.153616 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832b9eb-9f70-4cdd-bb27-910afae1f19d admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:33:54.153889 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832b9eb-9f70-4cdd-bb27-910afae1f19d admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:33:54.154158 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832b9eb-9f70-4cdd-bb27-910afae1f19d admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:33:54.154916 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832b9eb-9f70-4cdd-bb27-910afae1f19d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:33:54.155219 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832b9eb-9f70-4cdd-bb27-910afae1f19d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:33:54.156798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832b9eb-9f70-4cdd-bb27-910afae1f19d admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:33:54.169266 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1281/2531] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:33:54.173416 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef54a4-9424-46c5-bd7b-d6dd32b5b63a None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:33:54.182493 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef54a4-9424-46c5-bd7b-d6dd32b5b63a None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:33:54.187211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c53185-43f0-4c5e-8c41-c2490868ab7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:33:54.187859 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c53185-43f0-4c5e-8c41-c2490868ab7a admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:33:54.188143 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c53185-43f0-4c5e-8c41-c2490868ab7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:33:54.188412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c53185-43f0-4c5e-8c41-c2490868ab7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:33:54.189122 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c53185-43f0-4c5e-8c41-c2490868ab7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:33:54.191048 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c53185-43f0-4c5e-8c41-c2490868ab7a admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:33:54.217973 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1251/2532] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:33:54 2022] POST /identity/v3/projects => generated 363 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:33:54.220365 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832b9eb-9f70-4cdd-bb27-910afae1f19d admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:33:54.230132 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832b9eb-9f70-4cdd-bb27-910afae1f19d admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:33:54.283872 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0070eef-a5f6-475c-9885-8209c5ceae45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:33:54.284541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0070eef-a5f6-475c-9885-8209c5ceae45 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:33:54.284826 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0070eef-a5f6-475c-9885-8209c5ceae45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:33:54.285102 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0070eef-a5f6-475c-9885-8209c5ceae45 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:33:54.285824 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0070eef-a5f6-475c-9885-8209c5ceae45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:33:54.287775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0070eef-a5f6-475c-9885-8209c5ceae45 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:33:54.307148 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1282/2533] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:33:54 2022] POST /identity/v3/users => generated 282 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:33:54.310945 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c53185-43f0-4c5e-8c41-c2490868ab7a admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:33:54.320893 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c53185-43f0-4c5e-8c41-c2490868ab7a admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:33:54.325662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88e811-d02b-442e-8aab-fe3002d58a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:33:54.326307 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88e811-d02b-442e-8aab-fe3002d58a53 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:33:54.326586 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88e811-d02b-442e-8aab-fe3002d58a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:33:54.326888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88e811-d02b-442e-8aab-fe3002d58a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:33:54.327608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88e811-d02b-442e-8aab-fe3002d58a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:33:54.329186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88e811-d02b-442e-8aab-fe3002d58a53 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:33:54.339237 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1252/2534] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:33:54.343720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0070eef-a5f6-475c-9885-8209c5ceae45 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:33:54.353726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0070eef-a5f6-475c-9885-8209c5ceae45 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:33:54.358963 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817cbd4-7411-4cac-8552-a163cc36ecea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:33:54.359620 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817cbd4-7411-4cac-8552-a163cc36ecea admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:33:54.359899 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817cbd4-7411-4cac-8552-a163cc36ecea admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:33:54.360177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817cbd4-7411-4cac-8552-a163cc36ecea admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:33:54.360888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817cbd4-7411-4cac-8552-a163cc36ecea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:33:54.362478 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817cbd4-7411-4cac-8552-a163cc36ecea admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:33:54.373910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1283/2535] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:33:54.378279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88e811-d02b-442e-8aab-fe3002d58a53 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:33:54.388150 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88e811-d02b-442e-8aab-fe3002d58a53 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:33:54.392742 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03023cc9-2dc1-4c82-be97-9e9176d36e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:33:54.393609 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03023cc9-2dc1-4c82-be97-9e9176d36e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:33:54.393897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03023cc9-2dc1-4c82-be97-9e9176d36e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:33:54.394175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03023cc9-2dc1-4c82-be97-9e9176d36e14 admin admin] PATH_INFO: `/v3/projects/e9249a06859c4ede9754c3a63ec2c0e5/users/51e725f22c3e4c348fdd7caf422621a3/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:33:54.409051 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03023cc9-2dc1-4c82-be97-9e9176d36e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9249a06859c4ede9754c3a63ec2c0e5, user_id=51e725f22c3e4c348fdd7caf422621a3, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:33:54.411764 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03023cc9-2dc1-4c82-be97-9e9176d36e14 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:33:54.426012 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1253/2536] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:33:54 2022] PUT /identity/v3/projects/e9249a06859c4ede9754c3a63ec2c0e5/users/51e725f22c3e4c348fdd7caf422621a3/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:33:54.435969 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8d246-fcf1-4b86-aa56-189b33db6063 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:33:54.436256 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8d246-fcf1-4b86-aa56-189b33db6063 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:33:54.436556 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8d246-fcf1-4b86-aa56-189b33db6063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:33:54.461978 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-90c8d246-fcf1-4b86-aa56-189b33db6063 None None] MFA Rules not processed for user `51e725f22c3e4c348fdd7caf422621a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:33:54.463220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-90c8d246-fcf1-4b86-aa56-189b33db6063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:33:54.528503 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1284/2537] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:33:54 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:33:54.533062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03023cc9-2dc1-4c82-be97-9e9176d36e14 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:33:54.597670 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03023cc9-2dc1-4c82-be97-9e9176d36e14 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:33:54.602690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7904cc-6721-47ce-a5cb-57c7ddaf46a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:33:54.603376 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7904cc-6721-47ce-a5cb-57c7ddaf46a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:33:54.603663 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7904cc-6721-47ce-a5cb-57c7ddaf46a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:33:54.603938 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7904cc-6721-47ce-a5cb-57c7ddaf46a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:33:54.604622 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7904cc-6721-47ce-a5cb-57c7ddaf46a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:33:54.606583 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7904cc-6721-47ce-a5cb-57c7ddaf46a5 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:33:54.631312 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1254/2538] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:33:54 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:33:54.635341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8d246-fcf1-4b86-aa56-189b33db6063 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:33:54.646183 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8d246-fcf1-4b86-aa56-189b33db6063 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:33:54.698733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85819e42-b360-4197-899e-ee86d6d8b140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:33:54.699416 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85819e42-b360-4197-899e-ee86d6d8b140 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:33:54.700230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85819e42-b360-4197-899e-ee86d6d8b140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:33:54.700489 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85819e42-b360-4197-899e-ee86d6d8b140 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:33:54.701155 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85819e42-b360-4197-899e-ee86d6d8b140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:33:54.703055 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85819e42-b360-4197-899e-ee86d6d8b140 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:33:54.722375 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1285/2539] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:33:54 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:33:54.726477 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7904cc-6721-47ce-a5cb-57c7ddaf46a5 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:33:54.736911 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7904cc-6721-47ce-a5cb-57c7ddaf46a5 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:33:54.741748 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2afe4-c156-4c1e-88f9-6775198a7012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:33:54.742395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2afe4-c156-4c1e-88f9-6775198a7012 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:33:54.742677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2afe4-c156-4c1e-88f9-6775198a7012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:33:54.742987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2afe4-c156-4c1e-88f9-6775198a7012 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:33:54.743706 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2afe4-c156-4c1e-88f9-6775198a7012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:33:54.745370 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2afe4-c156-4c1e-88f9-6775198a7012 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:33:54.756065 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1255/2540] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:33:54.760694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85819e42-b360-4197-899e-ee86d6d8b140 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:33:54.771488 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85819e42-b360-4197-899e-ee86d6d8b140 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:33:54.776062 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928e986-14cb-4baa-8482-e3ebdf98cc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:33:54.776933 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928e986-14cb-4baa-8482-e3ebdf98cc9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:33:54.777214 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928e986-14cb-4baa-8482-e3ebdf98cc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:33:54.777484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928e986-14cb-4baa-8482-e3ebdf98cc9c admin admin] PATH_INFO: `/v3/projects/3e2e4e036ac9489589a8330f3f0763da/users/253253b6288644f987f4a25523f3724e/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:33:54.793407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928e986-14cb-4baa-8482-e3ebdf98cc9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e2e4e036ac9489589a8330f3f0763da, user_id=253253b6288644f987f4a25523f3724e, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:33:54.796144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928e986-14cb-4baa-8482-e3ebdf98cc9c admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:33:54.808501 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1286/2541] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:33:54 2022] PUT /identity/v3/projects/3e2e4e036ac9489589a8330f3f0763da/users/253253b6288644f987f4a25523f3724e/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:33:54.812566 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2afe4-c156-4c1e-88f9-6775198a7012 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:33:54.822437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2afe4-c156-4c1e-88f9-6775198a7012 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:33:54.880313 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d82528-6474-489c-92f0-794779d2f8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:33:54.880981 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d82528-6474-489c-92f0-794779d2f8bc admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:33:54.881624 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d82528-6474-489c-92f0-794779d2f8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:33:54.881624 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d82528-6474-489c-92f0-794779d2f8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:33:54.882371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d82528-6474-489c-92f0-794779d2f8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:33:54.884018 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d82528-6474-489c-92f0-794779d2f8bc admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:33:54.894567 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1256/2542] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:33:54.898627 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928e986-14cb-4baa-8482-e3ebdf98cc9c admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:33:54.908576 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928e986-14cb-4baa-8482-e3ebdf98cc9c admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:33:54.913116 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c739b3-cd3e-4364-87e1-de8e50792c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:33:54.913976 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c739b3-cd3e-4364-87e1-de8e50792c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:33:54.914248 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c739b3-cd3e-4364-87e1-de8e50792c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:33:54.914522 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c739b3-cd3e-4364-87e1-de8e50792c25 admin admin] PATH_INFO: `/v3/projects/3e2e4e036ac9489589a8330f3f0763da/users/253253b6288644f987f4a25523f3724e/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:33:54.916709 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c739b3-cd3e-4364-87e1-de8e50792c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e2e4e036ac9489589a8330f3f0763da, user_id=253253b6288644f987f4a25523f3724e, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:33:54.919490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c739b3-cd3e-4364-87e1-de8e50792c25 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:33:54.929807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1287/2543] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:33:54 2022] PUT /identity/v3/projects/3e2e4e036ac9489589a8330f3f0763da/users/253253b6288644f987f4a25523f3724e/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:33:54.941444 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36eb642-dde9-4f50-b1e5-27bf186aa546 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:33:54.941734 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36eb642-dde9-4f50-b1e5-27bf186aa546 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:33:54.942015 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36eb642-dde9-4f50-b1e5-27bf186aa546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:33:54.969667 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-e36eb642-dde9-4f50-b1e5-27bf186aa546 None None] MFA Rules not processed for user `253253b6288644f987f4a25523f3724e`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:33:54.970905 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-e36eb642-dde9-4f50-b1e5-27bf186aa546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:33:55.036174 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1257/2544] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:33:54 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:34:01.710228 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c739b3-cd3e-4364-87e1-de8e50792c25 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:34:01.711907 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-b3c739b3-cd3e-4364-87e1-de8e50792c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:34:01.792331 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c739b3-cd3e-4364-87e1-de8e50792c25 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:34:01.797388 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561e1f1-da5e-41be-960c-a6b3d4f451dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908d23b035f14756b438b3a61a63b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:34:01.798041 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561e1f1-da5e-41be-960c-a6b3d4f451dd service placement] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:34:01.798323 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561e1f1-da5e-41be-960c-a6b3d4f451dd service placement] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:34:01.798597 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561e1f1-da5e-41be-960c-a6b3d4f451dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:34:01.800413 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-5561e1f1-da5e-41be-960c-a6b3d4f451dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:34:01.812524 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561e1f1-da5e-41be-960c-a6b3d4f451dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:34:01.814103 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561e1f1-da5e-41be-960c-a6b3d4f451dd service placement] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:34:01.824054 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1288/2545] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:34:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:34:12.365025 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36eb642-dde9-4f50-b1e5-27bf186aa546 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:34:12.366473 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-e36eb642-dde9-4f50-b1e5-27bf186aa546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:34:12.426515 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36eb642-dde9-4f50-b1e5-27bf186aa546 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:34:12.430254 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224595b-dbfe-4d5a-a797-d806b5ec5894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:34:12.430947 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224595b-dbfe-4d5a-a797-d806b5ec5894 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:34:12.431234 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224595b-dbfe-4d5a-a797-d806b5ec5894 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:34:12.431507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224595b-dbfe-4d5a-a797-d806b5ec5894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:34:12.442163 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224595b-dbfe-4d5a-a797-d806b5ec5894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:34:12.443652 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224595b-dbfe-4d5a-a797-d806b5ec5894 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:34:12.454501 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1258/2546] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:34:12 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:35:52.835069 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561e1f1-da5e-41be-960c-a6b3d4f451dd service placement] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:35:52.836462 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-5561e1f1-da5e-41be-960c-a6b3d4f451dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:35:52.847846 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561e1f1-da5e-41be-960c-a6b3d4f451dd service placement] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:35:52.851370 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b2378-7554-4afb-bdb5-87a4da958d32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:35:52.852009 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b2378-7554-4afb-bdb5-87a4da958d32 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:52.852289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b2378-7554-4afb-bdb5-87a4da958d32 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:52.852565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b2378-7554-4afb-bdb5-87a4da958d32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:52.854307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-637b2378-7554-4afb-bdb5-87a4da958d32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:35:52.931058 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b2378-7554-4afb-bdb5-87a4da958d32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:35:52.932501 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b2378-7554-4afb-bdb5-87a4da958d32 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:35:52.941540 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1289/2547] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:35:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:35:53.067471 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224595b-dbfe-4d5a-a797-d806b5ec5894 service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:35:53.075993 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224595b-dbfe-4d5a-a797-d806b5ec5894 service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:35:53.079770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c871c20-e1c1-4824-99d1-0847b26f080e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:35:53.080341 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c871c20-e1c1-4824-99d1-0847b26f080e service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:53.080618 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c871c20-e1c1-4824-99d1-0847b26f080e service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:53.080889 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c871c20-e1c1-4824-99d1-0847b26f080e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:53.082677 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-7c871c20-e1c1-4824-99d1-0847b26f080e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:35:53.140759 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c871c20-e1c1-4824-99d1-0847b26f080e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:35:53.142208 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c871c20-e1c1-4824-99d1-0847b26f080e service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:35:53.151355 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1259/2548] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:35:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:35:53.622644 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b2378-7554-4afb-bdb5-87a4da958d32 service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:35:53.686227 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b2378-7554-4afb-bdb5-87a4da958d32 service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:35:53.693504 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1e348-4b42-4852-afb1-29951becb134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:35:53.694375 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1e348-4b42-4852-afb1-29951becb134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:53.694650 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1e348-4b42-4852-afb1-29951becb134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:53.694949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1e348-4b42-4852-afb1-29951becb134 admin admin] PATH_INFO: `/v3/users/51e725f22c3e4c348fdd7caf422621a3` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:53.696125 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1e348-4b42-4852-afb1-29951becb134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51e725f22c3e4c348fdd7caf422621a3)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:35:53.698041 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1e348-4b42-4852-afb1-29951becb134 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:35:53.748238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-78b1e348-4b42-4852-afb1-29951becb134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51e725f22c3e4c348fdd7caf422621a3'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:35:53.760277 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-78b1e348-4b42-4852-afb1-29951becb134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51e725f22c3e4c348fdd7caf422621a3'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:35:53.761001 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-78b1e348-4b42-4852-afb1-29951becb134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51e725f22c3e4c348fdd7caf422621a3'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:35:53.761703 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-78b1e348-4b42-4852-afb1-29951becb134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51e725f22c3e4c348fdd7caf422621a3'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:35:53.769019 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-78b1e348-4b42-4852-afb1-29951becb134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51e725f22c3e4c348fdd7caf422621a3'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:35:53.782468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1290/2549] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:35:53 2022] DELETE /identity/v3/users/51e725f22c3e4c348fdd7caf422621a3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:35:53.787934 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f7db2-e084-4e69-959c-dc74aa9a1527 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:53.788214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f7db2-e084-4e69-959c-dc74aa9a1527 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:53.788489 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f7db2-e084-4e69-959c-dc74aa9a1527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:53.805315 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-1f7f7db2-e084-4e69-959c-dc74aa9a1527 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:35:53.806504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-1f7f7db2-e084-4e69-959c-dc74aa9a1527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:35:53.864701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1260/2550] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:35:53.876560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1e348-4b42-4852-afb1-29951becb134 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:35:53.877929 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-78b1e348-4b42-4852-afb1-29951becb134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:35:53.932816 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1e348-4b42-4852-afb1-29951becb134 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:35:53.936943 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352c34a-ba64-4154-beb7-01b97c3bff07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:35:53.937579 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352c34a-ba64-4154-beb7-01b97c3bff07 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:53.937857 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352c34a-ba64-4154-beb7-01b97c3bff07 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:53.938127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352c34a-ba64-4154-beb7-01b97c3bff07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:53.946913 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352c34a-ba64-4154-beb7-01b97c3bff07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:35:53.948312 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352c34a-ba64-4154-beb7-01b97c3bff07 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:35:53.958013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1291/2551] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:35:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:35:54.261374 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f7db2-e084-4e69-959c-dc74aa9a1527 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:35:54.262863 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-1f7f7db2-e084-4e69-959c-dc74aa9a1527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:35:54.278935 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f7db2-e084-4e69-959c-dc74aa9a1527 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:35:54.285310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fedc1d-5337-45af-9716-7fd04ee945ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:35:54.286526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fedc1d-5337-45af-9716-7fd04ee945ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:54.287040 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fedc1d-5337-45af-9716-7fd04ee945ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:54.287875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fedc1d-5337-45af-9716-7fd04ee945ca admin admin] PATH_INFO: `/v3/projects/e9249a06859c4ede9754c3a63ec2c0e5` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:54.289390 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fedc1d-5337-45af-9716-7fd04ee945ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9249a06859c4ede9754c3a63ec2c0e5)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:35:54.292498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fedc1d-5337-45af-9716-7fd04ee945ca admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:35:54.350344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c0fedc1d-5337-45af-9716-7fd04ee945ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9249a06859c4ede9754c3a63ec2c0e5', 'request_id': 'req-c0fedc1d-5337-45af-9716-7fd04ee945ca'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:35:54.357188 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c0fedc1d-5337-45af-9716-7fd04ee945ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9249a06859c4ede9754c3a63ec2c0e5', 'request_id': 'req-c0fedc1d-5337-45af-9716-7fd04ee945ca'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:35:54.363221 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c0fedc1d-5337-45af-9716-7fd04ee945ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9249a06859c4ede9754c3a63ec2c0e5', 'request_id': 'req-c0fedc1d-5337-45af-9716-7fd04ee945ca'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:35:54.377186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c0fedc1d-5337-45af-9716-7fd04ee945ca admin admin] The token cache is being invalidate because project e9249a06859c4ede9754c3a63ec2c0e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:35:54.377469 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c0fedc1d-5337-45af-9716-7fd04ee945ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:35:54.378097 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c0fedc1d-5337-45af-9716-7fd04ee945ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:35:54.379748 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1261/2552] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:35:54 2022] DELETE /identity/v3/projects/e9249a06859c4ede9754c3a63ec2c0e5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:35:54.383748 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352c34a-ba64-4154-beb7-01b97c3bff07 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:35:54.393293 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352c34a-ba64-4154-beb7-01b97c3bff07 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:35:54.453713 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e43d6-29e0-4eaa-87d1-6979832bfcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:35:54.454800 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e43d6-29e0-4eaa-87d1-6979832bfcc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:54.455253 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e43d6-29e0-4eaa-87d1-6979832bfcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:54.455621 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e43d6-29e0-4eaa-87d1-6979832bfcc4 admin admin] PATH_INFO: `/v3/users/253253b6288644f987f4a25523f3724e` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:54.457050 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e43d6-29e0-4eaa-87d1-6979832bfcc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=253253b6288644f987f4a25523f3724e)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:35:54.459215 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e43d6-29e0-4eaa-87d1-6979832bfcc4 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:35:54.521070 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d22e43d6-29e0-4eaa-87d1-6979832bfcc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '253253b6288644f987f4a25523f3724e'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:35:54.533820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d22e43d6-29e0-4eaa-87d1-6979832bfcc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '253253b6288644f987f4a25523f3724e'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:35:54.534549 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d22e43d6-29e0-4eaa-87d1-6979832bfcc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '253253b6288644f987f4a25523f3724e'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:35:54.535186 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d22e43d6-29e0-4eaa-87d1-6979832bfcc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '253253b6288644f987f4a25523f3724e'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:35:54.542385 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d22e43d6-29e0-4eaa-87d1-6979832bfcc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '253253b6288644f987f4a25523f3724e'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:35:54.557479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1292/2553] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:35:54 2022] DELETE /identity/v3/users/253253b6288644f987f4a25523f3724e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:35:54.575858 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fedc1d-5337-45af-9716-7fd04ee945ca admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:35:54.577286 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c0fedc1d-5337-45af-9716-7fd04ee945ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:35:54.678555 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fedc1d-5337-45af-9716-7fd04ee945ca admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:35:54.742521 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b2047-ecc4-4336-84c2-f760803126ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:35:54.743209 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b2047-ecc4-4336-84c2-f760803126ef service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:54.743492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b2047-ecc4-4336-84c2-f760803126ef service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:54.743768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b2047-ecc4-4336-84c2-f760803126ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:54.745580 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-bb9b2047-ecc4-4336-84c2-f760803126ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:35:54.757560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b2047-ecc4-4336-84c2-f760803126ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:35:54.759189 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b2047-ecc4-4336-84c2-f760803126ef service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:35:54.770770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1262/2554] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:35:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:35:54.842982 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e43d6-29e0-4eaa-87d1-6979832bfcc4 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:35:54.844629 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-d22e43d6-29e0-4eaa-87d1-6979832bfcc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:35:54.910062 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e43d6-29e0-4eaa-87d1-6979832bfcc4 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:35:54.914856 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77588b7e-5cea-4e2c-b32c-0ca19d2ba2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:35:54.915706 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77588b7e-5cea-4e2c-b32c-0ca19d2ba2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:54.915982 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77588b7e-5cea-4e2c-b32c-0ca19d2ba2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:54.916251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77588b7e-5cea-4e2c-b32c-0ca19d2ba2f2 admin admin] PATH_INFO: `/v3/projects/3e2e4e036ac9489589a8330f3f0763da` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:54.917567 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77588b7e-5cea-4e2c-b32c-0ca19d2ba2f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e2e4e036ac9489589a8330f3f0763da)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:35:54.919536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77588b7e-5cea-4e2c-b32c-0ca19d2ba2f2 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:35:54.965181 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-77588b7e-5cea-4e2c-b32c-0ca19d2ba2f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e2e4e036ac9489589a8330f3f0763da', 'request_id': 'req-77588b7e-5cea-4e2c-b32c-0ca19d2ba2f2'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:35:54.972006 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-77588b7e-5cea-4e2c-b32c-0ca19d2ba2f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e2e4e036ac9489589a8330f3f0763da', 'request_id': 'req-77588b7e-5cea-4e2c-b32c-0ca19d2ba2f2'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:35:54.979605 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-77588b7e-5cea-4e2c-b32c-0ca19d2ba2f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e2e4e036ac9489589a8330f3f0763da', 'request_id': 'req-77588b7e-5cea-4e2c-b32c-0ca19d2ba2f2'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:35:54.990378 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-77588b7e-5cea-4e2c-b32c-0ca19d2ba2f2 admin admin] The token cache is being invalidate because project 3e2e4e036ac9489589a8330f3f0763da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:35:54.990663 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-77588b7e-5cea-4e2c-b32c-0ca19d2ba2f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:35:54.991396 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-77588b7e-5cea-4e2c-b32c-0ca19d2ba2f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:35:54.992878 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1293/2555] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:35:54 2022] DELETE /identity/v3/projects/3e2e4e036ac9489589a8330f3f0763da => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:35:54.998680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e6f8d-5e2d-4f78-93a2-b8fb5c2a2e82 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:54.999026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e6f8d-5e2d-4f78-93a2-b8fb5c2a2e82 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:54.999312 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e6f8d-5e2d-4f78-93a2-b8fb5c2a2e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:55.017096 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-898e6f8d-5e2d-4f78-93a2-b8fb5c2a2e82 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:35:55.018301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-898e6f8d-5e2d-4f78-93a2-b8fb5c2a2e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:35:55.077962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1263/2556] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:35:55.085636 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656359a-f591-41d9-b2fb-6dbb70a74fa0 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:55.085948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656359a-f591-41d9-b2fb-6dbb70a74fa0 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:55.086230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656359a-f591-41d9-b2fb-6dbb70a74fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:55.105374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-e656359a-f591-41d9-b2fb-6dbb70a74fa0 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:35:55.106602 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e656359a-f591-41d9-b2fb-6dbb70a74fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:35:55.114424 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1294/2557] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:35:55.118550 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e6f8d-5e2d-4f78-93a2-b8fb5c2a2e82 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:35:55.128467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e6f8d-5e2d-4f78-93a2-b8fb5c2a2e82 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:35:55.132895 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148dfaf-dc5c-44c1-80e8-2b32b44c8cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:35:55.133533 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148dfaf-dc5c-44c1-80e8-2b32b44c8cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:55.133810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148dfaf-dc5c-44c1-80e8-2b32b44c8cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:55.134077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148dfaf-dc5c-44c1-80e8-2b32b44c8cfe admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:55.134781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148dfaf-dc5c-44c1-80e8-2b32b44c8cfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:35:55.135119 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148dfaf-dc5c-44c1-80e8-2b32b44c8cfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:35:55.136694 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148dfaf-dc5c-44c1-80e8-2b32b44c8cfe admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:35:55.148483 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1264/2558] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:35:55.152847 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656359a-f591-41d9-b2fb-6dbb70a74fa0 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:35:55.162792 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656359a-f591-41d9-b2fb-6dbb70a74fa0 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:35:55.167439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b729a-22ac-49c8-aa91-5dd10488c6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:35:55.168116 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b729a-22ac-49c8-aa91-5dd10488c6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:55.168390 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b729a-22ac-49c8-aa91-5dd10488c6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:55.168681 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b729a-22ac-49c8-aa91-5dd10488c6f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:55.169365 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b729a-22ac-49c8-aa91-5dd10488c6f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:35:55.171268 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b729a-22ac-49c8-aa91-5dd10488c6f9 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:35:55.195856 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1295/2559] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:35:55 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:35:55.200569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148dfaf-dc5c-44c1-80e8-2b32b44c8cfe admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:35:55.210463 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148dfaf-dc5c-44c1-80e8-2b32b44c8cfe admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:35:55.265310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f145f9-7628-4276-bd84-bf767a568f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:35:55.266011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f145f9-7628-4276-bd84-bf767a568f7d admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:55.266259 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f145f9-7628-4276-bd84-bf767a568f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:55.266611 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f145f9-7628-4276-bd84-bf767a568f7d admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:55.267350 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f145f9-7628-4276-bd84-bf767a568f7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:35:55.269266 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f145f9-7628-4276-bd84-bf767a568f7d admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:35:55.288742 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1265/2560] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:35:55 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:35:55.292649 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b729a-22ac-49c8-aa91-5dd10488c6f9 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:35:55.302578 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b729a-22ac-49c8-aa91-5dd10488c6f9 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:35:55.307249 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1565d9-6e41-4cfd-9068-bac4bbef5c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:35:55.307900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1565d9-6e41-4cfd-9068-bac4bbef5c76 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:55.308183 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1565d9-6e41-4cfd-9068-bac4bbef5c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:55.308477 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1565d9-6e41-4cfd-9068-bac4bbef5c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:55.309694 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1565d9-6e41-4cfd-9068-bac4bbef5c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:35:55.311409 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1565d9-6e41-4cfd-9068-bac4bbef5c76 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:35:55.321496 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1296/2561] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:35:55.326013 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f145f9-7628-4276-bd84-bf767a568f7d admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:35:55.335966 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f145f9-7628-4276-bd84-bf767a568f7d admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:35:55.340579 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fca139-9fb4-45ae-9e96-aa84f30670c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:35:55.341229 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fca139-9fb4-45ae-9e96-aa84f30670c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:55.341510 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fca139-9fb4-45ae-9e96-aa84f30670c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:55.341784 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fca139-9fb4-45ae-9e96-aa84f30670c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:55.342508 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fca139-9fb4-45ae-9e96-aa84f30670c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:35:55.344135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fca139-9fb4-45ae-9e96-aa84f30670c1 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:35:55.354470 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1266/2562] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:35:55.358292 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1565d9-6e41-4cfd-9068-bac4bbef5c76 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:35:55.368069 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1565d9-6e41-4cfd-9068-bac4bbef5c76 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:35:55.373135 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cd91a-2bce-4400-b1b6-5c2ab0d35e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:35:55.374074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cd91a-2bce-4400-b1b6-5c2ab0d35e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:55.374360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cd91a-2bce-4400-b1b6-5c2ab0d35e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:55.374636 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cd91a-2bce-4400-b1b6-5c2ab0d35e66 admin admin] PATH_INFO: `/v3/projects/87711a61aed2411c887da687354bbe73/users/f01ed062dc2f4a3388c186a8ad414584/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:55.389796 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336cd91a-2bce-4400-b1b6-5c2ab0d35e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87711a61aed2411c887da687354bbe73, user_id=f01ed062dc2f4a3388c186a8ad414584, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:35:55.392481 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336cd91a-2bce-4400-b1b6-5c2ab0d35e66 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:35:55.405241 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1297/2563] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:35:55 2022] PUT /identity/v3/projects/87711a61aed2411c887da687354bbe73/users/f01ed062dc2f4a3388c186a8ad414584/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:35:55.415724 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb743b0-afec-4dd7-8279-df1f3f7bcabc None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:55.415949 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb743b0-afec-4dd7-8279-df1f3f7bcabc None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:55.416225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb743b0-afec-4dd7-8279-df1f3f7bcabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:55.443004 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-6cb743b0-afec-4dd7-8279-df1f3f7bcabc None None] MFA Rules not processed for user `f01ed062dc2f4a3388c186a8ad414584`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:35:55.444192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6cb743b0-afec-4dd7-8279-df1f3f7bcabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:35:55.506869 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1267/2564] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:35:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:35:55.511308 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cd91a-2bce-4400-b1b6-5c2ab0d35e66 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:35:55.577439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cd91a-2bce-4400-b1b6-5c2ab0d35e66 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:35:55.582182 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dc645-c15f-4ddc-9351-6b9e65122307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:35:55.582889 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dc645-c15f-4ddc-9351-6b9e65122307 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:55.583242 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dc645-c15f-4ddc-9351-6b9e65122307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:55.583454 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dc645-c15f-4ddc-9351-6b9e65122307 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:55.584177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dc645-c15f-4ddc-9351-6b9e65122307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:35:55.586152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dc645-c15f-4ddc-9351-6b9e65122307 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:35:55.611419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1298/2565] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:35:55 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:35:55.615827 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb743b0-afec-4dd7-8279-df1f3f7bcabc None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:35:55.627325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb743b0-afec-4dd7-8279-df1f3f7bcabc None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:35:55.681101 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db00d03-29a8-4689-8cce-689b8b843617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:35:55.681696 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db00d03-29a8-4689-8cce-689b8b843617 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:55.681974 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db00d03-29a8-4689-8cce-689b8b843617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:55.682246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db00d03-29a8-4689-8cce-689b8b843617 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:55.682981 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db00d03-29a8-4689-8cce-689b8b843617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:35:55.685425 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db00d03-29a8-4689-8cce-689b8b843617 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:35:55.704766 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1268/2566] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:35:55 2022] POST /identity/v3/users => generated 297 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:35:55.708736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dc645-c15f-4ddc-9351-6b9e65122307 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:35:55.718932 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dc645-c15f-4ddc-9351-6b9e65122307 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:35:55.723515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa6ed0-1411-4ae7-b38f-18fe477964a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:35:55.724170 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa6ed0-1411-4ae7-b38f-18fe477964a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:55.724453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa6ed0-1411-4ae7-b38f-18fe477964a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:55.724729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa6ed0-1411-4ae7-b38f-18fe477964a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:55.725451 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa6ed0-1411-4ae7-b38f-18fe477964a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:35:55.727085 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa6ed0-1411-4ae7-b38f-18fe477964a8 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:35:55.737901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1299/2567] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:35:55.742073 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db00d03-29a8-4689-8cce-689b8b843617 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:35:55.752539 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db00d03-29a8-4689-8cce-689b8b843617 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:35:55.757182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25454553-b75e-47e7-aee3-18e815166782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:35:55.758057 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25454553-b75e-47e7-aee3-18e815166782 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:55.758335 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25454553-b75e-47e7-aee3-18e815166782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:55.758632 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25454553-b75e-47e7-aee3-18e815166782 admin admin] PATH_INFO: `/v3/projects/3802a631bfe34ada87880b2f25785956/users/47b82235fcdf4ca39e4d694f333d0fe7/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:55.773164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25454553-b75e-47e7-aee3-18e815166782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3802a631bfe34ada87880b2f25785956, user_id=47b82235fcdf4ca39e4d694f333d0fe7, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:35:55.775936 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25454553-b75e-47e7-aee3-18e815166782 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:35:55.788643 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1269/2568] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:35:55 2022] PUT /identity/v3/projects/3802a631bfe34ada87880b2f25785956/users/47b82235fcdf4ca39e4d694f333d0fe7/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:35:55.792743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa6ed0-1411-4ae7-b38f-18fe477964a8 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:35:55.803317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa6ed0-1411-4ae7-b38f-18fe477964a8 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:35:55.857485 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b63c1f-9c2f-4664-8f4b-6046ae8feeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:35:55.858144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b63c1f-9c2f-4664-8f4b-6046ae8feeb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:55.858425 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b63c1f-9c2f-4664-8f4b-6046ae8feeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:55.858700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b63c1f-9c2f-4664-8f4b-6046ae8feeb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:55.859448 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b63c1f-9c2f-4664-8f4b-6046ae8feeb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:35:55.861030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b63c1f-9c2f-4664-8f4b-6046ae8feeb5 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:35:55.871142 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1300/2569] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:35:55.876150 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25454553-b75e-47e7-aee3-18e815166782 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:35:55.886358 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25454553-b75e-47e7-aee3-18e815166782 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:35:55.891077 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb0827-7168-48b8-9a00-382032a33a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:35:55.891942 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb0827-7168-48b8-9a00-382032a33a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:55.892224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb0827-7168-48b8-9a00-382032a33a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:55.892499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb0827-7168-48b8-9a00-382032a33a64 admin admin] PATH_INFO: `/v3/projects/3802a631bfe34ada87880b2f25785956/users/47b82235fcdf4ca39e4d694f333d0fe7/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:55.894447 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb0827-7168-48b8-9a00-382032a33a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3802a631bfe34ada87880b2f25785956, user_id=47b82235fcdf4ca39e4d694f333d0fe7, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:35:55.897123 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb0827-7168-48b8-9a00-382032a33a64 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:35:55.907885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1270/2570] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:35:55 2022] PUT /identity/v3/projects/3802a631bfe34ada87880b2f25785956/users/47b82235fcdf4ca39e4d694f333d0fe7/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:35:55.920213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafec03-7f62-417e-914a-5c86094d3eef None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:35:55.920731 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafec03-7f62-417e-914a-5c86094d3eef None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:35:55.920731 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafec03-7f62-417e-914a-5c86094d3eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:35:55.947205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-ccafec03-7f62-417e-914a-5c86094d3eef None None] MFA Rules not processed for user `47b82235fcdf4ca39e4d694f333d0fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:35:55.948343 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ccafec03-7f62-417e-914a-5c86094d3eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:35:56.015140 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1301/2571] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:35:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:36:12.637426 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb0827-7168-48b8-9a00-382032a33a64 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:36:12.639117 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-a6fb0827-7168-48b8-9a00-382032a33a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:36:12.695264 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb0827-7168-48b8-9a00-382032a33a64 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:36:12.699673 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e054419-1db5-4a30-81d5-49631212cfbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:36:12.700337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e054419-1db5-4a30-81d5-49631212cfbb service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:36:12.700614 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e054419-1db5-4a30-81d5-49631212cfbb service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:36:12.700888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e054419-1db5-4a30-81d5-49631212cfbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:36:12.714208 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e054419-1db5-4a30-81d5-49631212cfbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:36:12.715727 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e054419-1db5-4a30-81d5-49631212cfbb service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:36:12.725586 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1271/2572] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:36:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:36:13.218131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafec03-7f62-417e-914a-5c86094d3eef None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:36:13.229163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafec03-7f62-417e-914a-5c86094d3eef None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:36:13.234567 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47d741-3bc4-4e28-98db-a0d0840af2de tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b82235fcdf4ca39e4d694f333d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3802a631bfe34ada87880b2f25785956', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:36:13.235289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47d741-3bc4-4e28-98db-a0d0840af2de tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:36:13.235572 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47d741-3bc4-4e28-98db-a0d0840af2de tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:36:13.235990 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47d741-3bc4-4e28-98db-a0d0840af2de tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:36:13.236726 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47d741-3bc4-4e28-98db-a0d0840af2de tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:36:13.237039 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47d741-3bc4-4e28-98db-a0d0840af2de tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:36:13.238682 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47d741-3bc4-4e28-98db-a0d0840af2de tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:36:13.253107 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1302/2573] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:36:13.257186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e054419-1db5-4a30-81d5-49631212cfbb service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:36:13.267710 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e054419-1db5-4a30-81d5-49631212cfbb service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:36:13.272498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473ba76-77ce-4938-b4bc-5c1cf72b4a20 tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b82235fcdf4ca39e4d694f333d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3802a631bfe34ada87880b2f25785956', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:36:13.273273 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473ba76-77ce-4938-b4bc-5c1cf72b4a20 tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:36:13.273600 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473ba76-77ce-4938-b4bc-5c1cf72b4a20 tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:36:13.273944 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473ba76-77ce-4938-b4bc-5c1cf72b4a20 tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:36:13.274800 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473ba76-77ce-4938-b4bc-5c1cf72b4a20 tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:36:13.276797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473ba76-77ce-4938-b4bc-5c1cf72b4a20 tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:36:13.306492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1272/2574] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:36:13 2022] POST /identity/v3/projects => generated 355 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:36:13.310799 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47d741-3bc4-4e28-98db-a0d0840af2de tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:36:13.320731 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47d741-3bc4-4e28-98db-a0d0840af2de tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:36:13.376541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09489034-37ca-49c9-8401-c6173e6660b1 tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b82235fcdf4ca39e4d694f333d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3802a631bfe34ada87880b2f25785956', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:36:13.377211 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09489034-37ca-49c9-8401-c6173e6660b1 tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:36:13.377499 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09489034-37ca-49c9-8401-c6173e6660b1 tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:36:13.377772 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09489034-37ca-49c9-8401-c6173e6660b1 tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:36:13.378494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09489034-37ca-49c9-8401-c6173e6660b1 tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:36:13.378798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09489034-37ca-49c9-8401-c6173e6660b1 tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:36:13.380414 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09489034-37ca-49c9-8401-c6173e6660b1 tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:36:13.392091 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1303/2575] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:36:13.429850 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473ba76-77ce-4938-b4bc-5c1cf72b4a20 tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:36:13.440810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473ba76-77ce-4938-b4bc-5c1cf72b4a20 tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:36:13.445561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2052e4-94c3-46ea-a9bb-4375fd6df7bf tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b82235fcdf4ca39e4d694f333d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3802a631bfe34ada87880b2f25785956', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:36:13.446422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2052e4-94c3-46ea-a9bb-4375fd6df7bf tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:36:13.446707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2052e4-94c3-46ea-a9bb-4375fd6df7bf tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:36:13.447017 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2052e4-94c3-46ea-a9bb-4375fd6df7bf tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] PATH_INFO: `/v3/projects/0d6f22d92d2e4654ad19b9ea51a9ddf1` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:36:13.448208 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2052e4-94c3-46ea-a9bb-4375fd6df7bf tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0d6f22d92d2e4654ad19b9ea51a9ddf1)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:36:13.450134 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2052e4-94c3-46ea-a9bb-4375fd6df7bf tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:36:13.497826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2d2052e4-94c3-46ea-a9bb-4375fd6df7bf tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d6f22d92d2e4654ad19b9ea51a9ddf1', 'request_id': 'req-2d2052e4-94c3-46ea-a9bb-4375fd6df7bf'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:13.503851 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2d2052e4-94c3-46ea-a9bb-4375fd6df7bf tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d6f22d92d2e4654ad19b9ea51a9ddf1', 'request_id': 'req-2d2052e4-94c3-46ea-a9bb-4375fd6df7bf'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:13.509114 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2d2052e4-94c3-46ea-a9bb-4375fd6df7bf tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d6f22d92d2e4654ad19b9ea51a9ddf1', 'request_id': 'req-2d2052e4-94c3-46ea-a9bb-4375fd6df7bf'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:13.521236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2d2052e4-94c3-46ea-a9bb-4375fd6df7bf tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] The token cache is being invalidate because project 0d6f22d92d2e4654ad19b9ea51a9ddf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:36:13.521523 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2d2052e4-94c3-46ea-a9bb-4375fd6df7bf tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:13.522155 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2d2052e4-94c3-46ea-a9bb-4375fd6df7bf tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:13.523750 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1273/2576] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:36:13 2022] DELETE /identity/v3/projects/0d6f22d92d2e4654ad19b9ea51a9ddf1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:36:13.792998 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09489034-37ca-49c9-8401-c6173e6660b1 tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:36:13.794737 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-09489034-37ca-49c9-8401-c6173e6660b1 tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:36:13.860048 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09489034-37ca-49c9-8401-c6173e6660b1 tempest-VolumeQuotaClassesTest-1963399276 tempest-VolumeQuotaClassesTest-1963399276-project-admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:36:13.917321 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6cb3f-6b1e-46ed-b3f7-57ee49cfcaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:36:13.918265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6cb3f-6b1e-46ed-b3f7-57ee49cfcaa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:36:13.918542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6cb3f-6b1e-46ed-b3f7-57ee49cfcaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:36:13.918811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6cb3f-6b1e-46ed-b3f7-57ee49cfcaa9 admin admin] PATH_INFO: `/v3/users/f01ed062dc2f4a3388c186a8ad414584` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:36:13.920057 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6cb3f-6b1e-46ed-b3f7-57ee49cfcaa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01ed062dc2f4a3388c186a8ad414584)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:36:13.921982 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6cb3f-6b1e-46ed-b3f7-57ee49cfcaa9 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:36:13.970679 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d3e6cb3f-6b1e-46ed-b3f7-57ee49cfcaa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01ed062dc2f4a3388c186a8ad414584'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:13.982885 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d3e6cb3f-6b1e-46ed-b3f7-57ee49cfcaa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01ed062dc2f4a3388c186a8ad414584'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:13.983637 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d3e6cb3f-6b1e-46ed-b3f7-57ee49cfcaa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01ed062dc2f4a3388c186a8ad414584'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:13.984251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d3e6cb3f-6b1e-46ed-b3f7-57ee49cfcaa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01ed062dc2f4a3388c186a8ad414584'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:13.991494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d3e6cb3f-6b1e-46ed-b3f7-57ee49cfcaa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01ed062dc2f4a3388c186a8ad414584'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:14.005514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1304/2577] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:36:13 2022] DELETE /identity/v3/users/f01ed062dc2f4a3388c186a8ad414584 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:36:14.010085 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d4c80-b6d0-4a20-b1e8-86fe5260e776 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:36:14.010614 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d4c80-b6d0-4a20-b1e8-86fe5260e776 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:36:14.010614 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d4c80-b6d0-4a20-b1e8-86fe5260e776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:36:14.029569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-356d4c80-b6d0-4a20-b1e8-86fe5260e776 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:36:14.030785 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-356d4c80-b6d0-4a20-b1e8-86fe5260e776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:36:14.090324 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1274/2578] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:36:14.099935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6cb3f-6b1e-46ed-b3f7-57ee49cfcaa9 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:36:14.101345 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-d3e6cb3f-6b1e-46ed-b3f7-57ee49cfcaa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:36:14.158769 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6cb3f-6b1e-46ed-b3f7-57ee49cfcaa9 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:36:14.162882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1576d93-a9bf-435b-8a27-538a04812d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:36:14.163547 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1576d93-a9bf-435b-8a27-538a04812d57 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:36:14.163827 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1576d93-a9bf-435b-8a27-538a04812d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:36:14.164096 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1576d93-a9bf-435b-8a27-538a04812d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:36:14.174069 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1576d93-a9bf-435b-8a27-538a04812d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:36:14.175557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1576d93-a9bf-435b-8a27-538a04812d57 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:36:14.187710 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1305/2579] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:36:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:36:14.468377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d4c80-b6d0-4a20-b1e8-86fe5260e776 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:36:14.469954 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-356d4c80-b6d0-4a20-b1e8-86fe5260e776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:36:14.484528 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d4c80-b6d0-4a20-b1e8-86fe5260e776 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:36:14.490074 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fc671-e70a-4daf-a950-8c527efc8d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:36:14.491051 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fc671-e70a-4daf-a950-8c527efc8d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:36:14.491340 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fc671-e70a-4daf-a950-8c527efc8d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:36:14.491618 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fc671-e70a-4daf-a950-8c527efc8d26 admin admin] PATH_INFO: `/v3/projects/87711a61aed2411c887da687354bbe73` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:36:14.493805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69fc671-e70a-4daf-a950-8c527efc8d26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87711a61aed2411c887da687354bbe73)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:36:14.496536 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69fc671-e70a-4daf-a950-8c527efc8d26 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:36:14.553630 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c69fc671-e70a-4daf-a950-8c527efc8d26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87711a61aed2411c887da687354bbe73', 'request_id': 'req-c69fc671-e70a-4daf-a950-8c527efc8d26'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:14.560458 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c69fc671-e70a-4daf-a950-8c527efc8d26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87711a61aed2411c887da687354bbe73', 'request_id': 'req-c69fc671-e70a-4daf-a950-8c527efc8d26'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:14.565893 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c69fc671-e70a-4daf-a950-8c527efc8d26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87711a61aed2411c887da687354bbe73', 'request_id': 'req-c69fc671-e70a-4daf-a950-8c527efc8d26'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:14.583110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c69fc671-e70a-4daf-a950-8c527efc8d26 admin admin] The token cache is being invalidate because project 87711a61aed2411c887da687354bbe73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:36:14.583441 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c69fc671-e70a-4daf-a950-8c527efc8d26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:14.584022 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-c69fc671-e70a-4daf-a950-8c527efc8d26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:14.585623 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1275/2580] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:36:14 2022] DELETE /identity/v3/projects/87711a61aed2411c887da687354bbe73 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:36:14.590443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1576d93-a9bf-435b-8a27-538a04812d57 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:36:14.600578 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1576d93-a9bf-435b-8a27-538a04812d57 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:36:14.661639 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffdd6d9-5f11-4db9-ad68-137f9ef394ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:36:14.662778 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdd6d9-5f11-4db9-ad68-137f9ef394ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:36:14.663114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdd6d9-5f11-4db9-ad68-137f9ef394ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:36:14.663388 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdd6d9-5f11-4db9-ad68-137f9ef394ae admin admin] PATH_INFO: `/v3/users/47b82235fcdf4ca39e4d694f333d0fe7` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:36:14.664590 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffdd6d9-5f11-4db9-ad68-137f9ef394ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=47b82235fcdf4ca39e4d694f333d0fe7)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:36:14.666513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffdd6d9-5f11-4db9-ad68-137f9ef394ae admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:36:14.716743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-cffdd6d9-5f11-4db9-ad68-137f9ef394ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47b82235fcdf4ca39e4d694f333d0fe7'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:14.728807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-cffdd6d9-5f11-4db9-ad68-137f9ef394ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47b82235fcdf4ca39e4d694f333d0fe7'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:14.729518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-cffdd6d9-5f11-4db9-ad68-137f9ef394ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47b82235fcdf4ca39e4d694f333d0fe7'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:14.731034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-cffdd6d9-5f11-4db9-ad68-137f9ef394ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47b82235fcdf4ca39e4d694f333d0fe7'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:14.737627 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-cffdd6d9-5f11-4db9-ad68-137f9ef394ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47b82235fcdf4ca39e4d694f333d0fe7'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:14.752200 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1306/2581] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:36:14 2022] DELETE /identity/v3/users/47b82235fcdf4ca39e4d694f333d0fe7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:36:15.038793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fc671-e70a-4daf-a950-8c527efc8d26 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:36:15.040442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c69fc671-e70a-4daf-a950-8c527efc8d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:36:15.056499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fc671-e70a-4daf-a950-8c527efc8d26 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:36:15.115094 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cb6c4-ac78-4a52-8a88-1b227e65db96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:36:15.116113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cb6c4-ac78-4a52-8a88-1b227e65db96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:36:15.116309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cb6c4-ac78-4a52-8a88-1b227e65db96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:36:15.116419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cb6c4-ac78-4a52-8a88-1b227e65db96 admin admin] PATH_INFO: `/v3/projects/3802a631bfe34ada87880b2f25785956` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:36:15.117708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cb6c4-ac78-4a52-8a88-1b227e65db96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3802a631bfe34ada87880b2f25785956)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:36:15.119930 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cb6c4-ac78-4a52-8a88-1b227e65db96 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:36:15.166306 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2a1cb6c4-ac78-4a52-8a88-1b227e65db96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3802a631bfe34ada87880b2f25785956', 'request_id': 'req-2a1cb6c4-ac78-4a52-8a88-1b227e65db96'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:15.173255 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2a1cb6c4-ac78-4a52-8a88-1b227e65db96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3802a631bfe34ada87880b2f25785956', 'request_id': 'req-2a1cb6c4-ac78-4a52-8a88-1b227e65db96'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:15.178561 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2a1cb6c4-ac78-4a52-8a88-1b227e65db96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3802a631bfe34ada87880b2f25785956', 'request_id': 'req-2a1cb6c4-ac78-4a52-8a88-1b227e65db96'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:15.193089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2a1cb6c4-ac78-4a52-8a88-1b227e65db96 admin admin] The token cache is being invalidate because project 3802a631bfe34ada87880b2f25785956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:36:15.193382 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2a1cb6c4-ac78-4a52-8a88-1b227e65db96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:15.194032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2a1cb6c4-ac78-4a52-8a88-1b227e65db96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:36:15.196550 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1276/2582] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:36:15 2022] DELETE /identity/v3/projects/3802a631bfe34ada87880b2f25785956 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:36:15.202845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67e0b2-7b36-444c-82ff-6379847e3145 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:36:15.203126 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67e0b2-7b36-444c-82ff-6379847e3145 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:36:15.203400 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67e0b2-7b36-444c-82ff-6379847e3145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:36:15.221501 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-8e67e0b2-7b36-444c-82ff-6379847e3145 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:36:15.222853 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-8e67e0b2-7b36-444c-82ff-6379847e3145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:36:15.281369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1307/2583] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:36:15.289457 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d456d-dbd2-4823-b1f4-a402de8fe175 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:36:15.289745 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d456d-dbd2-4823-b1f4-a402de8fe175 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:36:15.290029 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d456d-dbd2-4823-b1f4-a402de8fe175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:36:15.310197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-c32d456d-dbd2-4823-b1f4-a402de8fe175 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:36:15.311421 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c32d456d-dbd2-4823-b1f4-a402de8fe175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:36:15.319258 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1277/2584] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:36:15.323531 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67e0b2-7b36-444c-82ff-6379847e3145 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:36:15.333174 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67e0b2-7b36-444c-82ff-6379847e3145 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:36:15.337922 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3393c5-55f2-462c-b48c-94169b79c803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:36:15.338584 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3393c5-55f2-462c-b48c-94169b79c803 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:36:15.338904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3393c5-55f2-462c-b48c-94169b79c803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:36:15.339745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3393c5-55f2-462c-b48c-94169b79c803 admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:36:15.340499 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3393c5-55f2-462c-b48c-94169b79c803 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:36:15.340810 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3393c5-55f2-462c-b48c-94169b79c803 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:36:15.342421 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3393c5-55f2-462c-b48c-94169b79c803 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:36:15.353929 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1308/2585] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:36:15.358956 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d456d-dbd2-4823-b1f4-a402de8fe175 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:36:15.368078 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d456d-dbd2-4823-b1f4-a402de8fe175 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:36:15.372694 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aec648-8d7a-4db4-84d1-096f36ba4974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:36:15.373337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aec648-8d7a-4db4-84d1-096f36ba4974 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:36:15.373621 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aec648-8d7a-4db4-84d1-096f36ba4974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:36:15.373942 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aec648-8d7a-4db4-84d1-096f36ba4974 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:36:15.374588 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aec648-8d7a-4db4-84d1-096f36ba4974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:36:15.376547 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aec648-8d7a-4db4-84d1-096f36ba4974 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:36:15.400858 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1278/2586] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:36:15 2022] POST /identity/v3/projects => generated 369 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:36:15.405455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3393c5-55f2-462c-b48c-94169b79c803 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:36:15.415574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3393c5-55f2-462c-b48c-94169b79c803 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:36:15.469913 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae0c8b-91b6-41c8-9502-c42ed8fbf98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:36:15.470565 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae0c8b-91b6-41c8-9502-c42ed8fbf98f admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:36:15.470870 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae0c8b-91b6-41c8-9502-c42ed8fbf98f admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:36:15.471150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae0c8b-91b6-41c8-9502-c42ed8fbf98f admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:36:15.471824 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae0c8b-91b6-41c8-9502-c42ed8fbf98f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:36:15.473728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae0c8b-91b6-41c8-9502-c42ed8fbf98f admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:36:15.493560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1309/2587] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:36:15 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:36:15.497674 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aec648-8d7a-4db4-84d1-096f36ba4974 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:36:15.507717 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aec648-8d7a-4db4-84d1-096f36ba4974 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:36:15.512477 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafd3af-36e4-47d2-a3f6-55bf8f01134c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:36:15.513133 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafd3af-36e4-47d2-a3f6-55bf8f01134c admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:36:15.513418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafd3af-36e4-47d2-a3f6-55bf8f01134c admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:36:15.513696 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafd3af-36e4-47d2-a3f6-55bf8f01134c admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:36:15.514419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafd3af-36e4-47d2-a3f6-55bf8f01134c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:36:15.516086 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafd3af-36e4-47d2-a3f6-55bf8f01134c admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:36:15.528002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1279/2588] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:36:15.531381 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae0c8b-91b6-41c8-9502-c42ed8fbf98f admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:36:15.542043 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae0c8b-91b6-41c8-9502-c42ed8fbf98f admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:36:15.547252 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f8526-a1f7-4a37-be3f-32c1e3822cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:36:15.547977 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f8526-a1f7-4a37-be3f-32c1e3822cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:36:15.548255 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f8526-a1f7-4a37-be3f-32c1e3822cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:36:15.548529 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f8526-a1f7-4a37-be3f-32c1e3822cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:36:15.549282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f8526-a1f7-4a37-be3f-32c1e3822cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:36:15.550891 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f8526-a1f7-4a37-be3f-32c1e3822cd7 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:36:15.561444 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1310/2589] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:36:15.565653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafd3af-36e4-47d2-a3f6-55bf8f01134c admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:36:15.575763 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafd3af-36e4-47d2-a3f6-55bf8f01134c admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:36:15.580737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e47e1-7cad-4d37-a81b-f24d583aaeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:36:15.581605 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e47e1-7cad-4d37-a81b-f24d583aaeea admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:36:15.581912 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e47e1-7cad-4d37-a81b-f24d583aaeea admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:36:15.582207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e47e1-7cad-4d37-a81b-f24d583aaeea admin admin] PATH_INFO: `/v3/projects/e1e8abb21c4042d9ab70223ea179214b/users/12d07bf03045499a9f8ff4ac6fdff44d/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:36:15.597576 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e47e1-7cad-4d37-a81b-f24d583aaeea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e8abb21c4042d9ab70223ea179214b, user_id=12d07bf03045499a9f8ff4ac6fdff44d, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:36:15.600310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e47e1-7cad-4d37-a81b-f24d583aaeea admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:36:15.612990 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1280/2590] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:36:15 2022] PUT /identity/v3/projects/e1e8abb21c4042d9ab70223ea179214b/users/12d07bf03045499a9f8ff4ac6fdff44d/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:36:15.624450 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f9668-cca6-44dc-908f-3b475295e5eb None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:36:15.624962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f9668-cca6-44dc-908f-3b475295e5eb None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:36:15.624962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f9668-cca6-44dc-908f-3b475295e5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:36:15.650307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-0e0f9668-cca6-44dc-908f-3b475295e5eb None None] MFA Rules not processed for user `12d07bf03045499a9f8ff4ac6fdff44d`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:36:15.653032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-0e0f9668-cca6-44dc-908f-3b475295e5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:36:15.716651 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1311/2591] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:36:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:36:15.728732 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e47e1-7cad-4d37-a81b-f24d583aaeea admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:36:15.731080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-5c9e47e1-7cad-4d37-a81b-f24d583aaeea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:36:15.816493 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e47e1-7cad-4d37-a81b-f24d583aaeea admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:36:15.820671 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a301c2f-be59-452a-915e-d8fc96b496c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdd8008619d4ee3b8fe45e0e5241878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:36:15.821334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a301c2f-be59-452a-915e-d8fc96b496c0 service glance] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:36:15.821611 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a301c2f-be59-452a-915e-d8fc96b496c0 service glance] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:36:15.821884 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a301c2f-be59-452a-915e-d8fc96b496c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:36:15.831665 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a301c2f-be59-452a-915e-d8fc96b496c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:36:15.840387 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a301c2f-be59-452a-915e-d8fc96b496c0 service glance] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:36:15.843765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1281/2592] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:36:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:36:52.590732 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f9668-cca6-44dc-908f-3b475295e5eb None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:36:52.592240 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-0e0f9668-cca6-44dc-908f-3b475295e5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:36:52.651962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f9668-cca6-44dc-908f-3b475295e5eb None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:36:52.655515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7c247-e303-4604-905e-195431048f4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:36:52.656164 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7c247-e303-4604-905e-195431048f4a service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:36:52.656443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7c247-e303-4604-905e-195431048f4a service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:36:52.656716 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7c247-e303-4604-905e-195431048f4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:36:52.658446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-b0a7c247-e303-4604-905e-195431048f4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:36:52.715825 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7c247-e303-4604-905e-195431048f4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:36:52.717273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7c247-e303-4604-905e-195431048f4a service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:36:52.726454 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1312/2593] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:36:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:38:12.481668 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a301c2f-be59-452a-915e-d8fc96b496c0 service glance] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:38:12.483109 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-4a301c2f-be59-452a-915e-d8fc96b496c0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:38:12.577658 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a301c2f-be59-452a-915e-d8fc96b496c0 service glance] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:38:12.581332 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae835d-aba4-4136-b5a6-3bff65253915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:38:12.581974 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae835d-aba4-4136-b5a6-3bff65253915 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:12.582258 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae835d-aba4-4136-b5a6-3bff65253915 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:12.582536 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae835d-aba4-4136-b5a6-3bff65253915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:12.584348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-d7ae835d-aba4-4136-b5a6-3bff65253915 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:38:12.663062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae835d-aba4-4136-b5a6-3bff65253915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:38:12.664491 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae835d-aba4-4136-b5a6-3bff65253915 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:38:12.674852 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1282/2594] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:38:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:38:15.943616 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7c247-e303-4604-905e-195431048f4a service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:38:15.945070 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-b0a7c247-e303-4604-905e-195431048f4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:38:15.989338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7c247-e303-4604-905e-195431048f4a service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:38:15.994164 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd063a-ec8c-400a-8886-508e69be990c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:38:15.995317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd063a-ec8c-400a-8886-508e69be990c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:15.995599 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd063a-ec8c-400a-8886-508e69be990c admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:15.995875 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd063a-ec8c-400a-8886-508e69be990c admin admin] PATH_INFO: `/v3/users/477e3c3f65f6407c9c7a932c9650334d` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:15.997116 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd063a-ec8c-400a-8886-508e69be990c admin admin] RBAC: Authorizing `identity:delete_user(user_id=477e3c3f65f6407c9c7a932c9650334d)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:38:15.999154 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd063a-ec8c-400a-8886-508e69be990c admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:38:16.048713 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-93cd063a-ec8c-400a-8886-508e69be990c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '477e3c3f65f6407c9c7a932c9650334d'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:38:16.060589 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-93cd063a-ec8c-400a-8886-508e69be990c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '477e3c3f65f6407c9c7a932c9650334d'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:38:16.061288 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-93cd063a-ec8c-400a-8886-508e69be990c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '477e3c3f65f6407c9c7a932c9650334d'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:38:16.061891 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-93cd063a-ec8c-400a-8886-508e69be990c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '477e3c3f65f6407c9c7a932c9650334d'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:38:16.068570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-93cd063a-ec8c-400a-8886-508e69be990c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '477e3c3f65f6407c9c7a932c9650334d'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:38:16.081439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1313/2595] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:38:15 2022] DELETE /identity/v3/users/477e3c3f65f6407c9c7a932c9650334d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:38:16.261946 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae835d-aba4-4136-b5a6-3bff65253915 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:38:16.272769 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae835d-aba4-4136-b5a6-3bff65253915 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:38:16.335509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de313ee-ba8d-4b4d-8884-e6439d085f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:38:16.336365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de313ee-ba8d-4b4d-8884-e6439d085f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:16.336652 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de313ee-ba8d-4b4d-8884-e6439d085f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:16.336922 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de313ee-ba8d-4b4d-8884-e6439d085f5b admin admin] PATH_INFO: `/v3/projects/e076e120b91a49b6896f0b16407564a2` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:16.338079 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de313ee-ba8d-4b4d-8884-e6439d085f5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e076e120b91a49b6896f0b16407564a2)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:38:16.340032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de313ee-ba8d-4b4d-8884-e6439d085f5b admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:38:16.384271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-1de313ee-ba8d-4b4d-8884-e6439d085f5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e076e120b91a49b6896f0b16407564a2', 'request_id': 'req-1de313ee-ba8d-4b4d-8884-e6439d085f5b'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:38:16.390168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-1de313ee-ba8d-4b4d-8884-e6439d085f5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e076e120b91a49b6896f0b16407564a2', 'request_id': 'req-1de313ee-ba8d-4b4d-8884-e6439d085f5b'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:38:16.395890 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-1de313ee-ba8d-4b4d-8884-e6439d085f5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e076e120b91a49b6896f0b16407564a2', 'request_id': 'req-1de313ee-ba8d-4b4d-8884-e6439d085f5b'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:38:16.408582 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-1de313ee-ba8d-4b4d-8884-e6439d085f5b admin admin] The token cache is being invalidate because project e076e120b91a49b6896f0b16407564a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:38:16.408953 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-1de313ee-ba8d-4b4d-8884-e6439d085f5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:38:16.410357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-1de313ee-ba8d-4b4d-8884-e6439d085f5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:38:16.412140 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1283/2596] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:38:16 2022] DELETE /identity/v3/projects/e076e120b91a49b6896f0b16407564a2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:38:16.417807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7b69f-1fa2-49d0-a80b-ccc9035d7642 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:16.418162 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7b69f-1fa2-49d0-a80b-ccc9035d7642 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:16.418527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7b69f-1fa2-49d0-a80b-ccc9035d7642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:16.436014 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-00a7b69f-1fa2-49d0-a80b-ccc9035d7642 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:38:16.437323 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-00a7b69f-1fa2-49d0-a80b-ccc9035d7642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:38:16.493922 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1314/2597] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:38:16.501672 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f0738-2054-4114-9e70-f9ea17787593 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:16.501978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f0738-2054-4114-9e70-f9ea17787593 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:16.502256 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f0738-2054-4114-9e70-f9ea17787593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:16.520904 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-799f0738-2054-4114-9e70-f9ea17787593 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:38:16.522103 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-799f0738-2054-4114-9e70-f9ea17787593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:38:16.530046 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1284/2598] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:38:16.535274 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7b69f-1fa2-49d0-a80b-ccc9035d7642 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:38:16.544895 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7b69f-1fa2-49d0-a80b-ccc9035d7642 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:38:16.549528 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e509d8-142e-4d98-ac3a-9c7461ccfbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:38:16.550184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e509d8-142e-4d98-ac3a-9c7461ccfbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:16.550471 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e509d8-142e-4d98-ac3a-9c7461ccfbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:16.550749 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e509d8-142e-4d98-ac3a-9c7461ccfbf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:16.551505 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e509d8-142e-4d98-ac3a-9c7461ccfbf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:38:16.551813 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e509d8-142e-4d98-ac3a-9c7461ccfbf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:38:16.553397 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e509d8-142e-4d98-ac3a-9c7461ccfbf5 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:38:16.566882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1315/2599] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:38:16.573518 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f0738-2054-4114-9e70-f9ea17787593 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:38:16.585183 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f0738-2054-4114-9e70-f9ea17787593 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:38:16.590186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b9bbc-3af5-47b0-bab2-c5b2bbd78fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:38:16.590852 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b9bbc-3af5-47b0-bab2-c5b2bbd78fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:16.591172 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b9bbc-3af5-47b0-bab2-c5b2bbd78fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:16.591449 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b9bbc-3af5-47b0-bab2-c5b2bbd78fa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:16.592129 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b9bbc-3af5-47b0-bab2-c5b2bbd78fa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:38:16.594404 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b9bbc-3af5-47b0-bab2-c5b2bbd78fa6 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:38:16.621770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1285/2600] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:38:16 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:38:16.625993 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e509d8-142e-4d98-ac3a-9c7461ccfbf5 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:38:16.636541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e509d8-142e-4d98-ac3a-9c7461ccfbf5 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:38:16.690248 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90348e36-e8af-4a3a-9950-1df1e077eb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:38:16.690935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90348e36-e8af-4a3a-9950-1df1e077eb51 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:16.691213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90348e36-e8af-4a3a-9950-1df1e077eb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:16.691483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90348e36-e8af-4a3a-9950-1df1e077eb51 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:16.692195 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90348e36-e8af-4a3a-9950-1df1e077eb51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:38:16.694077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90348e36-e8af-4a3a-9950-1df1e077eb51 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:38:16.717066 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1316/2601] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:38:16 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:38:16.718400 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b9bbc-3af5-47b0-bab2-c5b2bbd78fa6 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:38:16.728558 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b9bbc-3af5-47b0-bab2-c5b2bbd78fa6 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:38:16.733113 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418b39b-8d4e-47ac-983d-a3a8bf6141b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:38:16.733755 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418b39b-8d4e-47ac-983d-a3a8bf6141b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:16.734033 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418b39b-8d4e-47ac-983d-a3a8bf6141b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:16.734302 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418b39b-8d4e-47ac-983d-a3a8bf6141b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:16.735042 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418b39b-8d4e-47ac-983d-a3a8bf6141b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:38:16.736712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418b39b-8d4e-47ac-983d-a3a8bf6141b5 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:38:16.746782 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1286/2602] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:38:16.750766 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90348e36-e8af-4a3a-9950-1df1e077eb51 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:38:16.761251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90348e36-e8af-4a3a-9950-1df1e077eb51 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:38:16.765996 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8213b07-579c-4136-b62e-696bcfa01c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:38:16.766650 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8213b07-579c-4136-b62e-696bcfa01c85 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:16.766992 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8213b07-579c-4136-b62e-696bcfa01c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:16.767304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8213b07-579c-4136-b62e-696bcfa01c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:16.768563 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8213b07-579c-4136-b62e-696bcfa01c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:38:16.770142 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8213b07-579c-4136-b62e-696bcfa01c85 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:38:16.779868 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1317/2603] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:38:16.783867 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418b39b-8d4e-47ac-983d-a3a8bf6141b5 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:38:16.793940 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418b39b-8d4e-47ac-983d-a3a8bf6141b5 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:38:16.798589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fba682-e7cd-40df-b8a4-4b6cfed1fd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:38:16.799492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fba682-e7cd-40df-b8a4-4b6cfed1fd39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:16.799771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fba682-e7cd-40df-b8a4-4b6cfed1fd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:16.800044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fba682-e7cd-40df-b8a4-4b6cfed1fd39 admin admin] PATH_INFO: `/v3/projects/a8740291e9c9462d8b4b3d76762d1930/users/246ea5852be548f791046f765f3bcf45/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:16.814063 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fba682-e7cd-40df-b8a4-4b6cfed1fd39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8740291e9c9462d8b4b3d76762d1930, user_id=246ea5852be548f791046f765f3bcf45, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:38:16.817265 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fba682-e7cd-40df-b8a4-4b6cfed1fd39 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:38:16.830373 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1287/2604] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:38:16 2022] PUT /identity/v3/projects/a8740291e9c9462d8b4b3d76762d1930/users/246ea5852be548f791046f765f3bcf45/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:38:16.835472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fefec-b796-426c-9f0b-105fbc51d415 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:16.835782 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fefec-b796-426c-9f0b-105fbc51d415 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:16.836053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fefec-b796-426c-9f0b-105fbc51d415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:16.853268 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-610fefec-b796-426c-9f0b-105fbc51d415 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:38:16.854456 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-610fefec-b796-426c-9f0b-105fbc51d415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:38:16.912170 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1318/2605] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:38:16.924910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fba682-e7cd-40df-b8a4-4b6cfed1fd39 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:38:16.928337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-50fba682-e7cd-40df-b8a4-4b6cfed1fd39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:38:16.987755 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fba682-e7cd-40df-b8a4-4b6cfed1fd39 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:38:16.991593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a38bfb-863a-4865-8b69-ae31591b47bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:38:16.992236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a38bfb-863a-4865-8b69-ae31591b47bb service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:16.992556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a38bfb-863a-4865-8b69-ae31591b47bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:16.992831 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a38bfb-863a-4865-8b69-ae31591b47bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:17.002483 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a38bfb-863a-4865-8b69-ae31591b47bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:38:17.003948 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a38bfb-863a-4865-8b69-ae31591b47bb service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:38:17.013212 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1288/2606] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:38:21.159736 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfb47e-083d-47bb-be2a-92e2e27dab8f None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:21.160285 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfb47e-083d-47bb-be2a-92e2e27dab8f None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:21.160634 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfb47e-083d-47bb-be2a-92e2e27dab8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:21.191268 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-b9dfb47e-083d-47bb-be2a-92e2e27dab8f None None] MFA Rules not processed for user `246ea5852be548f791046f765f3bcf45`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:38:21.192516 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-b9dfb47e-083d-47bb-be2a-92e2e27dab8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:38:21.260992 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1319/2607] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:38:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:38:21.276530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a38bfb-863a-4865-8b69-ae31591b47bb service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:38:21.278545 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-e5a38bfb-863a-4865-8b69-ae31591b47bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:38:21.353740 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a38bfb-863a-4865-8b69-ae31591b47bb service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:38:21.359821 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c371ccf-cef6-4b86-ba84-468a05853e97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:38:21.360486 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c371ccf-cef6-4b86-ba84-468a05853e97 service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:21.360896 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c371ccf-cef6-4b86-ba84-468a05853e97 service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:21.361182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c371ccf-cef6-4b86-ba84-468a05853e97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:21.369863 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c371ccf-cef6-4b86-ba84-468a05853e97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:38:21.371516 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c371ccf-cef6-4b86-ba84-468a05853e97 service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:38:21.381663 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1289/2608] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:38:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:38:22.653152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6f2fa-baa5-4917-9bbe-93c5899ca6ca None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:22.653674 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6f2fa-baa5-4917-9bbe-93c5899ca6ca None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:22.653779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6f2fa-baa5-4917-9bbe-93c5899ca6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:22.672952 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-5dc6f2fa-baa5-4917-9bbe-93c5899ca6ca None None] MFA Rules not processed for user `246ea5852be548f791046f765f3bcf45`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:38:22.674732 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-5dc6f2fa-baa5-4917-9bbe-93c5899ca6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:38:22.682564 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1320/2609] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:38:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:38:22.717462 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c371ccf-cef6-4b86-ba84-468a05853e97 service nova] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:38:22.721318 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-1c371ccf-cef6-4b86-ba84-468a05853e97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:38:22.792821 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c371ccf-cef6-4b86-ba84-468a05853e97 service nova] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:38:22.796517 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ada5e-2560-4a41-aceb-c7fa8984e096 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cdd8008619d4ee3b8fe45e0e5241878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:38:22.797230 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ada5e-2560-4a41-aceb-c7fa8984e096 service glance] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:22.797714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ada5e-2560-4a41-aceb-c7fa8984e096 service glance] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:22.797990 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ada5e-2560-4a41-aceb-c7fa8984e096 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:22.800428 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-675ada5e-2560-4a41-aceb-c7fa8984e096 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:38:22.814875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ada5e-2560-4a41-aceb-c7fa8984e096 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:38:22.816372 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ada5e-2560-4a41-aceb-c7fa8984e096 service glance] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:38:22.827534 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1290/2610] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:38:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:38:23.118503 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6f2fa-baa5-4917-9bbe-93c5899ca6ca None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:38:23.128228 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6f2fa-baa5-4917-9bbe-93c5899ca6ca None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:38:23.132563 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279fd13-76a1-4061-a228-cf11a30d88d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:38:23.133225 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279fd13-76a1-4061-a228-cf11a30d88d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:23.133507 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279fd13-76a1-4061-a228-cf11a30d88d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:23.133786 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279fd13-76a1-4061-a228-cf11a30d88d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:23.135723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e279fd13-76a1-4061-a228-cf11a30d88d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:38:23.154712 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279fd13-76a1-4061-a228-cf11a30d88d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:38:23.156282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279fd13-76a1-4061-a228-cf11a30d88d9 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:38:23.165420 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1321/2611] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:38:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:38:23.527149 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ada5e-2560-4a41-aceb-c7fa8984e096 service glance] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:38:23.528992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-675ada5e-2560-4a41-aceb-c7fa8984e096 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:38:23.542660 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279fd13-76a1-4061-a228-cf11a30d88d9 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:38:23.556054 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279fd13-76a1-4061-a228-cf11a30d88d9 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:38:23.560748 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01e7d4-749b-48cb-ae65-8321a30f4307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:38:23.561689 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01e7d4-749b-48cb-ae65-8321a30f4307 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:23.562223 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01e7d4-749b-48cb-ae65-8321a30f4307 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:23.562716 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01e7d4-749b-48cb-ae65-8321a30f4307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:23.564867 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-fb01e7d4-749b-48cb-ae65-8321a30f4307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:38:23.580968 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01e7d4-749b-48cb-ae65-8321a30f4307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:38:23.583021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01e7d4-749b-48cb-ae65-8321a30f4307 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:38:23.610004 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1322/2612] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:38:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:38:23.627239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ada5e-2560-4a41-aceb-c7fa8984e096 service glance] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:38:23.634522 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1ab09-6104-4740-83fa-fbdf41b1de2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908d23b035f14756b438b3a61a63b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:38:23.635225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1ab09-6104-4740-83fa-fbdf41b1de2b service placement] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:23.635655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1ab09-6104-4740-83fa-fbdf41b1de2b service placement] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:23.635938 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1ab09-6104-4740-83fa-fbdf41b1de2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:23.637952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-30b1ab09-6104-4740-83fa-fbdf41b1de2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:38:23.652456 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1ab09-6104-4740-83fa-fbdf41b1de2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:38:23.654134 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1ab09-6104-4740-83fa-fbdf41b1de2b service placement] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:38:23.666836 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1291/2613] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:38:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:38:25.464166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01e7d4-749b-48cb-ae65-8321a30f4307 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:38:25.465676 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-fb01e7d4-749b-48cb-ae65-8321a30f4307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:38:25.476967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01e7d4-749b-48cb-ae65-8321a30f4307 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:38:25.480951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cd561-8d69-400f-99b0-70bb5bcad5a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:38:25.481602 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cd561-8d69-400f-99b0-70bb5bcad5a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:25.481877 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cd561-8d69-400f-99b0-70bb5bcad5a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:25.482147 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cd561-8d69-400f-99b0-70bb5bcad5a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:25.484157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-051cd561-8d69-400f-99b0-70bb5bcad5a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:38:25.495438 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cd561-8d69-400f-99b0-70bb5bcad5a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:38:25.497641 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cd561-8d69-400f-99b0-70bb5bcad5a6 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:38:25.508166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1323/2614] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:38:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:38:32.609181 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1ab09-6104-4740-83fa-fbdf41b1de2b service placement] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:38:32.610646 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-30b1ab09-6104-4740-83fa-fbdf41b1de2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:38:32.627373 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1ab09-6104-4740-83fa-fbdf41b1de2b service placement] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:38:32.635239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ae6d2-4ec1-447e-a786-3270ca5fea4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:38:32.636080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ae6d2-4ec1-447e-a786-3270ca5fea4d service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:32.636380 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ae6d2-4ec1-447e-a786-3270ca5fea4d service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:32.636682 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ae6d2-4ec1-447e-a786-3270ca5fea4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:32.638626 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-012ae6d2-4ec1-447e-a786-3270ca5fea4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:38:32.652099 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ae6d2-4ec1-447e-a786-3270ca5fea4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:38:32.653696 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ae6d2-4ec1-447e-a786-3270ca5fea4d service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:38:32.665058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1292/2615] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:38:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:38:36.639149 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cd561-8d69-400f-99b0-70bb5bcad5a6 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:38:36.653338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cd561-8d69-400f-99b0-70bb5bcad5a6 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:38:36.659991 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a29498-611b-4e1f-8411-fbfe3242d583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:38:36.660645 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a29498-611b-4e1f-8411-fbfe3242d583 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:38:36.660922 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a29498-611b-4e1f-8411-fbfe3242d583 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:38:36.661190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a29498-611b-4e1f-8411-fbfe3242d583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:38:36.663102 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-04a29498-611b-4e1f-8411-fbfe3242d583 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:38:36.675464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a29498-611b-4e1f-8411-fbfe3242d583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:38:36.677214 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a29498-611b-4e1f-8411-fbfe3242d583 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:38:36.690200 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1324/2616] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:38:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:39:06.715024 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ae6d2-4ec1-447e-a786-3270ca5fea4d service nova] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:39:06.735684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ae6d2-4ec1-447e-a786-3270ca5fea4d service nova] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:39:06.740686 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137f425-8680-4348-b490-061be225482a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908d23b035f14756b438b3a61a63b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:39:06.741314 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137f425-8680-4348-b490-061be225482a service placement] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:39:06.741593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137f425-8680-4348-b490-061be225482a service placement] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:39:06.741862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137f425-8680-4348-b490-061be225482a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:39:06.743611 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-0137f425-8680-4348-b490-061be225482a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:39:06.755470 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137f425-8680-4348-b490-061be225482a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:39:06.757032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137f425-8680-4348-b490-061be225482a service placement] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:39:06.766698 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1293/2617] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:39:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:40:13.009474 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a29498-611b-4e1f-8411-fbfe3242d583 service nova] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:13.018648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a29498-611b-4e1f-8411-fbfe3242d583 service nova] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:13.022206 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67463a7-5bde-4edd-86a5-bcf5ee886529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:13.022871 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67463a7-5bde-4edd-86a5-bcf5ee886529 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:13.023162 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67463a7-5bde-4edd-86a5-bcf5ee886529 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:13.023439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67463a7-5bde-4edd-86a5-bcf5ee886529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:13.025217 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a67463a7-5bde-4edd-86a5-bcf5ee886529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:13.058508 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67463a7-5bde-4edd-86a5-bcf5ee886529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:13.059973 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67463a7-5bde-4edd-86a5-bcf5ee886529 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:13.078259 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1325/2618] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:40:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:40:16.084274 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137f425-8680-4348-b490-061be225482a service placement] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:16.085796 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-0137f425-8680-4348-b490-061be225482a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:16.110060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137f425-8680-4348-b490-061be225482a service placement] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:16.114658 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f211f1a-2084-42a8-b109-e39f458bb062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:16.115537 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f211f1a-2084-42a8-b109-e39f458bb062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:16.115818 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f211f1a-2084-42a8-b109-e39f458bb062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:16.116089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f211f1a-2084-42a8-b109-e39f458bb062 admin admin] PATH_INFO: `/v3/users/5e51df81654f4ece9a90adaa1f7a5f4a` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:16.117262 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f211f1a-2084-42a8-b109-e39f458bb062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e51df81654f4ece9a90adaa1f7a5f4a)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:16.119207 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f211f1a-2084-42a8-b109-e39f458bb062 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:16.172606 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6f211f1a-2084-42a8-b109-e39f458bb062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e51df81654f4ece9a90adaa1f7a5f4a'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:16.181820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6f211f1a-2084-42a8-b109-e39f458bb062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e51df81654f4ece9a90adaa1f7a5f4a'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:16.195597 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6f211f1a-2084-42a8-b109-e39f458bb062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e51df81654f4ece9a90adaa1f7a5f4a'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:16.196433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6f211f1a-2084-42a8-b109-e39f458bb062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e51df81654f4ece9a90adaa1f7a5f4a'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:16.203417 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6f211f1a-2084-42a8-b109-e39f458bb062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e51df81654f4ece9a90adaa1f7a5f4a'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:16.209685 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1294/2619] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:40:16 2022] DELETE /identity/v3/users/5e51df81654f4ece9a90adaa1f7a5f4a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:40:16.393175 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67463a7-5bde-4edd-86a5-bcf5ee886529 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:16.404872 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67463a7-5bde-4edd-86a5-bcf5ee886529 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:16.461892 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06345b02-355e-4c8c-8d6a-f3a33127d461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:16.462749 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06345b02-355e-4c8c-8d6a-f3a33127d461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:16.463184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06345b02-355e-4c8c-8d6a-f3a33127d461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:16.463400 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06345b02-355e-4c8c-8d6a-f3a33127d461 admin admin] PATH_INFO: `/v3/projects/6feadeffa89f44d0b5e327c6e70ffd62` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:16.473465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06345b02-355e-4c8c-8d6a-f3a33127d461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6feadeffa89f44d0b5e327c6e70ffd62)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:16.475431 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06345b02-355e-4c8c-8d6a-f3a33127d461 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:16.522114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-06345b02-355e-4c8c-8d6a-f3a33127d461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6feadeffa89f44d0b5e327c6e70ffd62', 'request_id': 'req-06345b02-355e-4c8c-8d6a-f3a33127d461'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:16.529338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-06345b02-355e-4c8c-8d6a-f3a33127d461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6feadeffa89f44d0b5e327c6e70ffd62', 'request_id': 'req-06345b02-355e-4c8c-8d6a-f3a33127d461'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:16.537586 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-06345b02-355e-4c8c-8d6a-f3a33127d461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6feadeffa89f44d0b5e327c6e70ffd62', 'request_id': 'req-06345b02-355e-4c8c-8d6a-f3a33127d461'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:16.548802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-06345b02-355e-4c8c-8d6a-f3a33127d461 admin admin] The token cache is being invalidate because project 6feadeffa89f44d0b5e327c6e70ffd62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:40:16.549088 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-06345b02-355e-4c8c-8d6a-f3a33127d461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:16.549730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-06345b02-355e-4c8c-8d6a-f3a33127d461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:16.551320 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1326/2620] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:40:16 2022] DELETE /identity/v3/projects/6feadeffa89f44d0b5e327c6e70ffd62 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:40:16.557574 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b40047-3e9d-470f-8ba4-fd9a4e908916 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:16.557866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b40047-3e9d-470f-8ba4-fd9a4e908916 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:16.558148 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b40047-3e9d-470f-8ba4-fd9a4e908916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:16.617917 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-04b40047-3e9d-470f-8ba4-fd9a4e908916 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:40:16.619186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-04b40047-3e9d-470f-8ba4-fd9a4e908916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:16.677792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1295/2621] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:40:16.685996 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c1011-9326-4a04-88c1-f2fc49211afd None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:16.686276 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c1011-9326-4a04-88c1-f2fc49211afd None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:16.686549 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c1011-9326-4a04-88c1-f2fc49211afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:16.703676 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-e95c1011-9326-4a04-88c1-f2fc49211afd None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:40:16.704844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e95c1011-9326-4a04-88c1-f2fc49211afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:16.712728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1327/2622] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:40:16.717392 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b40047-3e9d-470f-8ba4-fd9a4e908916 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:16.727074 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b40047-3e9d-470f-8ba4-fd9a4e908916 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:16.732307 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2c43b-98c0-42e7-bd56-c3727e1f1b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:16.732955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2c43b-98c0-42e7-bd56-c3727e1f1b14 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:16.733237 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2c43b-98c0-42e7-bd56-c3727e1f1b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:16.733600 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2c43b-98c0-42e7-bd56-c3727e1f1b14 admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:16.734239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2c43b-98c0-42e7-bd56-c3727e1f1b14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:40:16.734547 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2c43b-98c0-42e7-bd56-c3727e1f1b14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:16.736177 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2c43b-98c0-42e7-bd56-c3727e1f1b14 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:16.747322 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1296/2623] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 15:40:16.751465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c1011-9326-4a04-88c1-f2fc49211afd None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:16.760677 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c1011-9326-4a04-88c1-f2fc49211afd None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:16.765353 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b780714-4f8c-4938-add6-022fd85b113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:16.766040 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b780714-4f8c-4938-add6-022fd85b113d admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:16.766435 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b780714-4f8c-4938-add6-022fd85b113d admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:16.766719 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b780714-4f8c-4938-add6-022fd85b113d admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:16.767426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b780714-4f8c-4938-add6-022fd85b113d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:16.769311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b780714-4f8c-4938-add6-022fd85b113d admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:16.804247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1328/2624] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:40:16 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:40:16.808445 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2c43b-98c0-42e7-bd56-c3727e1f1b14 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:16.818810 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2c43b-98c0-42e7-bd56-c3727e1f1b14 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:16.873141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0821d4b-57b4-44de-83f7-9cec20b95110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:16.873801 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0821d4b-57b4-44de-83f7-9cec20b95110 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:16.874082 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0821d4b-57b4-44de-83f7-9cec20b95110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:16.874359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0821d4b-57b4-44de-83f7-9cec20b95110 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:16.875071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0821d4b-57b4-44de-83f7-9cec20b95110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:16.876979 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0821d4b-57b4-44de-83f7-9cec20b95110 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:16.900461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1297/2625] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:40:16 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:40:16.901586 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b780714-4f8c-4938-add6-022fd85b113d admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:16.915925 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b780714-4f8c-4938-add6-022fd85b113d admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:16.922394 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4cb43-6d39-4030-ba45-91baea0d851e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:16.923104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4cb43-6d39-4030-ba45-91baea0d851e admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:16.923917 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4cb43-6d39-4030-ba45-91baea0d851e admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:16.923917 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4cb43-6d39-4030-ba45-91baea0d851e admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:16.924368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4cb43-6d39-4030-ba45-91baea0d851e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:16.928470 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4cb43-6d39-4030-ba45-91baea0d851e admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:16.938745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1329/2626] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:40:16.942888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0821d4b-57b4-44de-83f7-9cec20b95110 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:16.954116 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0821d4b-57b4-44de-83f7-9cec20b95110 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:16.958886 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb8b63-2917-4a11-8b32-3670e1bc5447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:16.959546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb8b63-2917-4a11-8b32-3670e1bc5447 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:16.959831 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb8b63-2917-4a11-8b32-3670e1bc5447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:16.960108 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb8b63-2917-4a11-8b32-3670e1bc5447 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:16.960831 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb8b63-2917-4a11-8b32-3670e1bc5447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:16.962444 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb8b63-2917-4a11-8b32-3670e1bc5447 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:16.973595 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1298/2627] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:40:16.977654 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4cb43-6d39-4030-ba45-91baea0d851e admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:16.987533 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4cb43-6d39-4030-ba45-91baea0d851e admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:16.992330 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601c28a-ce97-410a-9ca3-70f45ad30989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:16.993204 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601c28a-ce97-410a-9ca3-70f45ad30989 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:16.993483 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601c28a-ce97-410a-9ca3-70f45ad30989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:16.993757 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601c28a-ce97-410a-9ca3-70f45ad30989 admin admin] PATH_INFO: `/v3/projects/6c354a319e494b38a01dcec889a9b059/users/6283e86daed94b48b22df918bcae4cc3/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:17.008722 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601c28a-ce97-410a-9ca3-70f45ad30989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c354a319e494b38a01dcec889a9b059, user_id=6283e86daed94b48b22df918bcae4cc3, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:17.011915 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601c28a-ce97-410a-9ca3-70f45ad30989 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:17.024930 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1330/2628] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:40:16 2022] PUT /identity/v3/projects/6c354a319e494b38a01dcec889a9b059/users/6283e86daed94b48b22df918bcae4cc3/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:40:17.036697 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0205431-af24-4371-974d-b3bda3249f7e None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:17.036989 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0205431-af24-4371-974d-b3bda3249f7e None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:17.037276 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0205431-af24-4371-974d-b3bda3249f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:17.063876 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-d0205431-af24-4371-974d-b3bda3249f7e None None] MFA Rules not processed for user `6283e86daed94b48b22df918bcae4cc3`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:40:17.065079 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-d0205431-af24-4371-974d-b3bda3249f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:17.130281 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1299/2629] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:40:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:40:17.134807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601c28a-ce97-410a-9ca3-70f45ad30989 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:17.196705 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601c28a-ce97-410a-9ca3-70f45ad30989 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:17.202095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987564aa-303c-4aff-a983-1689ea78b1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:17.202782 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987564aa-303c-4aff-a983-1689ea78b1aa admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:17.203101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987564aa-303c-4aff-a983-1689ea78b1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:17.203376 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987564aa-303c-4aff-a983-1689ea78b1aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:17.204095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987564aa-303c-4aff-a983-1689ea78b1aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:17.205969 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987564aa-303c-4aff-a983-1689ea78b1aa admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:17.231258 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1331/2630] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:40:17 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:40:17.235202 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0205431-af24-4371-974d-b3bda3249f7e None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:17.247855 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0205431-af24-4371-974d-b3bda3249f7e None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:17.305465 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8db05b-bf2e-4134-81af-f9e51b8bf5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:17.306174 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8db05b-bf2e-4134-81af-f9e51b8bf5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:17.306447 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8db05b-bf2e-4134-81af-f9e51b8bf5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:17.306725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8db05b-bf2e-4134-81af-f9e51b8bf5b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:17.307449 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8db05b-bf2e-4134-81af-f9e51b8bf5b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:17.310044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8db05b-bf2e-4134-81af-f9e51b8bf5b9 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:17.329390 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1300/2631] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:40:17 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:40:17.333315 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987564aa-303c-4aff-a983-1689ea78b1aa admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:17.343775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987564aa-303c-4aff-a983-1689ea78b1aa admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:17.348341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072439fc-9a85-4825-a71e-c5394f076190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:17.349245 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072439fc-9a85-4825-a71e-c5394f076190 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:17.349532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072439fc-9a85-4825-a71e-c5394f076190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:17.349807 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072439fc-9a85-4825-a71e-c5394f076190 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:17.350541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072439fc-9a85-4825-a71e-c5394f076190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:17.352203 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072439fc-9a85-4825-a71e-c5394f076190 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:17.362561 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1332/2632] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:40:17.366852 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8db05b-bf2e-4134-81af-f9e51b8bf5b9 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:17.377238 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8db05b-bf2e-4134-81af-f9e51b8bf5b9 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:17.381769 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cefe9-a6ea-49f0-ae42-74452c8255dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:17.382624 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cefe9-a6ea-49f0-ae42-74452c8255dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:17.382940 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cefe9-a6ea-49f0-ae42-74452c8255dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:17.383214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cefe9-a6ea-49f0-ae42-74452c8255dc admin admin] PATH_INFO: `/v3/projects/5e622ae7610e46feb57f40058611c91b/users/3fa03270b215485faac0a850e3a04167/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:17.397585 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91cefe9-a6ea-49f0-ae42-74452c8255dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e622ae7610e46feb57f40058611c91b, user_id=3fa03270b215485faac0a850e3a04167, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:17.400267 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91cefe9-a6ea-49f0-ae42-74452c8255dc admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:17.413418 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1301/2633] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:40:17 2022] PUT /identity/v3/projects/5e622ae7610e46feb57f40058611c91b/users/3fa03270b215485faac0a850e3a04167/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:40:17.417321 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072439fc-9a85-4825-a71e-c5394f076190 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:17.427241 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072439fc-9a85-4825-a71e-c5394f076190 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:17.481822 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f9fef-313e-4f84-b2dd-3c27cf21c17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:17.482398 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f9fef-313e-4f84-b2dd-3c27cf21c17d admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:17.482682 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f9fef-313e-4f84-b2dd-3c27cf21c17d admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:17.482996 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f9fef-313e-4f84-b2dd-3c27cf21c17d admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:17.483716 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f9fef-313e-4f84-b2dd-3c27cf21c17d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:17.485314 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f9fef-313e-4f84-b2dd-3c27cf21c17d admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:17.494929 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1333/2634] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:40:17.500189 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cefe9-a6ea-49f0-ae42-74452c8255dc admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:17.510555 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cefe9-a6ea-49f0-ae42-74452c8255dc admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:17.515277 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8710d-69a3-4d36-bedd-93741fdd79ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:17.516171 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8710d-69a3-4d36-bedd-93741fdd79ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:17.516451 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8710d-69a3-4d36-bedd-93741fdd79ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:17.516724 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8710d-69a3-4d36-bedd-93741fdd79ef admin admin] PATH_INFO: `/v3/projects/5e622ae7610e46feb57f40058611c91b/users/3fa03270b215485faac0a850e3a04167/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:17.518661 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8710d-69a3-4d36-bedd-93741fdd79ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e622ae7610e46feb57f40058611c91b, user_id=3fa03270b215485faac0a850e3a04167, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:17.521363 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8710d-69a3-4d36-bedd-93741fdd79ef admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:17.532225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1302/2635] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:40:17 2022] PUT /identity/v3/projects/5e622ae7610e46feb57f40058611c91b/users/3fa03270b215485faac0a850e3a04167/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:40:17.543711 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852ea95-b4a3-4c41-aa75-43081e059d27 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:17.544331 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852ea95-b4a3-4c41-aa75-43081e059d27 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:17.544613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852ea95-b4a3-4c41-aa75-43081e059d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:17.572186 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-5852ea95-b4a3-4c41-aa75-43081e059d27 None None] MFA Rules not processed for user `3fa03270b215485faac0a850e3a04167`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:40:17.573381 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-5852ea95-b4a3-4c41-aa75-43081e059d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:17.646381 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1334/2636] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:40:17 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:40:17.658380 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8710d-69a3-4d36-bedd-93741fdd79ef admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:17.660930 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-f7b8710d-69a3-4d36-bedd-93741fdd79ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:17.724879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8710d-69a3-4d36-bedd-93741fdd79ef admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:17.728676 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca11538-aa2e-45e9-84b0-210a643db086 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:17.729323 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca11538-aa2e-45e9-84b0-210a643db086 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:17.729607 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca11538-aa2e-45e9-84b0-210a643db086 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:17.729884 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca11538-aa2e-45e9-84b0-210a643db086 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:17.739486 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca11538-aa2e-45e9-84b0-210a643db086 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:17.740862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca11538-aa2e-45e9-84b0-210a643db086 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:17.750760 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1303/2637] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:40:17 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:40:18.113064 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852ea95-b4a3-4c41-aa75-43081e059d27 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:18.173655 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852ea95-b4a3-4c41-aa75-43081e059d27 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:18.178401 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d2d56-0695-41ea-8fde-58ad509bf7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:18.179309 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d2d56-0695-41ea-8fde-58ad509bf7d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:18.179593 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d2d56-0695-41ea-8fde-58ad509bf7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:18.179867 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d2d56-0695-41ea-8fde-58ad509bf7d6 admin admin] PATH_INFO: `/v3/users/6283e86daed94b48b22df918bcae4cc3` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:18.181064 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d2d56-0695-41ea-8fde-58ad509bf7d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6283e86daed94b48b22df918bcae4cc3)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:18.183022 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d2d56-0695-41ea-8fde-58ad509bf7d6 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:18.236114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-668d2d56-0695-41ea-8fde-58ad509bf7d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6283e86daed94b48b22df918bcae4cc3'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:18.248210 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-668d2d56-0695-41ea-8fde-58ad509bf7d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6283e86daed94b48b22df918bcae4cc3'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:18.248884 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-668d2d56-0695-41ea-8fde-58ad509bf7d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6283e86daed94b48b22df918bcae4cc3'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:18.249489 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-668d2d56-0695-41ea-8fde-58ad509bf7d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6283e86daed94b48b22df918bcae4cc3'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:18.256403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-668d2d56-0695-41ea-8fde-58ad509bf7d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6283e86daed94b48b22df918bcae4cc3'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:18.269710 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1335/2638] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:40:18 2022] DELETE /identity/v3/users/6283e86daed94b48b22df918bcae4cc3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:40:18.274302 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69c797-6267-4fed-a547-4485202443d0 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:18.274811 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69c797-6267-4fed-a547-4485202443d0 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:18.274955 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69c797-6267-4fed-a547-4485202443d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:18.292102 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-7c69c797-6267-4fed-a547-4485202443d0 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:40:18.293313 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-7c69c797-6267-4fed-a547-4485202443d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:18.348737 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1304/2639] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:40:18.359570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d2d56-0695-41ea-8fde-58ad509bf7d6 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:18.361395 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-668d2d56-0695-41ea-8fde-58ad509bf7d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:18.419326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d2d56-0695-41ea-8fde-58ad509bf7d6 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:18.423042 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74682b4-a24f-4020-98fd-0968e6d3036a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:18.423688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74682b4-a24f-4020-98fd-0968e6d3036a service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:18.423969 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74682b4-a24f-4020-98fd-0968e6d3036a service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:18.424243 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74682b4-a24f-4020-98fd-0968e6d3036a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:18.434377 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74682b4-a24f-4020-98fd-0968e6d3036a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:18.436977 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74682b4-a24f-4020-98fd-0968e6d3036a service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:18.448122 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1336/2640] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:40:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:40:18.711312 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69c797-6267-4fed-a547-4485202443d0 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:18.712797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-7c69c797-6267-4fed-a547-4485202443d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:18.725326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69c797-6267-4fed-a547-4485202443d0 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:18.730591 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac19aa-8ce5-4a8c-b3c3-f2764bbff9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:18.731490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac19aa-8ce5-4a8c-b3c3-f2764bbff9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:18.731772 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac19aa-8ce5-4a8c-b3c3-f2764bbff9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:18.732044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac19aa-8ce5-4a8c-b3c3-f2764bbff9c5 admin admin] PATH_INFO: `/v3/projects/6c354a319e494b38a01dcec889a9b059` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:18.733225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac19aa-8ce5-4a8c-b3c3-f2764bbff9c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c354a319e494b38a01dcec889a9b059)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:18.735324 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac19aa-8ce5-4a8c-b3c3-f2764bbff9c5 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:18.783397 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e0ac19aa-8ce5-4a8c-b3c3-f2764bbff9c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c354a319e494b38a01dcec889a9b059', 'request_id': 'req-e0ac19aa-8ce5-4a8c-b3c3-f2764bbff9c5'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:18.789455 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e0ac19aa-8ce5-4a8c-b3c3-f2764bbff9c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c354a319e494b38a01dcec889a9b059', 'request_id': 'req-e0ac19aa-8ce5-4a8c-b3c3-f2764bbff9c5'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:18.795432 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e0ac19aa-8ce5-4a8c-b3c3-f2764bbff9c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c354a319e494b38a01dcec889a9b059', 'request_id': 'req-e0ac19aa-8ce5-4a8c-b3c3-f2764bbff9c5'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:18.807569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e0ac19aa-8ce5-4a8c-b3c3-f2764bbff9c5 admin admin] The token cache is being invalidate because project 6c354a319e494b38a01dcec889a9b059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:40:18.807857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e0ac19aa-8ce5-4a8c-b3c3-f2764bbff9c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:18.808638 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e0ac19aa-8ce5-4a8c-b3c3-f2764bbff9c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:18.810231 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1305/2641] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:40:18 2022] DELETE /identity/v3/projects/6c354a319e494b38a01dcec889a9b059 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:40:18.814221 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74682b4-a24f-4020-98fd-0968e6d3036a service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:18.823820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74682b4-a24f-4020-98fd-0968e6d3036a service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:18.877759 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585c7b2-f4d7-4322-9bca-0bd23b9799e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:18.878624 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585c7b2-f4d7-4322-9bca-0bd23b9799e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:18.878932 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585c7b2-f4d7-4322-9bca-0bd23b9799e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:18.879213 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585c7b2-f4d7-4322-9bca-0bd23b9799e5 admin admin] PATH_INFO: `/v3/users/3fa03270b215485faac0a850e3a04167` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:18.880405 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585c7b2-f4d7-4322-9bca-0bd23b9799e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fa03270b215485faac0a850e3a04167)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:18.882321 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585c7b2-f4d7-4322-9bca-0bd23b9799e5 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:18.927308 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-f585c7b2-f4d7-4322-9bca-0bd23b9799e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fa03270b215485faac0a850e3a04167'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:18.938311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-f585c7b2-f4d7-4322-9bca-0bd23b9799e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fa03270b215485faac0a850e3a04167'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:18.938993 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-f585c7b2-f4d7-4322-9bca-0bd23b9799e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fa03270b215485faac0a850e3a04167'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:18.939591 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-f585c7b2-f4d7-4322-9bca-0bd23b9799e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fa03270b215485faac0a850e3a04167'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:18.946101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-f585c7b2-f4d7-4322-9bca-0bd23b9799e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fa03270b215485faac0a850e3a04167'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:18.958558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1337/2642] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:40:18 2022] DELETE /identity/v3/users/3fa03270b215485faac0a850e3a04167 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:40:19.229630 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac19aa-8ce5-4a8c-b3c3-f2764bbff9c5 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:19.231172 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-e0ac19aa-8ce5-4a8c-b3c3-f2764bbff9c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:19.250182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac19aa-8ce5-4a8c-b3c3-f2764bbff9c5 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:19.307532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5212314-062f-497d-9400-3de7e9e9b504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:19.308382 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5212314-062f-497d-9400-3de7e9e9b504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:19.308663 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5212314-062f-497d-9400-3de7e9e9b504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:19.308962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5212314-062f-497d-9400-3de7e9e9b504 admin admin] PATH_INFO: `/v3/projects/5e622ae7610e46feb57f40058611c91b` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:19.310126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5212314-062f-497d-9400-3de7e9e9b504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e622ae7610e46feb57f40058611c91b)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:19.312165 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5212314-062f-497d-9400-3de7e9e9b504 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:19.359580 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d5212314-062f-497d-9400-3de7e9e9b504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e622ae7610e46feb57f40058611c91b', 'request_id': 'req-d5212314-062f-497d-9400-3de7e9e9b504'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:19.365615 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d5212314-062f-497d-9400-3de7e9e9b504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e622ae7610e46feb57f40058611c91b', 'request_id': 'req-d5212314-062f-497d-9400-3de7e9e9b504'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:19.371385 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d5212314-062f-497d-9400-3de7e9e9b504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e622ae7610e46feb57f40058611c91b', 'request_id': 'req-d5212314-062f-497d-9400-3de7e9e9b504'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:19.385028 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d5212314-062f-497d-9400-3de7e9e9b504 admin admin] The token cache is being invalidate because project 5e622ae7610e46feb57f40058611c91b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:40:19.385313 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d5212314-062f-497d-9400-3de7e9e9b504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:19.385960 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d5212314-062f-497d-9400-3de7e9e9b504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:19.388378 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1306/2643] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:40:19 2022] DELETE /identity/v3/projects/5e622ae7610e46feb57f40058611c91b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:40:19.393197 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d74768-4ee8-4e72-b420-fa2fbee0df1c None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:19.393479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d74768-4ee8-4e72-b420-fa2fbee0df1c None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:19.393752 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d74768-4ee8-4e72-b420-fa2fbee0df1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:19.411772 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-62d74768-4ee8-4e72-b420-fa2fbee0df1c None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:40:19.412984 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-62d74768-4ee8-4e72-b420-fa2fbee0df1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:19.471110 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1338/2644] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:40:19.480442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a97b9-5645-427b-a2e9-6bac4f575742 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:19.480731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a97b9-5645-427b-a2e9-6bac4f575742 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:19.481011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a97b9-5645-427b-a2e9-6bac4f575742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:19.498751 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-3d4a97b9-5645-427b-a2e9-6bac4f575742 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:40:19.499967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-3d4a97b9-5645-427b-a2e9-6bac4f575742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:19.507877 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1307/2645] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:40:19.512591 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d74768-4ee8-4e72-b420-fa2fbee0df1c None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:19.522180 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d74768-4ee8-4e72-b420-fa2fbee0df1c None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:19.526741 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370b97b-e0bf-4a8b-bb12-ea7c47dbb34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:19.528107 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370b97b-e0bf-4a8b-bb12-ea7c47dbb34a admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:19.528386 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370b97b-e0bf-4a8b-bb12-ea7c47dbb34a admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:19.528655 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370b97b-e0bf-4a8b-bb12-ea7c47dbb34a admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:19.529372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370b97b-e0bf-4a8b-bb12-ea7c47dbb34a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:40:19.529676 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370b97b-e0bf-4a8b-bb12-ea7c47dbb34a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:19.531306 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370b97b-e0bf-4a8b-bb12-ea7c47dbb34a admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:19.543013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1339/2646] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:40:19.546874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a97b9-5645-427b-a2e9-6bac4f575742 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:19.555860 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a97b9-5645-427b-a2e9-6bac4f575742 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:19.561102 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc1869-293c-4cd3-8bae-c670e7534212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:19.561685 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc1869-293c-4cd3-8bae-c670e7534212 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:19.561970 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc1869-293c-4cd3-8bae-c670e7534212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:19.562245 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc1869-293c-4cd3-8bae-c670e7534212 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:19.562965 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc1869-293c-4cd3-8bae-c670e7534212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:19.564857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc1869-293c-4cd3-8bae-c670e7534212 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:19.590293 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1308/2647] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:40:19 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:40:19.594166 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370b97b-e0bf-4a8b-bb12-ea7c47dbb34a admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:19.604304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370b97b-e0bf-4a8b-bb12-ea7c47dbb34a admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:19.660608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816662b-05b9-4118-8a74-1e28476d4094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:19.661422 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816662b-05b9-4118-8a74-1e28476d4094 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:19.661595 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816662b-05b9-4118-8a74-1e28476d4094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:19.661862 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816662b-05b9-4118-8a74-1e28476d4094 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:19.662541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816662b-05b9-4118-8a74-1e28476d4094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:19.664465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816662b-05b9-4118-8a74-1e28476d4094 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:19.689209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1340/2648] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:40:19 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:40:19.690642 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc1869-293c-4cd3-8bae-c670e7534212 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:19.701474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc1869-293c-4cd3-8bae-c670e7534212 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:19.706088 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3791b5-10e1-448e-a49a-c9eba6777c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:19.706738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3791b5-10e1-448e-a49a-c9eba6777c7d admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:19.707045 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3791b5-10e1-448e-a49a-c9eba6777c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:19.707321 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3791b5-10e1-448e-a49a-c9eba6777c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:19.708079 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3791b5-10e1-448e-a49a-c9eba6777c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:19.709671 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3791b5-10e1-448e-a49a-c9eba6777c7d admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:19.719864 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1309/2649] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:40:19.723655 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816662b-05b9-4118-8a74-1e28476d4094 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:19.733351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816662b-05b9-4118-8a74-1e28476d4094 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:19.738022 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67881b5b-270a-40f0-9529-158b0ff86ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:19.738670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67881b5b-270a-40f0-9529-158b0ff86ace admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:19.738990 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67881b5b-270a-40f0-9529-158b0ff86ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:19.739267 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67881b5b-270a-40f0-9529-158b0ff86ace admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:19.739981 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67881b5b-270a-40f0-9529-158b0ff86ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:19.741551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67881b5b-270a-40f0-9529-158b0ff86ace admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:19.751730 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1341/2650] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:40:19.755795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3791b5-10e1-448e-a49a-c9eba6777c7d admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:19.766410 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3791b5-10e1-448e-a49a-c9eba6777c7d admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:19.771092 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5750bc-aeb2-4043-89a8-91278339c538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:19.771956 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5750bc-aeb2-4043-89a8-91278339c538 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:19.772262 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5750bc-aeb2-4043-89a8-91278339c538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:19.772537 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5750bc-aeb2-4043-89a8-91278339c538 admin admin] PATH_INFO: `/v3/projects/cb17e977ebcd42ca83ccf5353a3b1487/users/daa3ab4f3d334a4a81b51309b3ebe16a/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:19.786877 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5750bc-aeb2-4043-89a8-91278339c538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb17e977ebcd42ca83ccf5353a3b1487, user_id=daa3ab4f3d334a4a81b51309b3ebe16a, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:19.789517 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5750bc-aeb2-4043-89a8-91278339c538 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:19.801902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1310/2651] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:40:19 2022] PUT /identity/v3/projects/cb17e977ebcd42ca83ccf5353a3b1487/users/daa3ab4f3d334a4a81b51309b3ebe16a/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:40:19.812562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bfde9-2459-4dc1-b10f-8277f659181c None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:19.812786 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bfde9-2459-4dc1-b10f-8277f659181c None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:19.813065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bfde9-2459-4dc1-b10f-8277f659181c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:19.839176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-863bfde9-2459-4dc1-b10f-8277f659181c None None] MFA Rules not processed for user `daa3ab4f3d334a4a81b51309b3ebe16a`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:40:19.840369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-863bfde9-2459-4dc1-b10f-8277f659181c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:19.905093 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1342/2652] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:40:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:40:19.909889 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5750bc-aeb2-4043-89a8-91278339c538 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:19.969966 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5750bc-aeb2-4043-89a8-91278339c538 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:19.974673 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26036cfa-b292-4130-833b-b484130a78df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:19.975359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26036cfa-b292-4130-833b-b484130a78df admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:19.975646 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26036cfa-b292-4130-833b-b484130a78df admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:19.975924 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26036cfa-b292-4130-833b-b484130a78df admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:19.976620 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26036cfa-b292-4130-833b-b484130a78df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:19.978532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26036cfa-b292-4130-833b-b484130a78df admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:20.003790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1311/2653] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:40:19 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:40:20.007886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bfde9-2459-4dc1-b10f-8277f659181c None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:20.018724 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bfde9-2459-4dc1-b10f-8277f659181c None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:20.073001 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19f343-643a-478e-8c39-c2ade4532799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:20.073599 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19f343-643a-478e-8c39-c2ade4532799 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:20.074387 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19f343-643a-478e-8c39-c2ade4532799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:20.074657 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19f343-643a-478e-8c39-c2ade4532799 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:20.075365 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19f343-643a-478e-8c39-c2ade4532799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:20.077267 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19f343-643a-478e-8c39-c2ade4532799 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:20.097234 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1343/2654] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:40:20 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:40:20.101444 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26036cfa-b292-4130-833b-b484130a78df admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:20.111710 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26036cfa-b292-4130-833b-b484130a78df admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:20.116272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328e62d-462e-4f4e-89c9-8df316ca1a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:20.116922 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328e62d-462e-4f4e-89c9-8df316ca1a98 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:20.117206 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328e62d-462e-4f4e-89c9-8df316ca1a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:20.117483 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328e62d-462e-4f4e-89c9-8df316ca1a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:20.118227 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328e62d-462e-4f4e-89c9-8df316ca1a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:20.119854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328e62d-462e-4f4e-89c9-8df316ca1a98 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:20.131477 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1312/2655] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:40:20.135595 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19f343-643a-478e-8c39-c2ade4532799 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:20.146876 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19f343-643a-478e-8c39-c2ade4532799 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:20.152634 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb517d-c269-40f1-ba8b-951838d91177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:20.153708 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb517d-c269-40f1-ba8b-951838d91177 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:20.153990 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb517d-c269-40f1-ba8b-951838d91177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:20.154278 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb517d-c269-40f1-ba8b-951838d91177 admin admin] PATH_INFO: `/v3/projects/d2284cb6a4f141d196a01aa034e30e09/users/e6b0312417744723958a7028d94bc1c3/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:20.169356 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb517d-c269-40f1-ba8b-951838d91177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2284cb6a4f141d196a01aa034e30e09, user_id=e6b0312417744723958a7028d94bc1c3, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:20.172039 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb517d-c269-40f1-ba8b-951838d91177 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:20.184924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1344/2656] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:40:20 2022] PUT /identity/v3/projects/d2284cb6a4f141d196a01aa034e30e09/users/e6b0312417744723958a7028d94bc1c3/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:40:20.188877 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328e62d-462e-4f4e-89c9-8df316ca1a98 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:20.199436 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328e62d-462e-4f4e-89c9-8df316ca1a98 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:20.255080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d05d6e-f67d-42aa-b861-cd1ccf5c1d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:20.255739 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d05d6e-f67d-42aa-b861-cd1ccf5c1d0f admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:20.256041 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d05d6e-f67d-42aa-b861-cd1ccf5c1d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:20.256274 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d05d6e-f67d-42aa-b861-cd1ccf5c1d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:20.257022 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d05d6e-f67d-42aa-b861-cd1ccf5c1d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:20.258609 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d05d6e-f67d-42aa-b861-cd1ccf5c1d0f admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:20.268442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1313/2657] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:40:20.272580 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb517d-c269-40f1-ba8b-951838d91177 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:20.283517 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb517d-c269-40f1-ba8b-951838d91177 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:20.288541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f308ba-a02c-4fa6-990a-577234bcc14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:20.289615 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f308ba-a02c-4fa6-990a-577234bcc14e admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:20.289887 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f308ba-a02c-4fa6-990a-577234bcc14e admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:20.290161 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f308ba-a02c-4fa6-990a-577234bcc14e admin admin] PATH_INFO: `/v3/projects/d2284cb6a4f141d196a01aa034e30e09/users/e6b0312417744723958a7028d94bc1c3/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:20.292177 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f308ba-a02c-4fa6-990a-577234bcc14e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2284cb6a4f141d196a01aa034e30e09, user_id=e6b0312417744723958a7028d94bc1c3, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:20.295447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f308ba-a02c-4fa6-990a-577234bcc14e admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:20.306164 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1345/2658] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:40:20 2022] PUT /identity/v3/projects/d2284cb6a4f141d196a01aa034e30e09/users/e6b0312417744723958a7028d94bc1c3/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:40:20.316609 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dffd78-b6d9-4265-ac0a-cf65252d7c98 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:20.317110 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dffd78-b6d9-4265-ac0a-cf65252d7c98 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:20.317231 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dffd78-b6d9-4265-ac0a-cf65252d7c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:20.348462 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-50dffd78-b6d9-4265-ac0a-cf65252d7c98 None None] MFA Rules not processed for user `e6b0312417744723958a7028d94bc1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:40:20.349609 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-50dffd78-b6d9-4265-ac0a-cf65252d7c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:20.415248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1314/2659] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:40:20 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:40:20.426570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f308ba-a02c-4fa6-990a-577234bcc14e admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:20.428520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a2f308ba-a02c-4fa6-990a-577234bcc14e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:20.486465 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f308ba-a02c-4fa6-990a-577234bcc14e admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:20.491064 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a7fc1-496d-478f-be0a-567b2b6ca8c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:20.491709 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a7fc1-496d-478f-be0a-567b2b6ca8c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:20.491987 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a7fc1-496d-478f-be0a-567b2b6ca8c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:20.492261 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a7fc1-496d-478f-be0a-567b2b6ca8c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:20.502159 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a7fc1-496d-478f-be0a-567b2b6ca8c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:20.503603 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a7fc1-496d-478f-be0a-567b2b6ca8c3 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:20.512825 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1346/2660] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:40:20 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:40:21.881115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dffd78-b6d9-4265-ac0a-cf65252d7c98 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:21.940695 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dffd78-b6d9-4265-ac0a-cf65252d7c98 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:21.945138 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc2dee-0b5d-47c5-8b88-1fbeb9c46766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:21.945994 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc2dee-0b5d-47c5-8b88-1fbeb9c46766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:21.946272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc2dee-0b5d-47c5-8b88-1fbeb9c46766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:21.946540 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc2dee-0b5d-47c5-8b88-1fbeb9c46766 admin admin] PATH_INFO: `/v3/users/daa3ab4f3d334a4a81b51309b3ebe16a` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:21.947732 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc2dee-0b5d-47c5-8b88-1fbeb9c46766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daa3ab4f3d334a4a81b51309b3ebe16a)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:21.950229 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc2dee-0b5d-47c5-8b88-1fbeb9c46766 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:21.992824 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6dbc2dee-0b5d-47c5-8b88-1fbeb9c46766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daa3ab4f3d334a4a81b51309b3ebe16a'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:22.000226 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6dbc2dee-0b5d-47c5-8b88-1fbeb9c46766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daa3ab4f3d334a4a81b51309b3ebe16a'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:22.012180 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6dbc2dee-0b5d-47c5-8b88-1fbeb9c46766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daa3ab4f3d334a4a81b51309b3ebe16a'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:22.012826 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6dbc2dee-0b5d-47c5-8b88-1fbeb9c46766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daa3ab4f3d334a4a81b51309b3ebe16a'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:22.019459 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6dbc2dee-0b5d-47c5-8b88-1fbeb9c46766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daa3ab4f3d334a4a81b51309b3ebe16a'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:22.025201 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1315/2661] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:40:21 2022] DELETE /identity/v3/users/daa3ab4f3d334a4a81b51309b3ebe16a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:40:22.030325 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d0f7a-dbb0-45ef-9dde-288c2c7886b8 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:22.030848 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d0f7a-dbb0-45ef-9dde-288c2c7886b8 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:22.031008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d0f7a-dbb0-45ef-9dde-288c2c7886b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:22.047940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-2e6d0f7a-dbb0-45ef-9dde-288c2c7886b8 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:40:22.049174 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-2e6d0f7a-dbb0-45ef-9dde-288c2c7886b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:22.110146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1347/2662] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:40:22.119779 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc2dee-0b5d-47c5-8b88-1fbeb9c46766 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:22.121217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6dbc2dee-0b5d-47c5-8b88-1fbeb9c46766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:22.178307 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc2dee-0b5d-47c5-8b88-1fbeb9c46766 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:22.182037 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c3262-5be7-4885-a531-49dfe4d9a2fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:22.182678 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c3262-5be7-4885-a531-49dfe4d9a2fb service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:22.182996 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c3262-5be7-4885-a531-49dfe4d9a2fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:22.183270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c3262-5be7-4885-a531-49dfe4d9a2fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:22.193226 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c3262-5be7-4885-a531-49dfe4d9a2fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:22.194674 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c3262-5be7-4885-a531-49dfe4d9a2fb service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:22.205665 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1316/2663] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:40:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:40:22.479850 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d0f7a-dbb0-45ef-9dde-288c2c7886b8 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:22.481251 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-2e6d0f7a-dbb0-45ef-9dde-288c2c7886b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:22.494103 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d0f7a-dbb0-45ef-9dde-288c2c7886b8 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:22.499199 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333025f-43a7-49cc-a0e0-5e054ecb6bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:22.500142 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333025f-43a7-49cc-a0e0-5e054ecb6bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:22.500407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333025f-43a7-49cc-a0e0-5e054ecb6bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:22.500661 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333025f-43a7-49cc-a0e0-5e054ecb6bc0 admin admin] PATH_INFO: `/v3/projects/cb17e977ebcd42ca83ccf5353a3b1487` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:22.501942 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333025f-43a7-49cc-a0e0-5e054ecb6bc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb17e977ebcd42ca83ccf5353a3b1487)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:22.503959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333025f-43a7-49cc-a0e0-5e054ecb6bc0 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:22.562511 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e333025f-43a7-49cc-a0e0-5e054ecb6bc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb17e977ebcd42ca83ccf5353a3b1487', 'request_id': 'req-e333025f-43a7-49cc-a0e0-5e054ecb6bc0'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:22.568659 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e333025f-43a7-49cc-a0e0-5e054ecb6bc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb17e977ebcd42ca83ccf5353a3b1487', 'request_id': 'req-e333025f-43a7-49cc-a0e0-5e054ecb6bc0'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:22.577587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e333025f-43a7-49cc-a0e0-5e054ecb6bc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb17e977ebcd42ca83ccf5353a3b1487', 'request_id': 'req-e333025f-43a7-49cc-a0e0-5e054ecb6bc0'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:22.587631 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e333025f-43a7-49cc-a0e0-5e054ecb6bc0 admin admin] The token cache is being invalidate because project cb17e977ebcd42ca83ccf5353a3b1487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:40:22.587934 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e333025f-43a7-49cc-a0e0-5e054ecb6bc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:22.588548 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e333025f-43a7-49cc-a0e0-5e054ecb6bc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:22.590104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1348/2664] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:40:22 2022] DELETE /identity/v3/projects/cb17e977ebcd42ca83ccf5353a3b1487 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:40:22.594115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c3262-5be7-4885-a531-49dfe4d9a2fb service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:22.603690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c3262-5be7-4885-a531-49dfe4d9a2fb service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:22.659959 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a9d4f-2bcf-4b79-a93e-ec810b13b57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:22.660723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a9d4f-2bcf-4b79-a93e-ec810b13b57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:22.661002 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a9d4f-2bcf-4b79-a93e-ec810b13b57d admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:22.661273 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a9d4f-2bcf-4b79-a93e-ec810b13b57d admin admin] PATH_INFO: `/v3/users/e6b0312417744723958a7028d94bc1c3` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:22.662447 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a9d4f-2bcf-4b79-a93e-ec810b13b57d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6b0312417744723958a7028d94bc1c3)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:22.664408 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a9d4f-2bcf-4b79-a93e-ec810b13b57d admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:22.709892 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e02a9d4f-2bcf-4b79-a93e-ec810b13b57d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6b0312417744723958a7028d94bc1c3'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:22.717245 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e02a9d4f-2bcf-4b79-a93e-ec810b13b57d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6b0312417744723958a7028d94bc1c3'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:22.729122 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e02a9d4f-2bcf-4b79-a93e-ec810b13b57d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6b0312417744723958a7028d94bc1c3'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:22.729840 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e02a9d4f-2bcf-4b79-a93e-ec810b13b57d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6b0312417744723958a7028d94bc1c3'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:22.737521 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e02a9d4f-2bcf-4b79-a93e-ec810b13b57d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6b0312417744723958a7028d94bc1c3'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:22.744031 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1317/2665] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:40:22 2022] DELETE /identity/v3/users/e6b0312417744723958a7028d94bc1c3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:40:23.012944 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333025f-43a7-49cc-a0e0-5e054ecb6bc0 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:23.014411 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e333025f-43a7-49cc-a0e0-5e054ecb6bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:23.026979 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333025f-43a7-49cc-a0e0-5e054ecb6bc0 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:23.083515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331709a-e006-411b-a814-b245b3d080d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:23.084370 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331709a-e006-411b-a814-b245b3d080d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:23.084645 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331709a-e006-411b-a814-b245b3d080d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:23.084914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331709a-e006-411b-a814-b245b3d080d1 admin admin] PATH_INFO: `/v3/projects/d2284cb6a4f141d196a01aa034e30e09` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:23.086075 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331709a-e006-411b-a814-b245b3d080d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2284cb6a4f141d196a01aa034e30e09)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:23.087996 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331709a-e006-411b-a814-b245b3d080d1 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:23.131834 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e331709a-e006-411b-a814-b245b3d080d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2284cb6a4f141d196a01aa034e30e09', 'request_id': 'req-e331709a-e006-411b-a814-b245b3d080d1'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:23.137653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e331709a-e006-411b-a814-b245b3d080d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2284cb6a4f141d196a01aa034e30e09', 'request_id': 'req-e331709a-e006-411b-a814-b245b3d080d1'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:23.144892 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e331709a-e006-411b-a814-b245b3d080d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2284cb6a4f141d196a01aa034e30e09', 'request_id': 'req-e331709a-e006-411b-a814-b245b3d080d1'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:23.155224 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e331709a-e006-411b-a814-b245b3d080d1 admin admin] The token cache is being invalidate because project d2284cb6a4f141d196a01aa034e30e09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:40:23.155503 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e331709a-e006-411b-a814-b245b3d080d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:23.156118 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e331709a-e006-411b-a814-b245b3d080d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:23.157992 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1349/2666] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:40:23 2022] DELETE /identity/v3/projects/d2284cb6a4f141d196a01aa034e30e09 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:40:23.163545 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b113201-b326-47fc-a1cf-942fd524def6 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:23.164026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b113201-b326-47fc-a1cf-942fd524def6 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:23.164131 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b113201-b326-47fc-a1cf-942fd524def6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:23.182599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-6b113201-b326-47fc-a1cf-942fd524def6 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:40:23.184410 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6b113201-b326-47fc-a1cf-942fd524def6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:23.241710 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1318/2667] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:40:23.298394 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e2d7d-3932-4ba6-a00b-2cfc0eb57f15 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:23.298669 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e2d7d-3932-4ba6-a00b-2cfc0eb57f15 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:23.298927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e2d7d-3932-4ba6-a00b-2cfc0eb57f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:23.317200 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-5e7e2d7d-3932-4ba6-a00b-2cfc0eb57f15 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:40:23.318383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-5e7e2d7d-3932-4ba6-a00b-2cfc0eb57f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:23.326237 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1350/2668] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:40:23.330559 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b113201-b326-47fc-a1cf-942fd524def6 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:23.340675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b113201-b326-47fc-a1cf-942fd524def6 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:23.345343 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51caa70-165d-4912-b6de-ae039710e26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:23.345990 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51caa70-165d-4912-b6de-ae039710e26e admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:23.346277 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51caa70-165d-4912-b6de-ae039710e26e admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:23.346546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51caa70-165d-4912-b6de-ae039710e26e admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:23.347309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51caa70-165d-4912-b6de-ae039710e26e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:40:23.347616 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51caa70-165d-4912-b6de-ae039710e26e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:23.349205 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51caa70-165d-4912-b6de-ae039710e26e admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:23.360974 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1319/2669] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:40:23.365117 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e2d7d-3932-4ba6-a00b-2cfc0eb57f15 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:23.374706 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e2d7d-3932-4ba6-a00b-2cfc0eb57f15 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:23.379398 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411b9cf-8f29-465d-b622-b3441217d4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:23.380052 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411b9cf-8f29-465d-b622-b3441217d4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:23.380327 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411b9cf-8f29-465d-b622-b3441217d4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:23.380615 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411b9cf-8f29-465d-b622-b3441217d4a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:23.381275 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411b9cf-8f29-465d-b622-b3441217d4a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:23.383176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411b9cf-8f29-465d-b622-b3441217d4a3 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:23.408131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1351/2670] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:40:23 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:40:23.412283 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51caa70-165d-4912-b6de-ae039710e26e admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:23.422716 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51caa70-165d-4912-b6de-ae039710e26e admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:23.479676 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3af20-ba53-4504-baf2-4a77d812f028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:23.480952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3af20-ba53-4504-baf2-4a77d812f028 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:23.481200 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3af20-ba53-4504-baf2-4a77d812f028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:23.481476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3af20-ba53-4504-baf2-4a77d812f028 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:23.482157 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3af20-ba53-4504-baf2-4a77d812f028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:23.484109 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3af20-ba53-4504-baf2-4a77d812f028 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:23.503067 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1320/2671] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:40:23 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:40:23.507176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411b9cf-8f29-465d-b622-b3441217d4a3 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:23.517263 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411b9cf-8f29-465d-b622-b3441217d4a3 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:23.521868 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e55ee-3ec0-4a40-b7a1-c96f45f784df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:23.522523 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e55ee-3ec0-4a40-b7a1-c96f45f784df admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:23.522806 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e55ee-3ec0-4a40-b7a1-c96f45f784df admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:23.523109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e55ee-3ec0-4a40-b7a1-c96f45f784df admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:23.523825 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e55ee-3ec0-4a40-b7a1-c96f45f784df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:23.525414 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e55ee-3ec0-4a40-b7a1-c96f45f784df admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:23.536370 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1352/2672] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:40:23.540194 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3af20-ba53-4504-baf2-4a77d812f028 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:23.550707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3af20-ba53-4504-baf2-4a77d812f028 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:23.555347 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac57f90-2282-4cce-9855-75db30a9c2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:23.556005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac57f90-2282-4cce-9855-75db30a9c2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:23.556290 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac57f90-2282-4cce-9855-75db30a9c2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:23.556571 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac57f90-2282-4cce-9855-75db30a9c2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:23.557288 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac57f90-2282-4cce-9855-75db30a9c2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:23.558938 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac57f90-2282-4cce-9855-75db30a9c2e6 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:23.570577 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1321/2673] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:40:23.574681 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e55ee-3ec0-4a40-b7a1-c96f45f784df admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:23.584658 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e55ee-3ec0-4a40-b7a1-c96f45f784df admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:23.589711 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe36818-02c0-4072-82d9-b3b2e57a7f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:23.590573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe36818-02c0-4072-82d9-b3b2e57a7f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:23.590875 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe36818-02c0-4072-82d9-b3b2e57a7f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:23.591148 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe36818-02c0-4072-82d9-b3b2e57a7f90 admin admin] PATH_INFO: `/v3/projects/37cbccdf64d44470a5b22f5c1056e166/users/60d408eb81d64d4dac86d2ea92a92879/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:23.605512 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe36818-02c0-4072-82d9-b3b2e57a7f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37cbccdf64d44470a5b22f5c1056e166, user_id=60d408eb81d64d4dac86d2ea92a92879, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:23.608176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe36818-02c0-4072-82d9-b3b2e57a7f90 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:23.622013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1353/2674] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:40:23 2022] PUT /identity/v3/projects/37cbccdf64d44470a5b22f5c1056e166/users/60d408eb81d64d4dac86d2ea92a92879/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:40:23.632221 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b690e35-7f31-4737-8290-e68ee8c5ca47 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:23.632510 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b690e35-7f31-4737-8290-e68ee8c5ca47 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:23.632839 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b690e35-7f31-4737-8290-e68ee8c5ca47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:23.659663 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-0b690e35-7f31-4737-8290-e68ee8c5ca47 None None] MFA Rules not processed for user `60d408eb81d64d4dac86d2ea92a92879`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:40:23.660870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-0b690e35-7f31-4737-8290-e68ee8c5ca47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:23.722216 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1322/2675] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:40:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:40:23.726633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe36818-02c0-4072-82d9-b3b2e57a7f90 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:23.785893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe36818-02c0-4072-82d9-b3b2e57a7f90 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:23.790518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6d328-6db8-49f5-9c72-1d3e14077787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:23.791293 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6d328-6db8-49f5-9c72-1d3e14077787 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:23.791486 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6d328-6db8-49f5-9c72-1d3e14077787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:23.791767 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6d328-6db8-49f5-9c72-1d3e14077787 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:23.792999 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6d328-6db8-49f5-9c72-1d3e14077787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:23.794919 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6d328-6db8-49f5-9c72-1d3e14077787 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:23.820169 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1354/2676] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:40:23 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:40:23.824195 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b690e35-7f31-4737-8290-e68ee8c5ca47 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:23.835141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b690e35-7f31-4737-8290-e68ee8c5ca47 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:23.891201 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c18152-1e3b-4f66-adbc-ee4f87f071a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:23.891872 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c18152-1e3b-4f66-adbc-ee4f87f071a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:23.892153 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c18152-1e3b-4f66-adbc-ee4f87f071a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:23.892423 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c18152-1e3b-4f66-adbc-ee4f87f071a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:23.893115 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c18152-1e3b-4f66-adbc-ee4f87f071a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:23.895062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c18152-1e3b-4f66-adbc-ee4f87f071a5 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:23.916502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1323/2677] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:40:23 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:40:23.920687 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6d328-6db8-49f5-9c72-1d3e14077787 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:23.931308 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6d328-6db8-49f5-9c72-1d3e14077787 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:23.936668 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504677a-44c1-4cf2-8581-62a19073efe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:23.937334 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504677a-44c1-4cf2-8581-62a19073efe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:23.937615 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504677a-44c1-4cf2-8581-62a19073efe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:23.937888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504677a-44c1-4cf2-8581-62a19073efe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:23.938610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504677a-44c1-4cf2-8581-62a19073efe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:23.940249 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504677a-44c1-4cf2-8581-62a19073efe8 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:23.950735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1355/2678] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:40:23.954947 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c18152-1e3b-4f66-adbc-ee4f87f071a5 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:23.965233 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c18152-1e3b-4f66-adbc-ee4f87f071a5 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:23.969800 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8d75a-028a-4fb2-a02a-2a0b34faa4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:23.970659 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8d75a-028a-4fb2-a02a-2a0b34faa4d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:23.970969 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8d75a-028a-4fb2-a02a-2a0b34faa4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:23.971245 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8d75a-028a-4fb2-a02a-2a0b34faa4d6 admin admin] PATH_INFO: `/v3/projects/192e32afec6e4a9e8a0e1df530faa3f3/users/f9f88a7f24fe4e568aa9519547f88673/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:23.985907 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8d75a-028a-4fb2-a02a-2a0b34faa4d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=192e32afec6e4a9e8a0e1df530faa3f3, user_id=f9f88a7f24fe4e568aa9519547f88673, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:23.988498 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8d75a-028a-4fb2-a02a-2a0b34faa4d6 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:24.001325 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1324/2679] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:40:23 2022] PUT /identity/v3/projects/192e32afec6e4a9e8a0e1df530faa3f3/users/f9f88a7f24fe4e568aa9519547f88673/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:40:24.005403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504677a-44c1-4cf2-8581-62a19073efe8 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:24.015296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504677a-44c1-4cf2-8581-62a19073efe8 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:24.069210 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43609f9-9f92-49be-9f99-845603b4728a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:24.069882 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43609f9-9f92-49be-9f99-845603b4728a admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:24.070164 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43609f9-9f92-49be-9f99-845603b4728a admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:24.070439 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43609f9-9f92-49be-9f99-845603b4728a admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:24.071210 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43609f9-9f92-49be-9f99-845603b4728a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:24.072802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43609f9-9f92-49be-9f99-845603b4728a admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:24.082697 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1356/2680] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:40:24.086745 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8d75a-028a-4fb2-a02a-2a0b34faa4d6 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:24.097296 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8d75a-028a-4fb2-a02a-2a0b34faa4d6 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:24.101878 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ff72e-100b-45d2-8efb-88e046f306c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:24.102746 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ff72e-100b-45d2-8efb-88e046f306c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:24.103059 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ff72e-100b-45d2-8efb-88e046f306c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:24.103336 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ff72e-100b-45d2-8efb-88e046f306c6 admin admin] PATH_INFO: `/v3/projects/192e32afec6e4a9e8a0e1df530faa3f3/users/f9f88a7f24fe4e568aa9519547f88673/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:24.105860 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ff72e-100b-45d2-8efb-88e046f306c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=192e32afec6e4a9e8a0e1df530faa3f3, user_id=f9f88a7f24fe4e568aa9519547f88673, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:24.108535 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ff72e-100b-45d2-8efb-88e046f306c6 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:24.119272 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1325/2681] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:40:24 2022] PUT /identity/v3/projects/192e32afec6e4a9e8a0e1df530faa3f3/users/f9f88a7f24fe4e568aa9519547f88673/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:40:24.129276 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f7620-cbb1-42b7-a588-31bd6e05baef None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:24.129798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f7620-cbb1-42b7-a588-31bd6e05baef None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:24.129932 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f7620-cbb1-42b7-a588-31bd6e05baef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:24.156131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-906f7620-cbb1-42b7-a588-31bd6e05baef None None] MFA Rules not processed for user `f9f88a7f24fe4e568aa9519547f88673`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:40:24.157606 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-906f7620-cbb1-42b7-a588-31bd6e05baef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:24.223814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1357/2682] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:40:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:40:24.235981 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ff72e-100b-45d2-8efb-88e046f306c6 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:24.237661 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-000ff72e-100b-45d2-8efb-88e046f306c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:24.293335 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ff72e-100b-45d2-8efb-88e046f306c6 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:24.296953 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ad83f-bcb7-483e-9559-ac0cb263d08e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:24.297590 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ad83f-bcb7-483e-9559-ac0cb263d08e service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:24.297872 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ad83f-bcb7-483e-9559-ac0cb263d08e service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:24.298142 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ad83f-bcb7-483e-9559-ac0cb263d08e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:24.306958 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ad83f-bcb7-483e-9559-ac0cb263d08e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:24.308427 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ad83f-bcb7-483e-9559-ac0cb263d08e service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:24.317797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1326/2683] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:40:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:40:24.394804 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f7620-cbb1-42b7-a588-31bd6e05baef None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:24.457600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f7620-cbb1-42b7-a588-31bd6e05baef None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:24.462144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdb0cd-df73-45c4-b69f-da61f043f893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:24.463049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdb0cd-df73-45c4-b69f-da61f043f893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:24.463365 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdb0cd-df73-45c4-b69f-da61f043f893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:24.463582 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdb0cd-df73-45c4-b69f-da61f043f893 admin admin] PATH_INFO: `/v3/users/60d408eb81d64d4dac86d2ea92a92879` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:24.465165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdb0cd-df73-45c4-b69f-da61f043f893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d408eb81d64d4dac86d2ea92a92879)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:24.467201 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdb0cd-df73-45c4-b69f-da61f043f893 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:24.518525 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-a3cdb0cd-df73-45c4-b69f-da61f043f893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d408eb81d64d4dac86d2ea92a92879'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:24.531337 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-a3cdb0cd-df73-45c4-b69f-da61f043f893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d408eb81d64d4dac86d2ea92a92879'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:24.532507 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-a3cdb0cd-df73-45c4-b69f-da61f043f893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d408eb81d64d4dac86d2ea92a92879'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:24.533346 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-a3cdb0cd-df73-45c4-b69f-da61f043f893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d408eb81d64d4dac86d2ea92a92879'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:24.539891 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-a3cdb0cd-df73-45c4-b69f-da61f043f893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d408eb81d64d4dac86d2ea92a92879'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:24.552561 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1358/2684] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:40:24 2022] DELETE /identity/v3/users/60d408eb81d64d4dac86d2ea92a92879 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:40:24.557211 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3948bf-9ec2-454e-b0af-14d63fbd63ad None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:24.557503 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3948bf-9ec2-454e-b0af-14d63fbd63ad None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:24.557792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3948bf-9ec2-454e-b0af-14d63fbd63ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:24.575603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-db3948bf-9ec2-454e-b0af-14d63fbd63ad None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:40:24.576787 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-db3948bf-9ec2-454e-b0af-14d63fbd63ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:24.633371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1327/2685] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:40:24.643501 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdb0cd-df73-45c4-b69f-da61f043f893 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:24.644959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a3cdb0cd-df73-45c4-b69f-da61f043f893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:24.700298 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdb0cd-df73-45c4-b69f-da61f043f893 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:24.703953 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03d5b7-fb79-4415-a0a2-176d9aa94995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:24.704599 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03d5b7-fb79-4415-a0a2-176d9aa94995 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:24.704878 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03d5b7-fb79-4415-a0a2-176d9aa94995 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:24.705150 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03d5b7-fb79-4415-a0a2-176d9aa94995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:24.714001 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03d5b7-fb79-4415-a0a2-176d9aa94995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:24.716058 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03d5b7-fb79-4415-a0a2-176d9aa94995 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:24.725336 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1359/2686] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:40:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:40:24.987828 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3948bf-9ec2-454e-b0af-14d63fbd63ad None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:24.989337 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-db3948bf-9ec2-454e-b0af-14d63fbd63ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:25.003305 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3948bf-9ec2-454e-b0af-14d63fbd63ad None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:25.008495 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543d32f-d2af-43a7-b83f-11bd3e82bec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:25.009625 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543d32f-d2af-43a7-b83f-11bd3e82bec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:25.009959 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543d32f-d2af-43a7-b83f-11bd3e82bec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:25.010172 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543d32f-d2af-43a7-b83f-11bd3e82bec6 admin admin] PATH_INFO: `/v3/projects/37cbccdf64d44470a5b22f5c1056e166` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:25.011982 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543d32f-d2af-43a7-b83f-11bd3e82bec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37cbccdf64d44470a5b22f5c1056e166)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:25.013930 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543d32f-d2af-43a7-b83f-11bd3e82bec6 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:25.059560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e543d32f-d2af-43a7-b83f-11bd3e82bec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37cbccdf64d44470a5b22f5c1056e166', 'request_id': 'req-e543d32f-d2af-43a7-b83f-11bd3e82bec6'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:25.065434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e543d32f-d2af-43a7-b83f-11bd3e82bec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37cbccdf64d44470a5b22f5c1056e166', 'request_id': 'req-e543d32f-d2af-43a7-b83f-11bd3e82bec6'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:25.070720 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e543d32f-d2af-43a7-b83f-11bd3e82bec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37cbccdf64d44470a5b22f5c1056e166', 'request_id': 'req-e543d32f-d2af-43a7-b83f-11bd3e82bec6'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:25.083493 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e543d32f-d2af-43a7-b83f-11bd3e82bec6 admin admin] The token cache is being invalidate because project 37cbccdf64d44470a5b22f5c1056e166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:40:25.083780 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e543d32f-d2af-43a7-b83f-11bd3e82bec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:25.084392 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-e543d32f-d2af-43a7-b83f-11bd3e82bec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:25.085925 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1328/2687] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:40:24 2022] DELETE /identity/v3/projects/37cbccdf64d44470a5b22f5c1056e166 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:40:25.089892 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03d5b7-fb79-4415-a0a2-176d9aa94995 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:25.099319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03d5b7-fb79-4415-a0a2-176d9aa94995 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:25.156254 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241988c-de50-4ab8-b7cb-ee0cbb9f45b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:25.157390 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241988c-de50-4ab8-b7cb-ee0cbb9f45b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:25.157729 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241988c-de50-4ab8-b7cb-ee0cbb9f45b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:25.157946 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241988c-de50-4ab8-b7cb-ee0cbb9f45b5 admin admin] PATH_INFO: `/v3/users/f9f88a7f24fe4e568aa9519547f88673` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:25.159174 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241988c-de50-4ab8-b7cb-ee0cbb9f45b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9f88a7f24fe4e568aa9519547f88673)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:25.161092 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241988c-de50-4ab8-b7cb-ee0cbb9f45b5 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:25.205801 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7241988c-de50-4ab8-b7cb-ee0cbb9f45b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9f88a7f24fe4e568aa9519547f88673'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:25.217186 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7241988c-de50-4ab8-b7cb-ee0cbb9f45b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9f88a7f24fe4e568aa9519547f88673'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:25.217863 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7241988c-de50-4ab8-b7cb-ee0cbb9f45b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9f88a7f24fe4e568aa9519547f88673'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:25.218473 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7241988c-de50-4ab8-b7cb-ee0cbb9f45b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9f88a7f24fe4e568aa9519547f88673'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:25.225013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7241988c-de50-4ab8-b7cb-ee0cbb9f45b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9f88a7f24fe4e568aa9519547f88673'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:25.238492 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1360/2688] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:40:25 2022] DELETE /identity/v3/users/f9f88a7f24fe4e568aa9519547f88673 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:40:25.498314 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543d32f-d2af-43a7-b83f-11bd3e82bec6 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:25.499836 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-e543d32f-d2af-43a7-b83f-11bd3e82bec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:25.514029 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543d32f-d2af-43a7-b83f-11bd3e82bec6 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:25.572816 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589af2ba-e527-4a4f-8a8a-2894c5995ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:25.574345 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589af2ba-e527-4a4f-8a8a-2894c5995ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:25.574661 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589af2ba-e527-4a4f-8a8a-2894c5995ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:25.574996 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589af2ba-e527-4a4f-8a8a-2894c5995ab6 admin admin] PATH_INFO: `/v3/projects/192e32afec6e4a9e8a0e1df530faa3f3` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:25.577104 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589af2ba-e527-4a4f-8a8a-2894c5995ab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=192e32afec6e4a9e8a0e1df530faa3f3)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:25.579368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589af2ba-e527-4a4f-8a8a-2894c5995ab6 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:25.624569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-589af2ba-e527-4a4f-8a8a-2894c5995ab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '192e32afec6e4a9e8a0e1df530faa3f3', 'request_id': 'req-589af2ba-e527-4a4f-8a8a-2894c5995ab6'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:25.631981 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-589af2ba-e527-4a4f-8a8a-2894c5995ab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '192e32afec6e4a9e8a0e1df530faa3f3', 'request_id': 'req-589af2ba-e527-4a4f-8a8a-2894c5995ab6'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:25.637775 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-589af2ba-e527-4a4f-8a8a-2894c5995ab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '192e32afec6e4a9e8a0e1df530faa3f3', 'request_id': 'req-589af2ba-e527-4a4f-8a8a-2894c5995ab6'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:25.649705 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-589af2ba-e527-4a4f-8a8a-2894c5995ab6 admin admin] The token cache is being invalidate because project 192e32afec6e4a9e8a0e1df530faa3f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:40:25.649984 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-589af2ba-e527-4a4f-8a8a-2894c5995ab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:25.650591 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-589af2ba-e527-4a4f-8a8a-2894c5995ab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:40:25.652152 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1329/2689] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:40:25 2022] DELETE /identity/v3/projects/192e32afec6e4a9e8a0e1df530faa3f3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:40:25.657320 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738072ac-227e-402e-8cc8-c4efeb3953f8 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:25.657610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738072ac-227e-402e-8cc8-c4efeb3953f8 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:25.657889 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738072ac-227e-402e-8cc8-c4efeb3953f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:25.675103 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-738072ac-227e-402e-8cc8-c4efeb3953f8 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:40:25.676339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-738072ac-227e-402e-8cc8-c4efeb3953f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:25.732827 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1361/2690] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:40:25.741649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27b713-e1be-459f-953a-5f5d715c66bd None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:25.741940 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27b713-e1be-459f-953a-5f5d715c66bd None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:25.742215 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27b713-e1be-459f-953a-5f5d715c66bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:25.760768 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-5e27b713-e1be-459f-953a-5f5d715c66bd None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:40:25.763300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-5e27b713-e1be-459f-953a-5f5d715c66bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:25.770712 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1330/2691] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:40:25.774973 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738072ac-227e-402e-8cc8-c4efeb3953f8 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:25.784827 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738072ac-227e-402e-8cc8-c4efeb3953f8 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:25.789312 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92090d58-f4cf-463e-8ab5-5d455437048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:25.789954 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92090d58-f4cf-463e-8ab5-5d455437048b admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:25.790232 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92090d58-f4cf-463e-8ab5-5d455437048b admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:25.790499 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92090d58-f4cf-463e-8ab5-5d455437048b admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:25.791244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92090d58-f4cf-463e-8ab5-5d455437048b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:40:25.791548 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92090d58-f4cf-463e-8ab5-5d455437048b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:25.793113 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92090d58-f4cf-463e-8ab5-5d455437048b admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:25.804414 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1362/2692] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:40:25.809164 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27b713-e1be-459f-953a-5f5d715c66bd None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:25.818970 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27b713-e1be-459f-953a-5f5d715c66bd None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:25.824236 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274b699-8b67-4919-96c2-bb72fdd8e8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:25.824890 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274b699-8b67-4919-96c2-bb72fdd8e8f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:25.825171 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274b699-8b67-4919-96c2-bb72fdd8e8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:25.825443 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274b699-8b67-4919-96c2-bb72fdd8e8f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:25.826260 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274b699-8b67-4919-96c2-bb72fdd8e8f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:25.828269 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274b699-8b67-4919-96c2-bb72fdd8e8f7 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:25.852691 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1331/2693] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:40:25 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:40:25.856886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92090d58-f4cf-463e-8ab5-5d455437048b admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:25.866606 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92090d58-f4cf-463e-8ab5-5d455437048b admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:25.924172 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925f8a0-4130-4e83-a3f7-4932df6911d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:25.924863 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925f8a0-4130-4e83-a3f7-4932df6911d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:25.925144 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925f8a0-4130-4e83-a3f7-4932df6911d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:25.925418 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925f8a0-4130-4e83-a3f7-4932df6911d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:25.926099 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925f8a0-4130-4e83-a3f7-4932df6911d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:25.928015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925f8a0-4130-4e83-a3f7-4932df6911d2 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:25.948063 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1363/2694] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:40:25 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:40:25.952246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274b699-8b67-4919-96c2-bb72fdd8e8f7 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:25.962494 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274b699-8b67-4919-96c2-bb72fdd8e8f7 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:25.967104 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6bc4e-2e35-4cd0-af01-102396a7a154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:25.967752 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6bc4e-2e35-4cd0-af01-102396a7a154 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:25.968034 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6bc4e-2e35-4cd0-af01-102396a7a154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:25.968308 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6bc4e-2e35-4cd0-af01-102396a7a154 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:25.969024 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6bc4e-2e35-4cd0-af01-102396a7a154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:25.970605 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6bc4e-2e35-4cd0-af01-102396a7a154 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:25.982513 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1332/2695] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:40:25.986278 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925f8a0-4130-4e83-a3f7-4932df6911d2 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:25.996774 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925f8a0-4130-4e83-a3f7-4932df6911d2 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:26.001438 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a90e19-b81e-4524-aeed-6297c135daec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:26.002234 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a90e19-b81e-4524-aeed-6297c135daec admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:26.002617 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a90e19-b81e-4524-aeed-6297c135daec admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:26.002962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a90e19-b81e-4524-aeed-6297c135daec admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:26.003696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a90e19-b81e-4524-aeed-6297c135daec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:26.005315 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a90e19-b81e-4524-aeed-6297c135daec admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:26.015808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1364/2696] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:40:26.019805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6bc4e-2e35-4cd0-af01-102396a7a154 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:26.029929 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6bc4e-2e35-4cd0-af01-102396a7a154 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:26.034788 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d083e88-9508-46ad-9ca1-7535e0901e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:26.035726 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d083e88-9508-46ad-9ca1-7535e0901e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:26.035996 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d083e88-9508-46ad-9ca1-7535e0901e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:26.036264 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d083e88-9508-46ad-9ca1-7535e0901e02 admin admin] PATH_INFO: `/v3/projects/dc042f7da78d48b1b6c23202c937833a/users/733e624a096e48ecbcc77e509cf065f8/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:26.051005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d083e88-9508-46ad-9ca1-7535e0901e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc042f7da78d48b1b6c23202c937833a, user_id=733e624a096e48ecbcc77e509cf065f8, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:26.053640 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d083e88-9508-46ad-9ca1-7535e0901e02 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:26.066870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1333/2697] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:40:26 2022] PUT /identity/v3/projects/dc042f7da78d48b1b6c23202c937833a/users/733e624a096e48ecbcc77e509cf065f8/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:40:26.077553 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617ec83-a62c-4ba2-83ec-085232fc1df8 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:26.077847 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617ec83-a62c-4ba2-83ec-085232fc1df8 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:26.078128 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617ec83-a62c-4ba2-83ec-085232fc1df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:26.104050 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-0617ec83-a62c-4ba2-83ec-085232fc1df8 None None] MFA Rules not processed for user `733e624a096e48ecbcc77e509cf065f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:40:26.105382 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-0617ec83-a62c-4ba2-83ec-085232fc1df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:26.165903 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1365/2698] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:40:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:40:26.171710 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d083e88-9508-46ad-9ca1-7535e0901e02 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:26.233724 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d083e88-9508-46ad-9ca1-7535e0901e02 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:26.238313 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee753137-ceca-459c-8d68-31bf8f90d6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:26.238995 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee753137-ceca-459c-8d68-31bf8f90d6f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:26.239280 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee753137-ceca-459c-8d68-31bf8f90d6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:26.239552 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee753137-ceca-459c-8d68-31bf8f90d6f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:26.240238 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee753137-ceca-459c-8d68-31bf8f90d6f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:26.242121 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee753137-ceca-459c-8d68-31bf8f90d6f4 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:26.267447 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1334/2699] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:40:26 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:40:26.271437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617ec83-a62c-4ba2-83ec-085232fc1df8 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:26.282758 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617ec83-a62c-4ba2-83ec-085232fc1df8 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:26.335802 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cd3f3-cbf8-4e8e-8399-cd9c182b5b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:26.336472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cd3f3-cbf8-4e8e-8399-cd9c182b5b01 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:26.336757 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cd3f3-cbf8-4e8e-8399-cd9c182b5b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:26.337064 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cd3f3-cbf8-4e8e-8399-cd9c182b5b01 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:26.337762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2cd3f3-cbf8-4e8e-8399-cd9c182b5b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:26.340239 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2cd3f3-cbf8-4e8e-8399-cd9c182b5b01 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:26.360258 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1366/2700] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:40:26 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:40:26.364401 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee753137-ceca-459c-8d68-31bf8f90d6f4 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:26.374525 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee753137-ceca-459c-8d68-31bf8f90d6f4 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:26.379095 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4e59e-21fb-4df3-8fc5-35547490ac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:26.379750 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4e59e-21fb-4df3-8fc5-35547490ac20 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:26.380038 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4e59e-21fb-4df3-8fc5-35547490ac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:26.380308 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4e59e-21fb-4df3-8fc5-35547490ac20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:26.381029 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4e59e-21fb-4df3-8fc5-35547490ac20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:26.382613 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4e59e-21fb-4df3-8fc5-35547490ac20 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:26.392891 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1335/2701] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:40:26.396714 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cd3f3-cbf8-4e8e-8399-cd9c182b5b01 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:26.407551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cd3f3-cbf8-4e8e-8399-cd9c182b5b01 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:26.413652 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4b7bc-ae95-4764-8197-8209829bd01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:26.414322 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4b7bc-ae95-4764-8197-8209829bd01d admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:26.414600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4b7bc-ae95-4764-8197-8209829bd01d admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:26.414977 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4b7bc-ae95-4764-8197-8209829bd01d admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:26.415711 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4b7bc-ae95-4764-8197-8209829bd01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:26.417940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4b7bc-ae95-4764-8197-8209829bd01d admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:26.428521 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1367/2702] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:40:26.432499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4e59e-21fb-4df3-8fc5-35547490ac20 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:26.442381 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4e59e-21fb-4df3-8fc5-35547490ac20 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:26.446926 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf6474-3573-474e-9712-b9fb47ad17e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:26.447792 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf6474-3573-474e-9712-b9fb47ad17e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:26.448073 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf6474-3573-474e-9712-b9fb47ad17e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:26.448383 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf6474-3573-474e-9712-b9fb47ad17e7 admin admin] PATH_INFO: `/v3/projects/51ccd7fabfd54b59b65b2bd5ab5fbb4b/users/01e3c85e7db64048b52b934acdcaa096/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:26.462192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf6474-3573-474e-9712-b9fb47ad17e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ccd7fabfd54b59b65b2bd5ab5fbb4b, user_id=01e3c85e7db64048b52b934acdcaa096, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:26.465402 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf6474-3573-474e-9712-b9fb47ad17e7 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:26.478437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1336/2703] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:40:26 2022] PUT /identity/v3/projects/51ccd7fabfd54b59b65b2bd5ab5fbb4b/users/01e3c85e7db64048b52b934acdcaa096/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:40:26.490372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0a688-1d53-4dfe-9fb8-7796c08f7a46 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:26.490670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0a688-1d53-4dfe-9fb8-7796c08f7a46 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:26.490963 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0a688-1d53-4dfe-9fb8-7796c08f7a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:26.527064 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-a2f0a688-1d53-4dfe-9fb8-7796c08f7a46 None None] MFA Rules not processed for user `01e3c85e7db64048b52b934acdcaa096`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:40:26.528238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a2f0a688-1d53-4dfe-9fb8-7796c08f7a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:26.594762 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1368/2704] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:40:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:40:26.599123 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf6474-3573-474e-9712-b9fb47ad17e7 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:26.659788 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf6474-3573-474e-9712-b9fb47ad17e7 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:26.664525 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02655f22-c952-4541-bc88-210f2c240b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:26.665167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02655f22-c952-4541-bc88-210f2c240b5f admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:26.665448 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02655f22-c952-4541-bc88-210f2c240b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:26.665721 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02655f22-c952-4541-bc88-210f2c240b5f admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:26.666397 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02655f22-c952-4541-bc88-210f2c240b5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:26.668341 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02655f22-c952-4541-bc88-210f2c240b5f admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:26.693894 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1337/2705] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:40:26 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:40:26.697930 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0a688-1d53-4dfe-9fb8-7796c08f7a46 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:26.709121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0a688-1d53-4dfe-9fb8-7796c08f7a46 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:26.762786 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb45bd7-c5af-44ff-bb7c-7fb86813cee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:26.763466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb45bd7-c5af-44ff-bb7c-7fb86813cee5 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:26.763744 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb45bd7-c5af-44ff-bb7c-7fb86813cee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:26.764015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb45bd7-c5af-44ff-bb7c-7fb86813cee5 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:26.764685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb45bd7-c5af-44ff-bb7c-7fb86813cee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:26.766571 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb45bd7-c5af-44ff-bb7c-7fb86813cee5 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:26.786397 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1369/2706] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:40:26 2022] POST /identity/v3/users => generated 296 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:40:26.790412 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02655f22-c952-4541-bc88-210f2c240b5f admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:26.801014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02655f22-c952-4541-bc88-210f2c240b5f admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:26.805891 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a858420-3648-4c4d-8f49-d6fa2d05b704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:26.806549 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a858420-3648-4c4d-8f49-d6fa2d05b704 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:26.806853 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a858420-3648-4c4d-8f49-d6fa2d05b704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:26.807133 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a858420-3648-4c4d-8f49-d6fa2d05b704 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:26.807893 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a858420-3648-4c4d-8f49-d6fa2d05b704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:26.809506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a858420-3648-4c4d-8f49-d6fa2d05b704 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:26.820267 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1338/2707] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:40:26.825077 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb45bd7-c5af-44ff-bb7c-7fb86813cee5 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:26.835122 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb45bd7-c5af-44ff-bb7c-7fb86813cee5 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:26.840355 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3c4f4-b27c-44a1-902c-ab6617a817e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:26.841230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3c4f4-b27c-44a1-902c-ab6617a817e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:26.841506 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3c4f4-b27c-44a1-902c-ab6617a817e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:26.841775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3c4f4-b27c-44a1-902c-ab6617a817e0 admin admin] PATH_INFO: `/v3/projects/79315c2c310543609f09607809097122/users/70d8fd3434344aeeb5ecd72fb2fbdf86/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:26.857713 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3c4f4-b27c-44a1-902c-ab6617a817e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79315c2c310543609f09607809097122, user_id=70d8fd3434344aeeb5ecd72fb2fbdf86, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:26.860363 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3c4f4-b27c-44a1-902c-ab6617a817e0 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:26.873024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1370/2708] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:40:26 2022] PUT /identity/v3/projects/79315c2c310543609f09607809097122/users/70d8fd3434344aeeb5ecd72fb2fbdf86/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:40:26.876874 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a858420-3648-4c4d-8f49-d6fa2d05b704 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:26.887189 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a858420-3648-4c4d-8f49-d6fa2d05b704 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:26.941693 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223f198-f036-4f99-b65f-0affc0a92bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:26.942351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223f198-f036-4f99-b65f-0affc0a92bdc admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:26.942634 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223f198-f036-4f99-b65f-0affc0a92bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:26.942940 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223f198-f036-4f99-b65f-0affc0a92bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:26.943669 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223f198-f036-4f99-b65f-0affc0a92bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:26.945260 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223f198-f036-4f99-b65f-0affc0a92bdc admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:26.955329 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1339/2709] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:40:26.959639 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3c4f4-b27c-44a1-902c-ab6617a817e0 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:26.970304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3c4f4-b27c-44a1-902c-ab6617a817e0 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:26.974951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24689a-d02a-4698-9dcd-b90a1ac3f5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:26.975825 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24689a-d02a-4698-9dcd-b90a1ac3f5ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:26.976105 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24689a-d02a-4698-9dcd-b90a1ac3f5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:26.976400 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24689a-d02a-4698-9dcd-b90a1ac3f5ae admin admin] PATH_INFO: `/v3/projects/79315c2c310543609f09607809097122/users/70d8fd3434344aeeb5ecd72fb2fbdf86/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:26.978326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24689a-d02a-4698-9dcd-b90a1ac3f5ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=79315c2c310543609f09607809097122, user_id=70d8fd3434344aeeb5ecd72fb2fbdf86, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:26.980958 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24689a-d02a-4698-9dcd-b90a1ac3f5ae admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:26.990789 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1371/2710] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:40:26 2022] PUT /identity/v3/projects/79315c2c310543609f09607809097122/users/70d8fd3434344aeeb5ecd72fb2fbdf86/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:40:27.000933 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a182d8a-0641-4f94-b18d-21c7edffe017 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:27.001246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a182d8a-0641-4f94-b18d-21c7edffe017 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:27.001527 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a182d8a-0641-4f94-b18d-21c7edffe017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:27.028053 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-5a182d8a-0641-4f94-b18d-21c7edffe017 None None] MFA Rules not processed for user `70d8fd3434344aeeb5ecd72fb2fbdf86`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:40:27.029257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-5a182d8a-0641-4f94-b18d-21c7edffe017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:27.095732 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1340/2711] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:40:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:40:27.106764 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24689a-d02a-4698-9dcd-b90a1ac3f5ae admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:27.108581 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-9a24689a-d02a-4698-9dcd-b90a1ac3f5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:27.182647 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24689a-d02a-4698-9dcd-b90a1ac3f5ae admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:27.189252 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b50b3f-7462-4487-811f-48cf7f89c6e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:27.190350 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b50b3f-7462-4487-811f-48cf7f89c6e7 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:27.190900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b50b3f-7462-4487-811f-48cf7f89c6e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:27.191406 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b50b3f-7462-4487-811f-48cf7f89c6e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:27.207538 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b50b3f-7462-4487-811f-48cf7f89c6e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:27.210279 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b50b3f-7462-4487-811f-48cf7f89c6e7 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:27.227101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1372/2712] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:40:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:40:27.268621 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a182d8a-0641-4f94-b18d-21c7edffe017 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:27.278040 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a182d8a-0641-4f94-b18d-21c7edffe017 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:27.281951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd217d69-0891-4a91-88f6-67a944520dff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:27.282590 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd217d69-0891-4a91-88f6-67a944520dff service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:27.282906 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd217d69-0891-4a91-88f6-67a944520dff service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:27.283188 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd217d69-0891-4a91-88f6-67a944520dff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:27.337410 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd217d69-0891-4a91-88f6-67a944520dff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:27.338758 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd217d69-0891-4a91-88f6-67a944520dff service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:27.347482 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1341/2713] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:40:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:40:53.283547 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b50b3f-7462-4487-811f-48cf7f89c6e7 service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:40:53.292503 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b50b3f-7462-4487-811f-48cf7f89c6e7 service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:40:53.296081 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9370e1-0e6e-4264-b937-909f3e706ba4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:40:53.296716 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9370e1-0e6e-4264-b937-909f3e706ba4 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:40:53.296990 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9370e1-0e6e-4264-b937-909f3e706ba4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:40:53.297262 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9370e1-0e6e-4264-b937-909f3e706ba4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:40:53.299020 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-da9370e1-0e6e-4264-b937-909f3e706ba4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:40:53.375437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9370e1-0e6e-4264-b937-909f3e706ba4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:40:53.376849 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9370e1-0e6e-4264-b937-909f3e706ba4 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:40:53.394997 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1373/2714] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:40:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:41:15.232828 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd217d69-0891-4a91-88f6-67a944520dff service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:41:15.241385 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd217d69-0891-4a91-88f6-67a944520dff service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:41:15.245030 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d8bf3-9ea6-4030-bbdf-f296504b41c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:41:15.245660 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d8bf3-9ea6-4030-bbdf-f296504b41c6 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:41:15.245942 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d8bf3-9ea6-4030-bbdf-f296504b41c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:41:15.246217 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d8bf3-9ea6-4030-bbdf-f296504b41c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:41:15.247984 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-0c3d8bf3-9ea6-4030-bbdf-f296504b41c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:41:15.305299 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d8bf3-9ea6-4030-bbdf-f296504b41c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:41:15.306729 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d8bf3-9ea6-4030-bbdf-f296504b41c6 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:41:15.315560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1342/2715] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:41:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:41:57.264502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc36d14-75b8-433e-80d2-cd3947c93bd1 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:41:57.265030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc36d14-75b8-433e-80d2-cd3947c93bd1 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:41:57.265116 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc36d14-75b8-433e-80d2-cd3947c93bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:41:57.291865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-2cc36d14-75b8-433e-80d2-cd3947c93bd1 None None] MFA Rules not processed for user `99fb6525fa854bc885f9966f5fc80407`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:41:57.293064 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-2cc36d14-75b8-433e-80d2-cd3947c93bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:41:57.299853 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1374/2716] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:41:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:41:57.531888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d8bf3-9ea6-4030-bbdf-f296504b41c6 service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:41:57.533366 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-0c3d8bf3-9ea6-4030-bbdf-f296504b41c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:41:57.588688 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d8bf3-9ea6-4030-bbdf-f296504b41c6 service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:41:57.592277 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1776bf-e701-4b2a-9941-f0d4bb65f4fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:41:57.592910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1776bf-e701-4b2a-9941-f0d4bb65f4fe service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:41:57.593189 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1776bf-e701-4b2a-9941-f0d4bb65f4fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:41:57.593462 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1776bf-e701-4b2a-9941-f0d4bb65f4fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:41:57.595237 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-3d1776bf-e701-4b2a-9941-f0d4bb65f4fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:41:57.604801 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1776bf-e701-4b2a-9941-f0d4bb65f4fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:41:57.606200 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1776bf-e701-4b2a-9941-f0d4bb65f4fe service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:41:57.613823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1343/2717] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:41:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:42:00.263510 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc36d14-75b8-433e-80d2-cd3947c93bd1 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:00.265243 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-2cc36d14-75b8-433e-80d2-cd3947c93bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:00.364464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc36d14-75b8-433e-80d2-cd3947c93bd1 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:00.371479 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b53d25-4cf7-4564-9bc5-bd3cdc5cd50b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:00.372129 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b53d25-4cf7-4564-9bc5-bd3cdc5cd50b service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:00.372406 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b53d25-4cf7-4564-9bc5-bd3cdc5cd50b service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:00.372679 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b53d25-4cf7-4564-9bc5-bd3cdc5cd50b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:00.374585 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-b7b53d25-4cf7-4564-9bc5-bd3cdc5cd50b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:00.387947 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b53d25-4cf7-4564-9bc5-bd3cdc5cd50b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:00.389549 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b53d25-4cf7-4564-9bc5-bd3cdc5cd50b service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:00.400698 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1375/2718] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:42:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:42:04.861933 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1776bf-e701-4b2a-9941-f0d4bb65f4fe service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:04.922638 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1776bf-e701-4b2a-9941-f0d4bb65f4fe service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:04.927200 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fe6e8-569d-4924-873e-6ba4e90a34cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:04.928063 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fe6e8-569d-4924-873e-6ba4e90a34cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:04.928345 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fe6e8-569d-4924-873e-6ba4e90a34cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:04.928621 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fe6e8-569d-4924-873e-6ba4e90a34cb admin admin] PATH_INFO: `/v3/users/733e624a096e48ecbcc77e509cf065f8` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:04.929791 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fe6e8-569d-4924-873e-6ba4e90a34cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=733e624a096e48ecbcc77e509cf065f8)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:04.931758 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fe6e8-569d-4924-873e-6ba4e90a34cb admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:04.977924 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-937fe6e8-569d-4924-873e-6ba4e90a34cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '733e624a096e48ecbcc77e509cf065f8'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:04.985099 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-937fe6e8-569d-4924-873e-6ba4e90a34cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '733e624a096e48ecbcc77e509cf065f8'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:04.996778 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-937fe6e8-569d-4924-873e-6ba4e90a34cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '733e624a096e48ecbcc77e509cf065f8'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:04.997417 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-937fe6e8-569d-4924-873e-6ba4e90a34cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '733e624a096e48ecbcc77e509cf065f8'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:05.004080 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-937fe6e8-569d-4924-873e-6ba4e90a34cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '733e624a096e48ecbcc77e509cf065f8'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:05.010311 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1344/2719] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:42:04 2022] DELETE /identity/v3/users/733e624a096e48ecbcc77e509cf065f8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:42:05.014794 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa5fed-9da7-4e3b-a2a3-c2149ced9d56 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:05.015299 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa5fed-9da7-4e3b-a2a3-c2149ced9d56 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:05.015422 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa5fed-9da7-4e3b-a2a3-c2149ced9d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:05.033131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-acfa5fed-9da7-4e3b-a2a3-c2149ced9d56 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:42:05.034332 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-acfa5fed-9da7-4e3b-a2a3-c2149ced9d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:05.091120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1376/2720] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:42:05.100655 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fe6e8-569d-4924-873e-6ba4e90a34cb admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:05.102153 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-937fe6e8-569d-4924-873e-6ba4e90a34cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:05.158102 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fe6e8-569d-4924-873e-6ba4e90a34cb admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:05.162502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c776b-72d9-45eb-9f3d-dada2cabdd93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:05.163178 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c776b-72d9-45eb-9f3d-dada2cabdd93 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:05.163489 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c776b-72d9-45eb-9f3d-dada2cabdd93 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:05.163766 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c776b-72d9-45eb-9f3d-dada2cabdd93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:05.173013 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c776b-72d9-45eb-9f3d-dada2cabdd93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:05.174377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c776b-72d9-45eb-9f3d-dada2cabdd93 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:05.184646 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1345/2721] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:42:05.552097 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa5fed-9da7-4e3b-a2a3-c2149ced9d56 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:05.554120 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-acfa5fed-9da7-4e3b-a2a3-c2149ced9d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:05.570798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa5fed-9da7-4e3b-a2a3-c2149ced9d56 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:05.577053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262aecf3-98cf-4910-8f43-d4a5ded1b7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:05.578583 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262aecf3-98cf-4910-8f43-d4a5ded1b7b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:05.578910 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262aecf3-98cf-4910-8f43-d4a5ded1b7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:05.579294 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262aecf3-98cf-4910-8f43-d4a5ded1b7b2 admin admin] PATH_INFO: `/v3/projects/dc042f7da78d48b1b6c23202c937833a` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:05.588604 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262aecf3-98cf-4910-8f43-d4a5ded1b7b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc042f7da78d48b1b6c23202c937833a)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:05.590600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262aecf3-98cf-4910-8f43-d4a5ded1b7b2 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:05.648732 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-262aecf3-98cf-4910-8f43-d4a5ded1b7b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc042f7da78d48b1b6c23202c937833a', 'request_id': 'req-262aecf3-98cf-4910-8f43-d4a5ded1b7b2'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:05.655245 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-262aecf3-98cf-4910-8f43-d4a5ded1b7b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc042f7da78d48b1b6c23202c937833a', 'request_id': 'req-262aecf3-98cf-4910-8f43-d4a5ded1b7b2'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:05.662721 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-262aecf3-98cf-4910-8f43-d4a5ded1b7b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc042f7da78d48b1b6c23202c937833a', 'request_id': 'req-262aecf3-98cf-4910-8f43-d4a5ded1b7b2'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:05.673031 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-262aecf3-98cf-4910-8f43-d4a5ded1b7b2 admin admin] The token cache is being invalidate because project dc042f7da78d48b1b6c23202c937833a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:42:05.673357 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-262aecf3-98cf-4910-8f43-d4a5ded1b7b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:05.673934 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-262aecf3-98cf-4910-8f43-d4a5ded1b7b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:05.675536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1377/2722] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:42:05 2022] DELETE /identity/v3/projects/dc042f7da78d48b1b6c23202c937833a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:42:05.679522 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c776b-72d9-45eb-9f3d-dada2cabdd93 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:05.690118 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c776b-72d9-45eb-9f3d-dada2cabdd93 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:05.749187 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef591c-3dbc-4b46-9ecc-dc51fe5a1cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:05.750059 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef591c-3dbc-4b46-9ecc-dc51fe5a1cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:05.750375 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef591c-3dbc-4b46-9ecc-dc51fe5a1cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:05.750653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef591c-3dbc-4b46-9ecc-dc51fe5a1cd1 admin admin] PATH_INFO: `/v3/users/01e3c85e7db64048b52b934acdcaa096` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:05.751881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef591c-3dbc-4b46-9ecc-dc51fe5a1cd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01e3c85e7db64048b52b934acdcaa096)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:05.753839 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef591c-3dbc-4b46-9ecc-dc51fe5a1cd1 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:05.801394 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-dbef591c-3dbc-4b46-9ecc-dc51fe5a1cd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01e3c85e7db64048b52b934acdcaa096'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:05.809549 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-dbef591c-3dbc-4b46-9ecc-dc51fe5a1cd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01e3c85e7db64048b52b934acdcaa096'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:05.821652 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-dbef591c-3dbc-4b46-9ecc-dc51fe5a1cd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01e3c85e7db64048b52b934acdcaa096'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:05.822531 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-dbef591c-3dbc-4b46-9ecc-dc51fe5a1cd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01e3c85e7db64048b52b934acdcaa096'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:05.830134 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-dbef591c-3dbc-4b46-9ecc-dc51fe5a1cd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01e3c85e7db64048b52b934acdcaa096'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:05.836945 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1346/2723] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:42:05 2022] DELETE /identity/v3/users/01e3c85e7db64048b52b934acdcaa096 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:42:06.108033 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262aecf3-98cf-4910-8f43-d4a5ded1b7b2 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:06.109443 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-262aecf3-98cf-4910-8f43-d4a5ded1b7b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:06.122626 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262aecf3-98cf-4910-8f43-d4a5ded1b7b2 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:06.178193 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6e92f-7bf6-4444-ac1a-833ba8c6bd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:06.179001 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6e92f-7bf6-4444-ac1a-833ba8c6bd72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:06.179281 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6e92f-7bf6-4444-ac1a-833ba8c6bd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:06.179552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6e92f-7bf6-4444-ac1a-833ba8c6bd72 admin admin] PATH_INFO: `/v3/projects/51ccd7fabfd54b59b65b2bd5ab5fbb4b` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:06.180723 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6e92f-7bf6-4444-ac1a-833ba8c6bd72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51ccd7fabfd54b59b65b2bd5ab5fbb4b)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:06.182613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6e92f-7bf6-4444-ac1a-833ba8c6bd72 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:06.232091 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-07f6e92f-7bf6-4444-ac1a-833ba8c6bd72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ccd7fabfd54b59b65b2bd5ab5fbb4b', 'request_id': 'req-07f6e92f-7bf6-4444-ac1a-833ba8c6bd72'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:06.238959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-07f6e92f-7bf6-4444-ac1a-833ba8c6bd72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ccd7fabfd54b59b65b2bd5ab5fbb4b', 'request_id': 'req-07f6e92f-7bf6-4444-ac1a-833ba8c6bd72'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:06.247830 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-07f6e92f-7bf6-4444-ac1a-833ba8c6bd72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ccd7fabfd54b59b65b2bd5ab5fbb4b', 'request_id': 'req-07f6e92f-7bf6-4444-ac1a-833ba8c6bd72'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:06.260118 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-07f6e92f-7bf6-4444-ac1a-833ba8c6bd72 admin admin] The token cache is being invalidate because project 51ccd7fabfd54b59b65b2bd5ab5fbb4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:42:06.260393 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-07f6e92f-7bf6-4444-ac1a-833ba8c6bd72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:06.261104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-07f6e92f-7bf6-4444-ac1a-833ba8c6bd72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:06.262662 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1378/2724] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:42:06 2022] DELETE /identity/v3/projects/51ccd7fabfd54b59b65b2bd5ab5fbb4b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:42:06.266793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef591c-3dbc-4b46-9ecc-dc51fe5a1cd1 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:06.268547 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-dbef591c-3dbc-4b46-9ecc-dc51fe5a1cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:06.282641 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef591c-3dbc-4b46-9ecc-dc51fe5a1cd1 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:06.341424 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad64b0-2e90-4be2-a292-25551eef1845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:06.342285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad64b0-2e90-4be2-a292-25551eef1845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:06.342566 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad64b0-2e90-4be2-a292-25551eef1845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:06.342879 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad64b0-2e90-4be2-a292-25551eef1845 admin admin] PATH_INFO: `/v3/users/70d8fd3434344aeeb5ecd72fb2fbdf86` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:06.344073 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad64b0-2e90-4be2-a292-25551eef1845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70d8fd3434344aeeb5ecd72fb2fbdf86)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:06.345960 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad64b0-2e90-4be2-a292-25551eef1845 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:06.393570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-bbad64b0-2e90-4be2-a292-25551eef1845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70d8fd3434344aeeb5ecd72fb2fbdf86'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:06.403666 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-bbad64b0-2e90-4be2-a292-25551eef1845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70d8fd3434344aeeb5ecd72fb2fbdf86'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:06.416362 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-bbad64b0-2e90-4be2-a292-25551eef1845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70d8fd3434344aeeb5ecd72fb2fbdf86'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:06.417091 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-bbad64b0-2e90-4be2-a292-25551eef1845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70d8fd3434344aeeb5ecd72fb2fbdf86'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:06.424823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-bbad64b0-2e90-4be2-a292-25551eef1845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70d8fd3434344aeeb5ecd72fb2fbdf86'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:06.434758 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1347/2725] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:42:06 2022] DELETE /identity/v3/users/70d8fd3434344aeeb5ecd72fb2fbdf86 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:42:06.718267 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6e92f-7bf6-4444-ac1a-833ba8c6bd72 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:06.719835 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-07f6e92f-7bf6-4444-ac1a-833ba8c6bd72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:06.732652 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6e92f-7bf6-4444-ac1a-833ba8c6bd72 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:06.791979 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38d39b-4d17-430a-9343-8ce4b47980eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:06.792958 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38d39b-4d17-430a-9343-8ce4b47980eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:06.793125 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38d39b-4d17-430a-9343-8ce4b47980eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:06.793406 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38d39b-4d17-430a-9343-8ce4b47980eb admin admin] PATH_INFO: `/v3/projects/79315c2c310543609f09607809097122` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:06.794608 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38d39b-4d17-430a-9343-8ce4b47980eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=79315c2c310543609f09607809097122)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:06.796560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38d39b-4d17-430a-9343-8ce4b47980eb admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:06.841985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-0d38d39b-4d17-430a-9343-8ce4b47980eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79315c2c310543609f09607809097122', 'request_id': 'req-0d38d39b-4d17-430a-9343-8ce4b47980eb'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:06.847846 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-0d38d39b-4d17-430a-9343-8ce4b47980eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79315c2c310543609f09607809097122', 'request_id': 'req-0d38d39b-4d17-430a-9343-8ce4b47980eb'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:06.855269 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-0d38d39b-4d17-430a-9343-8ce4b47980eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79315c2c310543609f09607809097122', 'request_id': 'req-0d38d39b-4d17-430a-9343-8ce4b47980eb'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:06.865587 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-0d38d39b-4d17-430a-9343-8ce4b47980eb admin admin] The token cache is being invalidate because project 79315c2c310543609f09607809097122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:42:06.865865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-0d38d39b-4d17-430a-9343-8ce4b47980eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:06.866478 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-0d38d39b-4d17-430a-9343-8ce4b47980eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:06.868036 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1379/2726] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:42:06 2022] DELETE /identity/v3/projects/79315c2c310543609f09607809097122 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:42:06.874170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72232167-e762-4201-9bbc-161d748fc7c5 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:06.874455 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72232167-e762-4201-9bbc-161d748fc7c5 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:06.874729 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72232167-e762-4201-9bbc-161d748fc7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:06.893186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-72232167-e762-4201-9bbc-161d748fc7c5 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:42:06.894364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-72232167-e762-4201-9bbc-161d748fc7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:06.957801 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1348/2727] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:42:06.966893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b803b-33b6-4c19-bf00-b86dba799951 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:06.967099 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b803b-33b6-4c19-bf00-b86dba799951 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:06.967374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b803b-33b6-4c19-bf00-b86dba799951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:06.985254 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-c31b803b-33b6-4c19-bf00-b86dba799951 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:42:06.986530 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-c31b803b-33b6-4c19-bf00-b86dba799951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:06.995266 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1380/2728] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:42:06.999399 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72232167-e762-4201-9bbc-161d748fc7c5 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:07.009723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72232167-e762-4201-9bbc-161d748fc7c5 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:07.014434 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1046d-4770-4d92-a970-103afae9a8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:07.015026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1046d-4770-4d92-a970-103afae9a8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:07.015310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1046d-4770-4d92-a970-103afae9a8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:07.015584 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1046d-4770-4d92-a970-103afae9a8e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:07.016306 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1046d-4770-4d92-a970-103afae9a8e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:42:07.016612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1046d-4770-4d92-a970-103afae9a8e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:07.018201 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1046d-4770-4d92-a970-103afae9a8e0 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:07.029758 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1349/2729] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:42:07.034037 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b803b-33b6-4c19-bf00-b86dba799951 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:07.043362 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b803b-33b6-4c19-bf00-b86dba799951 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:07.047971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6132359-d33f-4471-9114-fe00c2fd3f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:07.048620 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6132359-d33f-4471-9114-fe00c2fd3f9b admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:07.048901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6132359-d33f-4471-9114-fe00c2fd3f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:07.049172 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6132359-d33f-4471-9114-fe00c2fd3f9b admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:07.049850 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6132359-d33f-4471-9114-fe00c2fd3f9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:07.051831 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6132359-d33f-4471-9114-fe00c2fd3f9b admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:07.080340 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1381/2730] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:42:07 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:42:07.081508 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1046d-4770-4d92-a970-103afae9a8e0 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:07.091300 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1046d-4770-4d92-a970-103afae9a8e0 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:07.150365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f575c4-6658-4360-a774-f9dab3696a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:07.151060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f575c4-6658-4360-a774-f9dab3696a32 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:07.151344 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f575c4-6658-4360-a774-f9dab3696a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:07.151626 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f575c4-6658-4360-a774-f9dab3696a32 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:07.152308 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f575c4-6658-4360-a774-f9dab3696a32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:07.154482 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f575c4-6658-4360-a774-f9dab3696a32 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:07.175244 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1350/2731] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:42:07 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:42:07.179956 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6132359-d33f-4471-9114-fe00c2fd3f9b admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:07.190480 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6132359-d33f-4471-9114-fe00c2fd3f9b admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:07.195383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b97541-ea56-4ad0-ae5c-66876c76c303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:07.196041 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b97541-ea56-4ad0-ae5c-66876c76c303 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:07.196321 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b97541-ea56-4ad0-ae5c-66876c76c303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:07.196598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b97541-ea56-4ad0-ae5c-66876c76c303 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:07.197335 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b97541-ea56-4ad0-ae5c-66876c76c303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:07.198958 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b97541-ea56-4ad0-ae5c-66876c76c303 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:07.209296 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1382/2732] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:42:07.213417 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f575c4-6658-4360-a774-f9dab3696a32 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:07.223271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f575c4-6658-4360-a774-f9dab3696a32 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:07.228511 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2101cbc-e5e7-40a4-b0bd-c7553603c441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:07.229158 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2101cbc-e5e7-40a4-b0bd-c7553603c441 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:07.229437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2101cbc-e5e7-40a4-b0bd-c7553603c441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:07.229709 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2101cbc-e5e7-40a4-b0bd-c7553603c441 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:07.230422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2101cbc-e5e7-40a4-b0bd-c7553603c441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:07.232041 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2101cbc-e5e7-40a4-b0bd-c7553603c441 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:07.242901 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1351/2733] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:42:07.247118 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b97541-ea56-4ad0-ae5c-66876c76c303 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:07.257266 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b97541-ea56-4ad0-ae5c-66876c76c303 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:07.261999 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5f777-6ba2-4c78-a28e-4ddc2a3598be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:07.262976 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5f777-6ba2-4c78-a28e-4ddc2a3598be admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:07.263275 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5f777-6ba2-4c78-a28e-4ddc2a3598be admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:07.263555 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5f777-6ba2-4c78-a28e-4ddc2a3598be admin admin] PATH_INFO: `/v3/projects/63470da6d26549ca8f825a28b96fb276/users/da18f3dbe4a5492db4e72418170d3069/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:07.277788 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5f777-6ba2-4c78-a28e-4ddc2a3598be admin admin] RBAC: Authorizing `identity:create_grant(project_id=63470da6d26549ca8f825a28b96fb276, user_id=da18f3dbe4a5492db4e72418170d3069, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:07.281416 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5f777-6ba2-4c78-a28e-4ddc2a3598be admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:07.294731 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1383/2734] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:42:07 2022] PUT /identity/v3/projects/63470da6d26549ca8f825a28b96fb276/users/da18f3dbe4a5492db4e72418170d3069/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:42:07.309046 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591d721-7a3c-4b15-9191-3726b43b87e9 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:07.309526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591d721-7a3c-4b15-9191-3726b43b87e9 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:07.309628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591d721-7a3c-4b15-9191-3726b43b87e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:07.339288 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-6591d721-7a3c-4b15-9191-3726b43b87e9 None None] MFA Rules not processed for user `da18f3dbe4a5492db4e72418170d3069`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:42:07.340482 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6591d721-7a3c-4b15-9191-3726b43b87e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:07.402739 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1352/2735] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:42:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:42:07.407492 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5f777-6ba2-4c78-a28e-4ddc2a3598be admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:07.468303 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5f777-6ba2-4c78-a28e-4ddc2a3598be admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:07.473152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aee523-b990-4d23-8a2f-d71646d8cc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:07.473895 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aee523-b990-4d23-8a2f-d71646d8cc34 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:07.474108 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aee523-b990-4d23-8a2f-d71646d8cc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:07.475060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aee523-b990-4d23-8a2f-d71646d8cc34 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:07.475948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aee523-b990-4d23-8a2f-d71646d8cc34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:07.477982 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aee523-b990-4d23-8a2f-d71646d8cc34 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:07.506466 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1384/2736] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:42:07 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:42:07.507670 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591d721-7a3c-4b15-9191-3726b43b87e9 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:07.518897 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591d721-7a3c-4b15-9191-3726b43b87e9 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:07.573668 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2381246-ba2b-45c0-8be5-d2b14c4f6e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:07.574339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2381246-ba2b-45c0-8be5-d2b14c4f6e59 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:07.574618 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2381246-ba2b-45c0-8be5-d2b14c4f6e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:07.574924 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2381246-ba2b-45c0-8be5-d2b14c4f6e59 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:07.575595 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2381246-ba2b-45c0-8be5-d2b14c4f6e59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:07.577502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2381246-ba2b-45c0-8be5-d2b14c4f6e59 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:07.596990 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1353/2737] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:42:07 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:42:07.602002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aee523-b990-4d23-8a2f-d71646d8cc34 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:07.612425 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aee523-b990-4d23-8a2f-d71646d8cc34 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:07.617492 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ff349-c001-4101-8f3d-50e771ad86d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:07.618221 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ff349-c001-4101-8f3d-50e771ad86d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:07.618501 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ff349-c001-4101-8f3d-50e771ad86d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:07.618770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ff349-c001-4101-8f3d-50e771ad86d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:07.619530 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ff349-c001-4101-8f3d-50e771ad86d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:07.621098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ff349-c001-4101-8f3d-50e771ad86d2 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:07.632757 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1385/2738] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:42:07.636889 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2381246-ba2b-45c0-8be5-d2b14c4f6e59 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:07.647452 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2381246-ba2b-45c0-8be5-d2b14c4f6e59 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:07.652335 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377bb28-8180-4298-8de3-4e95005ab36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:07.653369 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377bb28-8180-4298-8de3-4e95005ab36b admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:07.653649 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377bb28-8180-4298-8de3-4e95005ab36b admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:07.653921 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377bb28-8180-4298-8de3-4e95005ab36b admin admin] PATH_INFO: `/v3/projects/aa0084518fa54574b45e181f6df10e09/users/0f332571b67e4e6f917a735c79be4324/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:07.670063 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377bb28-8180-4298-8de3-4e95005ab36b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa0084518fa54574b45e181f6df10e09, user_id=0f332571b67e4e6f917a735c79be4324, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:07.672889 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377bb28-8180-4298-8de3-4e95005ab36b admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:07.686860 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1354/2739] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:42:07 2022] PUT /identity/v3/projects/aa0084518fa54574b45e181f6df10e09/users/0f332571b67e4e6f917a735c79be4324/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:42:07.690645 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ff349-c001-4101-8f3d-50e771ad86d2 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:07.700896 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ff349-c001-4101-8f3d-50e771ad86d2 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:07.759767 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21aa1c-3e7c-425f-adc6-9d36088d624a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:07.760440 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21aa1c-3e7c-425f-adc6-9d36088d624a admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:07.760717 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21aa1c-3e7c-425f-adc6-9d36088d624a admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:07.760986 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21aa1c-3e7c-425f-adc6-9d36088d624a admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:07.761709 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21aa1c-3e7c-425f-adc6-9d36088d624a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:07.763329 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21aa1c-3e7c-425f-adc6-9d36088d624a admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:07.778280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1386/2740] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:42:07.782741 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377bb28-8180-4298-8de3-4e95005ab36b admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:07.793553 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377bb28-8180-4298-8de3-4e95005ab36b admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:07.798214 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60125f8c-4869-4e50-81ff-3f061792ac8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:07.799124 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60125f8c-4869-4e50-81ff-3f061792ac8f admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:07.799402 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60125f8c-4869-4e50-81ff-3f061792ac8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:07.799670 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60125f8c-4869-4e50-81ff-3f061792ac8f admin admin] PATH_INFO: `/v3/projects/aa0084518fa54574b45e181f6df10e09/users/0f332571b67e4e6f917a735c79be4324/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:07.801739 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60125f8c-4869-4e50-81ff-3f061792ac8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa0084518fa54574b45e181f6df10e09, user_id=0f332571b67e4e6f917a735c79be4324, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:07.804674 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60125f8c-4869-4e50-81ff-3f061792ac8f admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:07.815556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1355/2741] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:42:07 2022] PUT /identity/v3/projects/aa0084518fa54574b45e181f6df10e09/users/0f332571b67e4e6f917a735c79be4324/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:42:07.827076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738d2b9-7ac2-44b0-8596-d635cbda2e88 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:07.827390 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738d2b9-7ac2-44b0-8596-d635cbda2e88 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:07.827665 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738d2b9-7ac2-44b0-8596-d635cbda2e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:07.854638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-6738d2b9-7ac2-44b0-8596-d635cbda2e88 None None] MFA Rules not processed for user `0f332571b67e4e6f917a735c79be4324`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:42:07.855905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-6738d2b9-7ac2-44b0-8596-d635cbda2e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:07.921901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1387/2742] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:42:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:42:07.932295 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60125f8c-4869-4e50-81ff-3f061792ac8f admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:07.933980 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-60125f8c-4869-4e50-81ff-3f061792ac8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:08.002447 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60125f8c-4869-4e50-81ff-3f061792ac8f admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:08.006731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246621e-9ae4-45a5-8adf-ee1f7ed4edb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:08.007313 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246621e-9ae4-45a5-8adf-ee1f7ed4edb5 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:08.007595 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246621e-9ae4-45a5-8adf-ee1f7ed4edb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:08.007868 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246621e-9ae4-45a5-8adf-ee1f7ed4edb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:08.061370 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246621e-9ae4-45a5-8adf-ee1f7ed4edb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:08.062796 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246621e-9ae4-45a5-8adf-ee1f7ed4edb5 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:08.072041 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1356/2743] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:42:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:42:15.417545 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738d2b9-7ac2-44b0-8596-d635cbda2e88 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:15.427256 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738d2b9-7ac2-44b0-8596-d635cbda2e88 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:15.431370 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a9b96-c38b-411b-a77d-a9e9401641cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:15.431987 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a9b96-c38b-411b-a77d-a9e9401641cb service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:15.432267 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a9b96-c38b-411b-a77d-a9e9401641cb service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:15.432536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a9b96-c38b-411b-a77d-a9e9401641cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:15.441745 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a9b96-c38b-411b-a77d-a9e9401641cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:15.443737 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a9b96-c38b-411b-a77d-a9e9401641cb service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:15.453570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1388/2744] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:42:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:42:24.485986 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246621e-9ae4-45a5-8adf-ee1f7ed4edb5 service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:24.557548 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246621e-9ae4-45a5-8adf-ee1f7ed4edb5 service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:24.562178 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b47e4c-739f-427b-bdaa-3a581f0bbcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:24.563073 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b47e4c-739f-427b-bdaa-3a581f0bbcc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:24.563351 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b47e4c-739f-427b-bdaa-3a581f0bbcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:24.563623 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b47e4c-739f-427b-bdaa-3a581f0bbcc9 admin admin] PATH_INFO: `/v3/users/da18f3dbe4a5492db4e72418170d3069` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:24.564799 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b47e4c-739f-427b-bdaa-3a581f0bbcc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da18f3dbe4a5492db4e72418170d3069)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:24.566750 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b47e4c-739f-427b-bdaa-3a581f0bbcc9 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:24.615089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-a6b47e4c-739f-427b-bdaa-3a581f0bbcc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da18f3dbe4a5492db4e72418170d3069'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:24.622301 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-a6b47e4c-739f-427b-bdaa-3a581f0bbcc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da18f3dbe4a5492db4e72418170d3069'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:24.633962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-a6b47e4c-739f-427b-bdaa-3a581f0bbcc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da18f3dbe4a5492db4e72418170d3069'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:24.634591 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-a6b47e4c-739f-427b-bdaa-3a581f0bbcc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da18f3dbe4a5492db4e72418170d3069'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:24.641303 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-a6b47e4c-739f-427b-bdaa-3a581f0bbcc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da18f3dbe4a5492db4e72418170d3069'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:24.647248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1357/2745] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:42:24 2022] DELETE /identity/v3/users/da18f3dbe4a5492db4e72418170d3069 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:42:24.651703 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23051b59-b06b-4851-86f8-a75ca4123c3a None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:24.652247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23051b59-b06b-4851-86f8-a75ca4123c3a None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:24.652247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23051b59-b06b-4851-86f8-a75ca4123c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:24.670135 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-23051b59-b06b-4851-86f8-a75ca4123c3a None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:42:24.671402 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-23051b59-b06b-4851-86f8-a75ca4123c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:24.728609 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1389/2746] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:42:24.738845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b47e4c-739f-427b-bdaa-3a581f0bbcc9 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:24.740857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-a6b47e4c-739f-427b-bdaa-3a581f0bbcc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:24.798342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b47e4c-739f-427b-bdaa-3a581f0bbcc9 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:24.803346 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbcd1e-943e-4663-a3fb-1fb36a4f942c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:24.804018 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbcd1e-943e-4663-a3fb-1fb36a4f942c service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:24.804302 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbcd1e-943e-4663-a3fb-1fb36a4f942c service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:24.804603 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbcd1e-943e-4663-a3fb-1fb36a4f942c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:24.814251 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbcd1e-943e-4663-a3fb-1fb36a4f942c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:24.815749 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbcd1e-943e-4663-a3fb-1fb36a4f942c service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:24.826965 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1358/2747] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:42:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:42:25.104989 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23051b59-b06b-4851-86f8-a75ca4123c3a None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:25.106488 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-23051b59-b06b-4851-86f8-a75ca4123c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:25.120176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23051b59-b06b-4851-86f8-a75ca4123c3a None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:25.125367 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23a018-aad1-444f-94d8-336af700eecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:25.126302 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23a018-aad1-444f-94d8-336af700eecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:25.126678 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23a018-aad1-444f-94d8-336af700eecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:25.127051 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23a018-aad1-444f-94d8-336af700eecc admin admin] PATH_INFO: `/v3/projects/63470da6d26549ca8f825a28b96fb276` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:25.128779 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23a018-aad1-444f-94d8-336af700eecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=63470da6d26549ca8f825a28b96fb276)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:25.131418 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23a018-aad1-444f-94d8-336af700eecc admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:25.179040 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ad23a018-aad1-444f-94d8-336af700eecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63470da6d26549ca8f825a28b96fb276', 'request_id': 'req-ad23a018-aad1-444f-94d8-336af700eecc'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:25.185190 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ad23a018-aad1-444f-94d8-336af700eecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63470da6d26549ca8f825a28b96fb276', 'request_id': 'req-ad23a018-aad1-444f-94d8-336af700eecc'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:25.192692 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ad23a018-aad1-444f-94d8-336af700eecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63470da6d26549ca8f825a28b96fb276', 'request_id': 'req-ad23a018-aad1-444f-94d8-336af700eecc'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:25.202900 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ad23a018-aad1-444f-94d8-336af700eecc admin admin] The token cache is being invalidate because project 63470da6d26549ca8f825a28b96fb276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:42:25.203162 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ad23a018-aad1-444f-94d8-336af700eecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:25.203833 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ad23a018-aad1-444f-94d8-336af700eecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:25.205435 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1390/2748] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:42:25 2022] DELETE /identity/v3/projects/63470da6d26549ca8f825a28b96fb276 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:42:25.209544 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbcd1e-943e-4663-a3fb-1fb36a4f942c service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:25.219204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbcd1e-943e-4663-a3fb-1fb36a4f942c service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:25.274521 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a77237-cd89-442a-909c-93272000079b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:25.275331 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a77237-cd89-442a-909c-93272000079b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:25.275616 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a77237-cd89-442a-909c-93272000079b admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:25.275890 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a77237-cd89-442a-909c-93272000079b admin admin] PATH_INFO: `/v3/users/0f332571b67e4e6f917a735c79be4324` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:25.277067 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a77237-cd89-442a-909c-93272000079b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f332571b67e4e6f917a735c79be4324)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:25.279282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a77237-cd89-442a-909c-93272000079b admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:25.326713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-39a77237-cd89-442a-909c-93272000079b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f332571b67e4e6f917a735c79be4324'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:25.333156 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-39a77237-cd89-442a-909c-93272000079b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f332571b67e4e6f917a735c79be4324'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:25.344483 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-39a77237-cd89-442a-909c-93272000079b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f332571b67e4e6f917a735c79be4324'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:25.345171 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-39a77237-cd89-442a-909c-93272000079b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f332571b67e4e6f917a735c79be4324'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:25.352564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-39a77237-cd89-442a-909c-93272000079b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f332571b67e4e6f917a735c79be4324'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:25.358414 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1359/2749] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:42:25 2022] DELETE /identity/v3/users/0f332571b67e4e6f917a735c79be4324 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:42:25.658134 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23a018-aad1-444f-94d8-336af700eecc admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:25.660081 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ad23a018-aad1-444f-94d8-336af700eecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:25.673411 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23a018-aad1-444f-94d8-336af700eecc admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:25.729961 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be802b6c-b349-409a-9b67-b592749ab9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:25.730835 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be802b6c-b349-409a-9b67-b592749ab9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:25.731123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be802b6c-b349-409a-9b67-b592749ab9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:25.731397 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be802b6c-b349-409a-9b67-b592749ab9d7 admin admin] PATH_INFO: `/v3/projects/aa0084518fa54574b45e181f6df10e09` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:25.732560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be802b6c-b349-409a-9b67-b592749ab9d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa0084518fa54574b45e181f6df10e09)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:25.734451 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be802b6c-b349-409a-9b67-b592749ab9d7 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:25.778903 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-be802b6c-b349-409a-9b67-b592749ab9d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa0084518fa54574b45e181f6df10e09', 'request_id': 'req-be802b6c-b349-409a-9b67-b592749ab9d7'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:25.784837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-be802b6c-b349-409a-9b67-b592749ab9d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa0084518fa54574b45e181f6df10e09', 'request_id': 'req-be802b6c-b349-409a-9b67-b592749ab9d7'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:25.792365 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-be802b6c-b349-409a-9b67-b592749ab9d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa0084518fa54574b45e181f6df10e09', 'request_id': 'req-be802b6c-b349-409a-9b67-b592749ab9d7'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:25.803264 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-be802b6c-b349-409a-9b67-b592749ab9d7 admin admin] The token cache is being invalidate because project aa0084518fa54574b45e181f6df10e09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:42:25.803533 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-be802b6c-b349-409a-9b67-b592749ab9d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:25.804159 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-be802b6c-b349-409a-9b67-b592749ab9d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:25.805927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1391/2750] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:42:25 2022] DELETE /identity/v3/projects/aa0084518fa54574b45e181f6df10e09 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:42:26.681935 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a77237-cd89-442a-909c-93272000079b admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:26.683526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-39a77237-cd89-442a-909c-93272000079b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:26.696870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a77237-cd89-442a-909c-93272000079b admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:26.755945 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc037a4-324f-40ca-86af-1fff33255882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:26.756806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc037a4-324f-40ca-86af-1fff33255882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:26.757087 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc037a4-324f-40ca-86af-1fff33255882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:26.757360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc037a4-324f-40ca-86af-1fff33255882 admin admin] PATH_INFO: `/v3/users/12d07bf03045499a9f8ff4ac6fdff44d` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:26.758536 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc037a4-324f-40ca-86af-1fff33255882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d07bf03045499a9f8ff4ac6fdff44d)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:26.760499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc037a4-324f-40ca-86af-1fff33255882 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:26.805076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2dc037a4-324f-40ca-86af-1fff33255882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d07bf03045499a9f8ff4ac6fdff44d'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:26.812101 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2dc037a4-324f-40ca-86af-1fff33255882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d07bf03045499a9f8ff4ac6fdff44d'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:26.824204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2dc037a4-324f-40ca-86af-1fff33255882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d07bf03045499a9f8ff4ac6fdff44d'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:26.824686 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2dc037a4-324f-40ca-86af-1fff33255882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d07bf03045499a9f8ff4ac6fdff44d'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:26.831992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2dc037a4-324f-40ca-86af-1fff33255882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d07bf03045499a9f8ff4ac6fdff44d'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:26.838473 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1360/2751] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:42:26 2022] DELETE /identity/v3/users/12d07bf03045499a9f8ff4ac6fdff44d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:42:26.843111 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b580c-5d02-4403-bb61-5924dadec38f None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:26.843625 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b580c-5d02-4403-bb61-5924dadec38f None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:26.843734 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b580c-5d02-4403-bb61-5924dadec38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:26.860547 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-890b580c-5d02-4403-bb61-5924dadec38f None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:42:26.861743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-890b580c-5d02-4403-bb61-5924dadec38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:26.919218 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1392/2752] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:42:26.928951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc037a4-324f-40ca-86af-1fff33255882 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:26.930451 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-2dc037a4-324f-40ca-86af-1fff33255882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:26.988568 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc037a4-324f-40ca-86af-1fff33255882 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:26.992250 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab033f8-804d-4476-9203-ab392c9bba69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:26.992894 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab033f8-804d-4476-9203-ab392c9bba69 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:26.993175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab033f8-804d-4476-9203-ab392c9bba69 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:26.993451 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab033f8-804d-4476-9203-ab392c9bba69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:27.002270 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab033f8-804d-4476-9203-ab392c9bba69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:27.003722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab033f8-804d-4476-9203-ab392c9bba69 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:27.013547 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1361/2753] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:42:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:42:27.357198 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b580c-5d02-4403-bb61-5924dadec38f None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:27.358626 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-890b580c-5d02-4403-bb61-5924dadec38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:27.375104 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b580c-5d02-4403-bb61-5924dadec38f None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:27.384079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a137b-fcbf-4d1f-9a0b-124aa269f174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:27.385504 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a137b-fcbf-4d1f-9a0b-124aa269f174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:27.385921 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a137b-fcbf-4d1f-9a0b-124aa269f174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:27.386281 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a137b-fcbf-4d1f-9a0b-124aa269f174 admin admin] PATH_INFO: `/v3/projects/e1e8abb21c4042d9ab70223ea179214b` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:27.387743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a137b-fcbf-4d1f-9a0b-124aa269f174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e8abb21c4042d9ab70223ea179214b)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:27.390149 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a137b-fcbf-4d1f-9a0b-124aa269f174 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:27.437377 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d15a137b-fcbf-4d1f-9a0b-124aa269f174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e8abb21c4042d9ab70223ea179214b', 'request_id': 'req-d15a137b-fcbf-4d1f-9a0b-124aa269f174'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:27.443886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d15a137b-fcbf-4d1f-9a0b-124aa269f174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e8abb21c4042d9ab70223ea179214b', 'request_id': 'req-d15a137b-fcbf-4d1f-9a0b-124aa269f174'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:27.451086 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d15a137b-fcbf-4d1f-9a0b-124aa269f174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e8abb21c4042d9ab70223ea179214b', 'request_id': 'req-d15a137b-fcbf-4d1f-9a0b-124aa269f174'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:27.460820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d15a137b-fcbf-4d1f-9a0b-124aa269f174 admin admin] The token cache is being invalidate because project e1e8abb21c4042d9ab70223ea179214b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:42:27.461099 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d15a137b-fcbf-4d1f-9a0b-124aa269f174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:27.461714 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d15a137b-fcbf-4d1f-9a0b-124aa269f174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:42:27.463300 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1393/2754] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:42:27 2022] DELETE /identity/v3/projects/e1e8abb21c4042d9ab70223ea179214b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:42:27.468143 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3a77f-9832-4350-a605-76e9c53738c8 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:27.468442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3a77f-9832-4350-a605-76e9c53738c8 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:27.468723 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3a77f-9832-4350-a605-76e9c53738c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:27.486317 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-11d3a77f-9832-4350-a605-76e9c53738c8 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:42:27.487557 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-11d3a77f-9832-4350-a605-76e9c53738c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:27.545781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1362/2755] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:42:27.553888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effcc0f-4017-4a8d-a92e-036736f52e7b None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:27.554178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effcc0f-4017-4a8d-a92e-036736f52e7b None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:27.554463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effcc0f-4017-4a8d-a92e-036736f52e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:27.572340 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-0effcc0f-4017-4a8d-a92e-036736f52e7b None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:42:27.573542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-0effcc0f-4017-4a8d-a92e-036736f52e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:27.581412 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1394/2756] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:42:27.585511 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3a77f-9832-4350-a605-76e9c53738c8 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:27.595086 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3a77f-9832-4350-a605-76e9c53738c8 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:27.600124 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c033eb-6794-4036-92d9-ad211ddfcc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:27.600766 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c033eb-6794-4036-92d9-ad211ddfcc42 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:27.601044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c033eb-6794-4036-92d9-ad211ddfcc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:27.601315 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c033eb-6794-4036-92d9-ad211ddfcc42 admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:27.602031 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c033eb-6794-4036-92d9-ad211ddfcc42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:42:27.602332 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c033eb-6794-4036-92d9-ad211ddfcc42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:27.604005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c033eb-6794-4036-92d9-ad211ddfcc42 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:27.615728 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1363/2757] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:42:27.619887 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effcc0f-4017-4a8d-a92e-036736f52e7b None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:27.629579 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effcc0f-4017-4a8d-a92e-036736f52e7b None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:27.634786 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d754c-9ca7-4bc1-ae16-b2b1e5fda56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:27.635501 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d754c-9ca7-4bc1-ae16-b2b1e5fda56c admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:27.635786 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d754c-9ca7-4bc1-ae16-b2b1e5fda56c admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:27.636063 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d754c-9ca7-4bc1-ae16-b2b1e5fda56c admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:27.636801 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d754c-9ca7-4bc1-ae16-b2b1e5fda56c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:27.638716 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d754c-9ca7-4bc1-ae16-b2b1e5fda56c admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:27.665939 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1395/2758] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:42:27 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:42:27.668331 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c033eb-6794-4036-92d9-ad211ddfcc42 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:27.679267 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c033eb-6794-4036-92d9-ad211ddfcc42 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:27.732929 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f316a87-4115-40b5-ae9c-c24e6ae84df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:27.733589 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316a87-4115-40b5-ae9c-c24e6ae84df3 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:27.733869 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316a87-4115-40b5-ae9c-c24e6ae84df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:27.734141 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316a87-4115-40b5-ae9c-c24e6ae84df3 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:27.734864 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f316a87-4115-40b5-ae9c-c24e6ae84df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:27.736790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f316a87-4115-40b5-ae9c-c24e6ae84df3 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:27.757218 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1364/2759] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:42:27 2022] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:42:27.761313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d754c-9ca7-4bc1-ae16-b2b1e5fda56c admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:27.772074 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d754c-9ca7-4bc1-ae16-b2b1e5fda56c admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:27.778355 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31397096-57ee-42f6-b4ad-f18cdf945482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:27.779354 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31397096-57ee-42f6-b4ad-f18cdf945482 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:27.779632 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31397096-57ee-42f6-b4ad-f18cdf945482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:27.779905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31397096-57ee-42f6-b4ad-f18cdf945482 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:27.780758 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31397096-57ee-42f6-b4ad-f18cdf945482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:27.782369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31397096-57ee-42f6-b4ad-f18cdf945482 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:27.793592 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1396/2760] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:42:27.797765 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f316a87-4115-40b5-ae9c-c24e6ae84df3 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:27.807862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f316a87-4115-40b5-ae9c-c24e6ae84df3 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:27.812380 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016682d1-c18b-43d2-8d8e-2766670366fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:27.813018 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016682d1-c18b-43d2-8d8e-2766670366fd admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:27.813296 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016682d1-c18b-43d2-8d8e-2766670366fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:27.813566 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016682d1-c18b-43d2-8d8e-2766670366fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:27.814278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016682d1-c18b-43d2-8d8e-2766670366fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:27.815886 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016682d1-c18b-43d2-8d8e-2766670366fd admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:27.825767 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1365/2761] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:42:27.830469 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31397096-57ee-42f6-b4ad-f18cdf945482 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:27.840781 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31397096-57ee-42f6-b4ad-f18cdf945482 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:27.845416 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704102e-105e-4bc9-8dff-5a6a7c7fc4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:27.846290 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704102e-105e-4bc9-8dff-5a6a7c7fc4dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:27.846568 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704102e-105e-4bc9-8dff-5a6a7c7fc4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:27.846864 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704102e-105e-4bc9-8dff-5a6a7c7fc4dd admin admin] PATH_INFO: `/v3/projects/fbe2f800da33485ebd60119add321748/users/68d4c42599524d15942e159729740d2b/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:27.861333 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704102e-105e-4bc9-8dff-5a6a7c7fc4dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe2f800da33485ebd60119add321748, user_id=68d4c42599524d15942e159729740d2b, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:27.863946 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704102e-105e-4bc9-8dff-5a6a7c7fc4dd admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:27.876623 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1397/2762] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:42:27 2022] PUT /identity/v3/projects/fbe2f800da33485ebd60119add321748/users/68d4c42599524d15942e159729740d2b/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:42:27.887725 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7661abc-499a-458a-b649-b89cc83aa856 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:27.888010 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7661abc-499a-458a-b649-b89cc83aa856 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:27.888282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7661abc-499a-458a-b649-b89cc83aa856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:27.915775 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-e7661abc-499a-458a-b649-b89cc83aa856 None None] MFA Rules not processed for user `68d4c42599524d15942e159729740d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:42:27.917197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-e7661abc-499a-458a-b649-b89cc83aa856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:27.979439 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1366/2763] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:42:27.991004 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704102e-105e-4bc9-8dff-5a6a7c7fc4dd admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:42:27.995065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-d704102e-105e-4bc9-8dff-5a6a7c7fc4dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:42:28.051975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704102e-105e-4bc9-8dff-5a6a7c7fc4dd admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:42:28.055621 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91e1c2-5f48-4cae-9cf0-fbc030b7c1d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:42:28.056258 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91e1c2-5f48-4cae-9cf0-fbc030b7c1d8 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:42:28.056536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91e1c2-5f48-4cae-9cf0-fbc030b7c1d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:42:28.056823 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91e1c2-5f48-4cae-9cf0-fbc030b7c1d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:42:28.064876 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91e1c2-5f48-4cae-9cf0-fbc030b7c1d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:42:28.066290 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91e1c2-5f48-4cae-9cf0-fbc030b7c1d8 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:42:28.074921 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1398/2764] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:42:27 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:43:32.368889 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7661abc-499a-458a-b649-b89cc83aa856 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:32.370400 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-e7661abc-499a-458a-b649-b89cc83aa856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:43:32.430021 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7661abc-499a-458a-b649-b89cc83aa856 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:32.433646 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16eb26-e3ea-4f78-ae07-1c69f94c9b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:32.434244 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16eb26-e3ea-4f78-ae07-1c69f94c9b7b service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:32.434521 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16eb26-e3ea-4f78-ae07-1c69f94c9b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:32.435039 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16eb26-e3ea-4f78-ae07-1c69f94c9b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:32.437246 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-5b16eb26-e3ea-4f78-ae07-1c69f94c9b7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:43:32.501355 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16eb26-e3ea-4f78-ae07-1c69f94c9b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:32.502794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16eb26-e3ea-4f78-ae07-1c69f94c9b7b service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:32.512264 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1367/2765] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:43:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:43:33.000039 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91e1c2-5f48-4cae-9cf0-fbc030b7c1d8 service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:33.001998 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-7a91e1c2-5f48-4cae-9cf0-fbc030b7c1d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:43:33.015703 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91e1c2-5f48-4cae-9cf0-fbc030b7c1d8 service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:33.020888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1be6f-7c09-47ab-a02c-87a68ef3ec95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:33.021751 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1be6f-7c09-47ab-a02c-87a68ef3ec95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:33.022032 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1be6f-7c09-47ab-a02c-87a68ef3ec95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:33.022302 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1be6f-7c09-47ab-a02c-87a68ef3ec95 admin admin] PATH_INFO: `/v3/users/99fb6525fa854bc885f9966f5fc80407` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:33.023517 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1be6f-7c09-47ab-a02c-87a68ef3ec95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99fb6525fa854bc885f9966f5fc80407)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:33.025421 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1be6f-7c09-47ab-a02c-87a68ef3ec95 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:33.072760 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-cce1be6f-7c09-47ab-a02c-87a68ef3ec95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99fb6525fa854bc885f9966f5fc80407'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:33.084146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-cce1be6f-7c09-47ab-a02c-87a68ef3ec95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99fb6525fa854bc885f9966f5fc80407'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:33.084803 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-cce1be6f-7c09-47ab-a02c-87a68ef3ec95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99fb6525fa854bc885f9966f5fc80407'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:33.085394 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-cce1be6f-7c09-47ab-a02c-87a68ef3ec95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99fb6525fa854bc885f9966f5fc80407'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:33.091832 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-cce1be6f-7c09-47ab-a02c-87a68ef3ec95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99fb6525fa854bc885f9966f5fc80407'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:33.104348 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1399/2766] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:43:32 2022] DELETE /identity/v3/users/99fb6525fa854bc885f9966f5fc80407 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:43:33.283560 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16eb26-e3ea-4f78-ae07-1c69f94c9b7b service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:33.294086 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16eb26-e3ea-4f78-ae07-1c69f94c9b7b service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:33.358084 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7984a-fc7a-4716-a61c-f26ab6efc355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:33.358976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7984a-fc7a-4716-a61c-f26ab6efc355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:33.359257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7984a-fc7a-4716-a61c-f26ab6efc355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:33.359526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7984a-fc7a-4716-a61c-f26ab6efc355 admin admin] PATH_INFO: `/v3/projects/96f8297688b74593b49fe8317741dc63` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:33.360722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7984a-fc7a-4716-a61c-f26ab6efc355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96f8297688b74593b49fe8317741dc63)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:33.362604 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7984a-fc7a-4716-a61c-f26ab6efc355 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:33.407638 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-91a7984a-fc7a-4716-a61c-f26ab6efc355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96f8297688b74593b49fe8317741dc63', 'request_id': 'req-91a7984a-fc7a-4716-a61c-f26ab6efc355'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:33.413531 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-91a7984a-fc7a-4716-a61c-f26ab6efc355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96f8297688b74593b49fe8317741dc63', 'request_id': 'req-91a7984a-fc7a-4716-a61c-f26ab6efc355'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:33.419015 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-91a7984a-fc7a-4716-a61c-f26ab6efc355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96f8297688b74593b49fe8317741dc63', 'request_id': 'req-91a7984a-fc7a-4716-a61c-f26ab6efc355'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:33.430878 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-91a7984a-fc7a-4716-a61c-f26ab6efc355 admin admin] The token cache is being invalidate because project 96f8297688b74593b49fe8317741dc63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:43:33.431167 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-91a7984a-fc7a-4716-a61c-f26ab6efc355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:33.431788 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-91a7984a-fc7a-4716-a61c-f26ab6efc355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:33.433321 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1368/2767] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:43:33 2022] DELETE /identity/v3/projects/96f8297688b74593b49fe8317741dc63 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:43:34.380975 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1be6f-7c09-47ab-a02c-87a68ef3ec95 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:34.382403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-cce1be6f-7c09-47ab-a02c-87a68ef3ec95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:43:34.395209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1be6f-7c09-47ab-a02c-87a68ef3ec95 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:34.449308 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05925e2e-b29d-461c-bd92-7d2b1294dbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:34.450179 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05925e2e-b29d-461c-bd92-7d2b1294dbd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:34.450459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05925e2e-b29d-461c-bd92-7d2b1294dbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:34.450738 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05925e2e-b29d-461c-bd92-7d2b1294dbd2 admin admin] PATH_INFO: `/v3/users/68d4c42599524d15942e159729740d2b` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:34.451948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05925e2e-b29d-461c-bd92-7d2b1294dbd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d4c42599524d15942e159729740d2b)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:34.453853 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05925e2e-b29d-461c-bd92-7d2b1294dbd2 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:34.500163 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-05925e2e-b29d-461c-bd92-7d2b1294dbd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d4c42599524d15942e159729740d2b'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:34.513874 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-05925e2e-b29d-461c-bd92-7d2b1294dbd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d4c42599524d15942e159729740d2b'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:34.514700 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-05925e2e-b29d-461c-bd92-7d2b1294dbd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d4c42599524d15942e159729740d2b'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:34.515572 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-05925e2e-b29d-461c-bd92-7d2b1294dbd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d4c42599524d15942e159729740d2b'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:34.523013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-05925e2e-b29d-461c-bd92-7d2b1294dbd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d4c42599524d15942e159729740d2b'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:34.536643 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1400/2768] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:43:34 2022] DELETE /identity/v3/users/68d4c42599524d15942e159729740d2b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:43:34.541284 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22e783-e9de-4726-9bcd-117a33e6c97c None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:34.541770 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22e783-e9de-4726-9bcd-117a33e6c97c None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:34.541858 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22e783-e9de-4726-9bcd-117a33e6c97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:34.559205 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-8b22e783-e9de-4726-9bcd-117a33e6c97c None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:43:34.560396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-8b22e783-e9de-4726-9bcd-117a33e6c97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:43:34.617812 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1369/2769] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:43:34.627571 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05925e2e-b29d-461c-bd92-7d2b1294dbd2 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:34.628988 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-05925e2e-b29d-461c-bd92-7d2b1294dbd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:43:34.686920 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05925e2e-b29d-461c-bd92-7d2b1294dbd2 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:34.690699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47f7a9-993d-48f0-bb03-e55094b6726d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:34.691368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47f7a9-993d-48f0-bb03-e55094b6726d service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:34.691646 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47f7a9-993d-48f0-bb03-e55094b6726d service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:34.691919 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47f7a9-993d-48f0-bb03-e55094b6726d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:34.700688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47f7a9-993d-48f0-bb03-e55094b6726d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:34.702108 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47f7a9-993d-48f0-bb03-e55094b6726d service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:34.711903 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1401/2770] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:43:34.975835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22e783-e9de-4726-9bcd-117a33e6c97c None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:34.977240 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-8b22e783-e9de-4726-9bcd-117a33e6c97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:43:34.990528 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22e783-e9de-4726-9bcd-117a33e6c97c None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:34.995338 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e357549-493f-4f10-90f0-4902cb7a3859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:34.996234 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e357549-493f-4f10-90f0-4902cb7a3859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:34.996519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e357549-493f-4f10-90f0-4902cb7a3859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:34.996801 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e357549-493f-4f10-90f0-4902cb7a3859 admin admin] PATH_INFO: `/v3/projects/fbe2f800da33485ebd60119add321748` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:34.997987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e357549-493f-4f10-90f0-4902cb7a3859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe2f800da33485ebd60119add321748)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:34.999977 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e357549-493f-4f10-90f0-4902cb7a3859 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:35.045188 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9e357549-493f-4f10-90f0-4902cb7a3859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe2f800da33485ebd60119add321748', 'request_id': 'req-9e357549-493f-4f10-90f0-4902cb7a3859'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:35.051197 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9e357549-493f-4f10-90f0-4902cb7a3859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe2f800da33485ebd60119add321748', 'request_id': 'req-9e357549-493f-4f10-90f0-4902cb7a3859'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:35.057018 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9e357549-493f-4f10-90f0-4902cb7a3859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe2f800da33485ebd60119add321748', 'request_id': 'req-9e357549-493f-4f10-90f0-4902cb7a3859'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:35.069444 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9e357549-493f-4f10-90f0-4902cb7a3859 admin admin] The token cache is being invalidate because project fbe2f800da33485ebd60119add321748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:43:35.069733 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9e357549-493f-4f10-90f0-4902cb7a3859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:35.070360 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9e357549-493f-4f10-90f0-4902cb7a3859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:35.072064 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1370/2771] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:43:34 2022] DELETE /identity/v3/projects/fbe2f800da33485ebd60119add321748 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:43:35.077006 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b0714-5968-4966-9e3b-486c6bddd75b None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:35.077302 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b0714-5968-4966-9e3b-486c6bddd75b None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:35.077598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b0714-5968-4966-9e3b-486c6bddd75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:35.095154 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-d46b0714-5968-4966-9e3b-486c6bddd75b None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:43:35.096380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-d46b0714-5968-4966-9e3b-486c6bddd75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:43:35.155864 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1402/2772] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:43:35.164006 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a902d-ff13-43fc-8e6a-29138f0c19a7 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:35.164290 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a902d-ff13-43fc-8e6a-29138f0c19a7 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:35.164565 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a902d-ff13-43fc-8e6a-29138f0c19a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:35.182357 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-633a902d-ff13-43fc-8e6a-29138f0c19a7 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:43:35.183656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-633a902d-ff13-43fc-8e6a-29138f0c19a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:43:35.197097 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1371/2773] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:43:35.201383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b0714-5968-4966-9e3b-486c6bddd75b None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:35.211550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b0714-5968-4966-9e3b-486c6bddd75b None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:35.216098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c0e94-b2af-4003-82d8-0c8acc1c072d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:35.216747 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c0e94-b2af-4003-82d8-0c8acc1c072d admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:35.217028 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c0e94-b2af-4003-82d8-0c8acc1c072d admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:35.217297 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c0e94-b2af-4003-82d8-0c8acc1c072d admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:35.218014 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c0e94-b2af-4003-82d8-0c8acc1c072d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:43:35.218317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c0e94-b2af-4003-82d8-0c8acc1c072d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:35.220092 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c0e94-b2af-4003-82d8-0c8acc1c072d admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:35.231380 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1403/2774] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 15:43:35.235845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a902d-ff13-43fc-8e6a-29138f0c19a7 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:35.245037 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a902d-ff13-43fc-8e6a-29138f0c19a7 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:35.249651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489f1aa-b26d-4cdf-a367-2bacb9be10e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:35.250316 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489f1aa-b26d-4cdf-a367-2bacb9be10e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:35.250593 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489f1aa-b26d-4cdf-a367-2bacb9be10e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:35.251443 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489f1aa-b26d-4cdf-a367-2bacb9be10e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:35.252128 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489f1aa-b26d-4cdf-a367-2bacb9be10e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:35.254021 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489f1aa-b26d-4cdf-a367-2bacb9be10e6 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:35.281122 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1372/2775] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:43:35 2022] POST /identity/v3/projects => generated 397 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:43:35.285371 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c0e94-b2af-4003-82d8-0c8acc1c072d admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:35.295169 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c0e94-b2af-4003-82d8-0c8acc1c072d admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:35.348413 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6a77a-0039-41a3-b701-e90603c7448c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:35.349107 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6a77a-0039-41a3-b701-e90603c7448c admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:35.349389 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6a77a-0039-41a3-b701-e90603c7448c admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:35.349664 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6a77a-0039-41a3-b701-e90603c7448c admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:35.350338 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6a77a-0039-41a3-b701-e90603c7448c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:35.352346 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6a77a-0039-41a3-b701-e90603c7448c admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:35.372095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1404/2776] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:43:35 2022] POST /identity/v3/users => generated 299 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:43:35.376881 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489f1aa-b26d-4cdf-a367-2bacb9be10e6 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:35.387196 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489f1aa-b26d-4cdf-a367-2bacb9be10e6 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:35.391784 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f02a9-b3e6-4e3b-8624-7f02500c5573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:35.392433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f02a9-b3e6-4e3b-8624-7f02500c5573 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:35.392714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f02a9-b3e6-4e3b-8624-7f02500c5573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:35.392987 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f02a9-b3e6-4e3b-8624-7f02500c5573 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:35.393739 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f02a9-b3e6-4e3b-8624-7f02500c5573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:35.395417 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f02a9-b3e6-4e3b-8624-7f02500c5573 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:35.405832 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1373/2777] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:43:35.409554 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6a77a-0039-41a3-b701-e90603c7448c admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:35.419225 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6a77a-0039-41a3-b701-e90603c7448c admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:35.424312 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d089cd-11ef-4a32-a8aa-3d0cb114d8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:35.424962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d089cd-11ef-4a32-a8aa-3d0cb114d8eb admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:35.425244 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d089cd-11ef-4a32-a8aa-3d0cb114d8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:35.425515 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d089cd-11ef-4a32-a8aa-3d0cb114d8eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:35.426237 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d089cd-11ef-4a32-a8aa-3d0cb114d8eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:35.427842 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d089cd-11ef-4a32-a8aa-3d0cb114d8eb admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:35.437480 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1405/2778] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:43:35.441515 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f02a9-b3e6-4e3b-8624-7f02500c5573 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:35.451271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f02a9-b3e6-4e3b-8624-7f02500c5573 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:35.456448 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40c30b-292a-410a-8bb5-aea5891aaa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:35.457309 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40c30b-292a-410a-8bb5-aea5891aaa03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:35.457587 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40c30b-292a-410a-8bb5-aea5891aaa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:35.457857 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40c30b-292a-410a-8bb5-aea5891aaa03 admin admin] PATH_INFO: `/v3/projects/6c2edc074bfc49f1b3da481ec918c9d3/users/bbd8d910e2ee46439b2b1387a32929f9/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:35.472129 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40c30b-292a-410a-8bb5-aea5891aaa03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2edc074bfc49f1b3da481ec918c9d3, user_id=bbd8d910e2ee46439b2b1387a32929f9, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:35.474763 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40c30b-292a-410a-8bb5-aea5891aaa03 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:35.487962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1374/2779] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:43:35 2022] PUT /identity/v3/projects/6c2edc074bfc49f1b3da481ec918c9d3/users/bbd8d910e2ee46439b2b1387a32929f9/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:43:35.498966 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed784e77-9402-4a2c-ad98-626211733834 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:35.499256 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed784e77-9402-4a2c-ad98-626211733834 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:35.499539 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed784e77-9402-4a2c-ad98-626211733834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:35.526653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-ed784e77-9402-4a2c-ad98-626211733834 None None] MFA Rules not processed for user `bbd8d910e2ee46439b2b1387a32929f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:43:35.528155 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ed784e77-9402-4a2c-ad98-626211733834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:43:35.590930 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1406/2780] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:43:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:43:35.602869 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40c30b-292a-410a-8bb5-aea5891aaa03 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:35.604536 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ea40c30b-292a-410a-8bb5-aea5891aaa03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:43:35.660615 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40c30b-292a-410a-8bb5-aea5891aaa03 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:35.664630 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebaa1a-2cfa-42ec-a8ea-e8448bc51a4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:35.665314 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebaa1a-2cfa-42ec-a8ea-e8448bc51a4e service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:35.665601 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebaa1a-2cfa-42ec-a8ea-e8448bc51a4e service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:35.665880 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebaa1a-2cfa-42ec-a8ea-e8448bc51a4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:35.674991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebaa1a-2cfa-42ec-a8ea-e8448bc51a4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:35.676433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebaa1a-2cfa-42ec-a8ea-e8448bc51a4e service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:35.685402 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1375/2781] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:43:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:43:44.724026 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed784e77-9402-4a2c-ad98-626211733834 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:44.784514 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed784e77-9402-4a2c-ad98-626211733834 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:44.789161 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f09d5c-f2ed-419f-91ee-7a4c4b8ab3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:44.790033 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f09d5c-f2ed-419f-91ee-7a4c4b8ab3cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:44.790315 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f09d5c-f2ed-419f-91ee-7a4c4b8ab3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:44.790592 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f09d5c-f2ed-419f-91ee-7a4c4b8ab3cb admin admin] PATH_INFO: `/v3/users/bbd8d910e2ee46439b2b1387a32929f9` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:44.791814 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f09d5c-f2ed-419f-91ee-7a4c4b8ab3cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd8d910e2ee46439b2b1387a32929f9)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:44.793727 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f09d5c-f2ed-419f-91ee-7a4c4b8ab3cb admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:44.839596 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e4f09d5c-f2ed-419f-91ee-7a4c4b8ab3cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd8d910e2ee46439b2b1387a32929f9'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:44.850977 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e4f09d5c-f2ed-419f-91ee-7a4c4b8ab3cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd8d910e2ee46439b2b1387a32929f9'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:44.851660 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e4f09d5c-f2ed-419f-91ee-7a4c4b8ab3cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd8d910e2ee46439b2b1387a32929f9'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:44.852247 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e4f09d5c-f2ed-419f-91ee-7a4c4b8ab3cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd8d910e2ee46439b2b1387a32929f9'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:44.858746 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-e4f09d5c-f2ed-419f-91ee-7a4c4b8ab3cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd8d910e2ee46439b2b1387a32929f9'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:44.872451 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1407/2782] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:43:44 2022] DELETE /identity/v3/users/bbd8d910e2ee46439b2b1387a32929f9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:43:44.877523 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40b155-06e0-4ea8-ab18-0d8e45454be2 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:44.878023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40b155-06e0-4ea8-ab18-0d8e45454be2 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:44.878107 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40b155-06e0-4ea8-ab18-0d8e45454be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:44.898668 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-6f40b155-06e0-4ea8-ab18-0d8e45454be2 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:43:44.900116 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6f40b155-06e0-4ea8-ab18-0d8e45454be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:43:44.958909 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1376/2783] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:43:44.968680 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f09d5c-f2ed-419f-91ee-7a4c4b8ab3cb admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:44.970109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-e4f09d5c-f2ed-419f-91ee-7a4c4b8ab3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:43:45.024625 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f09d5c-f2ed-419f-91ee-7a4c4b8ab3cb admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:45.028523 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d6126-7aa8-42fd-a520-43408c7ac0b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:45.029164 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d6126-7aa8-42fd-a520-43408c7ac0b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:45.029464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d6126-7aa8-42fd-a520-43408c7ac0b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:45.029743 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d6126-7aa8-42fd-a520-43408c7ac0b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:45.038974 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d6126-7aa8-42fd-a520-43408c7ac0b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:45.040403 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d6126-7aa8-42fd-a520-43408c7ac0b2 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:45.050634 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1408/2784] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:43:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:43:45.311702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40b155-06e0-4ea8-ab18-0d8e45454be2 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:45.313776 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6f40b155-06e0-4ea8-ab18-0d8e45454be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:43:45.326591 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40b155-06e0-4ea8-ab18-0d8e45454be2 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:45.331835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1eb09e-84ea-4e3b-a14c-89ae97c09990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:45.332707 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1eb09e-84ea-4e3b-a14c-89ae97c09990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:45.333120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1eb09e-84ea-4e3b-a14c-89ae97c09990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:45.333413 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1eb09e-84ea-4e3b-a14c-89ae97c09990 admin admin] PATH_INFO: `/v3/projects/6c2edc074bfc49f1b3da481ec918c9d3` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:45.334630 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1eb09e-84ea-4e3b-a14c-89ae97c09990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c2edc074bfc49f1b3da481ec918c9d3)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:45.336612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1eb09e-84ea-4e3b-a14c-89ae97c09990 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:45.384662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9d1eb09e-84ea-4e3b-a14c-89ae97c09990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c2edc074bfc49f1b3da481ec918c9d3', 'request_id': 'req-9d1eb09e-84ea-4e3b-a14c-89ae97c09990'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:45.391024 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9d1eb09e-84ea-4e3b-a14c-89ae97c09990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c2edc074bfc49f1b3da481ec918c9d3', 'request_id': 'req-9d1eb09e-84ea-4e3b-a14c-89ae97c09990'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:45.396346 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9d1eb09e-84ea-4e3b-a14c-89ae97c09990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c2edc074bfc49f1b3da481ec918c9d3', 'request_id': 'req-9d1eb09e-84ea-4e3b-a14c-89ae97c09990'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:45.408991 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9d1eb09e-84ea-4e3b-a14c-89ae97c09990 admin admin] The token cache is being invalidate because project 6c2edc074bfc49f1b3da481ec918c9d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:43:45.409275 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9d1eb09e-84ea-4e3b-a14c-89ae97c09990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:45.409892 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-9d1eb09e-84ea-4e3b-a14c-89ae97c09990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:43:45.411454 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1377/2785] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:43:45 2022] DELETE /identity/v3/projects/6c2edc074bfc49f1b3da481ec918c9d3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:43:45.416495 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ed0f2-de5e-4550-8101-490f27d8d5a3 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:45.416848 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ed0f2-de5e-4550-8101-490f27d8d5a3 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:45.417205 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ed0f2-de5e-4550-8101-490f27d8d5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:45.435021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-271ed0f2-de5e-4550-8101-490f27d8d5a3 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:43:45.436214 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-271ed0f2-de5e-4550-8101-490f27d8d5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:43:45.493392 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1409/2786] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:43:45.501618 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7457ca-ba75-4998-a5b8-34fb6c8e56f5 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:45.501905 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7457ca-ba75-4998-a5b8-34fb6c8e56f5 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:45.502181 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7457ca-ba75-4998-a5b8-34fb6c8e56f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:45.520253 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-ee7457ca-ba75-4998-a5b8-34fb6c8e56f5 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:43:45.521442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ee7457ca-ba75-4998-a5b8-34fb6c8e56f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:43:45.529525 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1378/2787] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:43:45.534362 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ed0f2-de5e-4550-8101-490f27d8d5a3 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:45.544109 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ed0f2-de5e-4550-8101-490f27d8d5a3 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:45.549268 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40f251-164d-4e41-90b3-5ae0b5c096e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:45.549917 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40f251-164d-4e41-90b3-5ae0b5c096e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:45.550193 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40f251-164d-4e41-90b3-5ae0b5c096e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:45.550463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40f251-164d-4e41-90b3-5ae0b5c096e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:45.551285 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40f251-164d-4e41-90b3-5ae0b5c096e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:43:45.551584 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40f251-164d-4e41-90b3-5ae0b5c096e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:45.553173 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40f251-164d-4e41-90b3-5ae0b5c096e7 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:45.564304 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1410/2788] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:43:45.568555 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7457ca-ba75-4998-a5b8-34fb6c8e56f5 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:45.577570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7457ca-ba75-4998-a5b8-34fb6c8e56f5 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:45.582220 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259df2a-8d9c-4e11-9a3a-da67387cd8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:45.582914 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259df2a-8d9c-4e11-9a3a-da67387cd8fe admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:45.583198 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259df2a-8d9c-4e11-9a3a-da67387cd8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:45.583476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259df2a-8d9c-4e11-9a3a-da67387cd8fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:45.584156 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259df2a-8d9c-4e11-9a3a-da67387cd8fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:45.586089 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259df2a-8d9c-4e11-9a3a-da67387cd8fe admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:45.613071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1379/2789] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:43:45 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:43:45.616939 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40f251-164d-4e41-90b3-5ae0b5c096e7 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:45.626433 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40f251-164d-4e41-90b3-5ae0b5c096e7 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:45.679169 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64e216-11ad-4849-b974-dbf96d5bf3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:45.679824 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64e216-11ad-4849-b974-dbf96d5bf3e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:45.680102 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64e216-11ad-4849-b974-dbf96d5bf3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:45.680374 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64e216-11ad-4849-b974-dbf96d5bf3e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:45.681065 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64e216-11ad-4849-b974-dbf96d5bf3e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:45.683451 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64e216-11ad-4849-b974-dbf96d5bf3e3 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:45.701617 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1411/2790] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:43:45 2022] POST /identity/v3/users => generated 287 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:43:45.705734 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259df2a-8d9c-4e11-9a3a-da67387cd8fe admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:45.715803 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259df2a-8d9c-4e11-9a3a-da67387cd8fe admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:45.720884 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97cb25-53b3-4f49-ac00-58a1b394619a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:45.721536 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97cb25-53b3-4f49-ac00-58a1b394619a admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:45.721820 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97cb25-53b3-4f49-ac00-58a1b394619a admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:45.722094 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97cb25-53b3-4f49-ac00-58a1b394619a admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:45.722814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97cb25-53b3-4f49-ac00-58a1b394619a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:45.724437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97cb25-53b3-4f49-ac00-58a1b394619a admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:45.735438 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1380/2791] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:43:45.739108 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64e216-11ad-4849-b974-dbf96d5bf3e3 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:45.748967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64e216-11ad-4849-b974-dbf96d5bf3e3 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:45.753964 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d2df2-497b-4849-b950-0415f402ce64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:45.754625 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d2df2-497b-4849-b950-0415f402ce64 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:45.754940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d2df2-497b-4849-b950-0415f402ce64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:45.755220 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d2df2-497b-4849-b950-0415f402ce64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:45.755980 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d2df2-497b-4849-b950-0415f402ce64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:45.757562 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d2df2-497b-4849-b950-0415f402ce64 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:45.768768 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1412/2792] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:43:45.773011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97cb25-53b3-4f49-ac00-58a1b394619a admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:45.783849 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97cb25-53b3-4f49-ac00-58a1b394619a admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:45.788482 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e164f7-f3b5-4af0-bad9-e7eb84740329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:45.789343 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e164f7-f3b5-4af0-bad9-e7eb84740329 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:45.789617 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e164f7-f3b5-4af0-bad9-e7eb84740329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:45.789883 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e164f7-f3b5-4af0-bad9-e7eb84740329 admin admin] PATH_INFO: `/v3/projects/46f4825db9e745b4bc1f167937dda229/users/cb5eb88bdfdb4df784e194336de814c1/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:45.803887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e164f7-f3b5-4af0-bad9-e7eb84740329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46f4825db9e745b4bc1f167937dda229, user_id=cb5eb88bdfdb4df784e194336de814c1, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:45.806504 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e164f7-f3b5-4af0-bad9-e7eb84740329 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:45.818688 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1381/2793] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:43:45 2022] PUT /identity/v3/projects/46f4825db9e745b4bc1f167937dda229/users/cb5eb88bdfdb4df784e194336de814c1/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:43:45.823886 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571def6-114b-4fdb-910c-fb10e239ead5 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:45.824178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571def6-114b-4fdb-910c-fb10e239ead5 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:45.824458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571def6-114b-4fdb-910c-fb10e239ead5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:45.843136 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-1571def6-114b-4fdb-910c-fb10e239ead5 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:43:45.844905 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-1571def6-114b-4fdb-910c-fb10e239ead5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:43:45.900825 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1413/2794] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:43:45.911027 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e164f7-f3b5-4af0-bad9-e7eb84740329 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:45.912769 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-73e164f7-f3b5-4af0-bad9-e7eb84740329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:43:45.974734 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e164f7-f3b5-4af0-bad9-e7eb84740329 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:45.978372 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381120f-0fef-4d06-afbe-27499afb1945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:45.979046 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381120f-0fef-4d06-afbe-27499afb1945 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:45.979330 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381120f-0fef-4d06-afbe-27499afb1945 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:45.979608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381120f-0fef-4d06-afbe-27499afb1945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:45.988461 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381120f-0fef-4d06-afbe-27499afb1945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:45.989880 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381120f-0fef-4d06-afbe-27499afb1945 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:45.999239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1382/2795] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:43:50.009833 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff26b7-1a7d-4cfc-8662-2a304e53745c None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:50.010370 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff26b7-1a7d-4cfc-8662-2a304e53745c None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:50.010370 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff26b7-1a7d-4cfc-8662-2a304e53745c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:50.044239 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-2fff26b7-1a7d-4cfc-8662-2a304e53745c None None] MFA Rules not processed for user `cb5eb88bdfdb4df784e194336de814c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:43:50.045533 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-2fff26b7-1a7d-4cfc-8662-2a304e53745c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:43:50.115537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1414/2796] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:43:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:43:50.120061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381120f-0fef-4d06-afbe-27499afb1945 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:50.132234 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381120f-0fef-4d06-afbe-27499afb1945 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:50.137235 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195a027-5fc1-4d2c-9555-0b6d69e6a83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:50.137901 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195a027-5fc1-4d2c-9555-0b6d69e6a83b admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:50.138187 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195a027-5fc1-4d2c-9555-0b6d69e6a83b admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:50.138470 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195a027-5fc1-4d2c-9555-0b6d69e6a83b admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:50.139196 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195a027-5fc1-4d2c-9555-0b6d69e6a83b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:50.141150 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195a027-5fc1-4d2c-9555-0b6d69e6a83b admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:50.174055 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1383/2797] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:43:50 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:43:50.178546 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff26b7-1a7d-4cfc-8662-2a304e53745c None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:50.190185 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff26b7-1a7d-4cfc-8662-2a304e53745c None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:50.264893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87af39-efe6-4368-a42b-88485ee910cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:50.266160 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87af39-efe6-4368-a42b-88485ee910cf admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:50.266442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87af39-efe6-4368-a42b-88485ee910cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:50.266744 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87af39-efe6-4368-a42b-88485ee910cf admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:50.267468 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87af39-efe6-4368-a42b-88485ee910cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:50.269445 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87af39-efe6-4368-a42b-88485ee910cf admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:50.294866 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1415/2798] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:43:50 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:43:50.298850 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195a027-5fc1-4d2c-9555-0b6d69e6a83b admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:50.310740 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195a027-5fc1-4d2c-9555-0b6d69e6a83b admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:50.315959 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82327d2-6a5b-4f5b-908e-36506f90d981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:50.316918 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82327d2-6a5b-4f5b-908e-36506f90d981 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:50.317205 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82327d2-6a5b-4f5b-908e-36506f90d981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:50.317485 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82327d2-6a5b-4f5b-908e-36506f90d981 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:50.318225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82327d2-6a5b-4f5b-908e-36506f90d981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:50.319915 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82327d2-6a5b-4f5b-908e-36506f90d981 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:50.334366 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1384/2799] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:43:50.339820 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87af39-efe6-4368-a42b-88485ee910cf admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:50.358808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87af39-efe6-4368-a42b-88485ee910cf admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:50.364106 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427675b-108d-4774-8f4a-983a291fd588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:50.365003 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427675b-108d-4774-8f4a-983a291fd588 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:50.365283 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427675b-108d-4774-8f4a-983a291fd588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:50.365707 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427675b-108d-4774-8f4a-983a291fd588 admin admin] PATH_INFO: `/v3/projects/070083eee2c7411e97ad7b68acf09e4e/users/619ec8aef78e4af5a32085cfaee7224a/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:50.383472 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427675b-108d-4774-8f4a-983a291fd588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=070083eee2c7411e97ad7b68acf09e4e, user_id=619ec8aef78e4af5a32085cfaee7224a, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:50.386377 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427675b-108d-4774-8f4a-983a291fd588 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:50.404856 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1416/2800] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:43:50 2022] PUT /identity/v3/projects/070083eee2c7411e97ad7b68acf09e4e/users/619ec8aef78e4af5a32085cfaee7224a/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:43:50.408736 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82327d2-6a5b-4f5b-908e-36506f90d981 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:50.424954 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82327d2-6a5b-4f5b-908e-36506f90d981 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:50.511843 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ecf9b-e41a-4c21-8c35-faa95b78b592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:50.512742 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ecf9b-e41a-4c21-8c35-faa95b78b592 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:50.513060 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ecf9b-e41a-4c21-8c35-faa95b78b592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:50.513400 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ecf9b-e41a-4c21-8c35-faa95b78b592 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:50.514500 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ecf9b-e41a-4c21-8c35-faa95b78b592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:50.516813 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ecf9b-e41a-4c21-8c35-faa95b78b592 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:50.528252 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1385/2801] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:43:50.533307 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427675b-108d-4774-8f4a-983a291fd588 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:50.546734 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427675b-108d-4774-8f4a-983a291fd588 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:50.551872 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f75d0-2ac3-456a-ad42-dcc705a32646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:50.552949 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f75d0-2ac3-456a-ad42-dcc705a32646 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:50.553327 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f75d0-2ac3-456a-ad42-dcc705a32646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:50.553695 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f75d0-2ac3-456a-ad42-dcc705a32646 admin admin] PATH_INFO: `/v3/projects/070083eee2c7411e97ad7b68acf09e4e/users/619ec8aef78e4af5a32085cfaee7224a/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:50.556130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f75d0-2ac3-456a-ad42-dcc705a32646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=070083eee2c7411e97ad7b68acf09e4e, user_id=619ec8aef78e4af5a32085cfaee7224a, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:50.559076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f75d0-2ac3-456a-ad42-dcc705a32646 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:50.570688 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1417/2802] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:43:50 2022] PUT /identity/v3/projects/070083eee2c7411e97ad7b68acf09e4e/users/619ec8aef78e4af5a32085cfaee7224a/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:43:55.250973 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8533592-1045-4d68-9ce9-c8ff1cf1b809 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:55.251526 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8533592-1045-4d68-9ce9-c8ff1cf1b809 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:55.252139 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8533592-1045-4d68-9ce9-c8ff1cf1b809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:55.284695 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-d8533592-1045-4d68-9ce9-c8ff1cf1b809 None None] MFA Rules not processed for user `619ec8aef78e4af5a32085cfaee7224a`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:43:55.286527 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-d8533592-1045-4d68-9ce9-c8ff1cf1b809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:43:55.364871 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1386/2803] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:43:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:43:55.380168 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f75d0-2ac3-456a-ad42-dcc705a32646 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:43:55.382017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-113f75d0-2ac3-456a-ad42-dcc705a32646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:43:55.461756 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f75d0-2ac3-456a-ad42-dcc705a32646 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:43:55.473526 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082f64f-ee6c-4b38-a602-0c84a82f1b6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:43:55.474521 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082f64f-ee6c-4b38-a602-0c84a82f1b6a service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:55.474808 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082f64f-ee6c-4b38-a602-0c84a82f1b6a service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:55.475257 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082f64f-ee6c-4b38-a602-0c84a82f1b6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:55.538959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082f64f-ee6c-4b38-a602-0c84a82f1b6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:43:55.540684 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082f64f-ee6c-4b38-a602-0c84a82f1b6a service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:43:55.553928 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1418/2804] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:43:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:43:56.596501 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de302e2d-a91c-44e3-9754-2b18d38f9bb5 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:43:56.596983 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de302e2d-a91c-44e3-9754-2b18d38f9bb5 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:43:56.597068 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de302e2d-a91c-44e3-9754-2b18d38f9bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:43:56.614861 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-de302e2d-a91c-44e3-9754-2b18d38f9bb5 None None] MFA Rules not processed for user `cb5eb88bdfdb4df784e194336de814c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:43:56.616055 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-de302e2d-a91c-44e3-9754-2b18d38f9bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:43:56.623029 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1387/2805] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:43:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:44:07.412634 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082f64f-ee6c-4b38-a602-0c84a82f1b6a service nova] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:44:07.414114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-6082f64f-ee6c-4b38-a602-0c84a82f1b6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:44:07.489861 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082f64f-ee6c-4b38-a602-0c84a82f1b6a service nova] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:44:07.493656 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0b664-f84a-49a3-8e8f-909f1d669a1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:44:07.494313 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0b664-f84a-49a3-8e8f-909f1d669a1e service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:44:07.494593 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0b664-f84a-49a3-8e8f-909f1d669a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:44:07.494898 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0b664-f84a-49a3-8e8f-909f1d669a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:44:07.496691 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-49d0b664-f84a-49a3-8e8f-909f1d669a1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:44:07.506563 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0b664-f84a-49a3-8e8f-909f1d669a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:44:07.508117 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0b664-f84a-49a3-8e8f-909f1d669a1e service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:44:07.516755 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1419/2806] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:44:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:44:10.661417 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de302e2d-a91c-44e3-9754-2b18d38f9bb5 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:44:10.662782 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-de302e2d-a91c-44e3-9754-2b18d38f9bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:44:10.743147 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de302e2d-a91c-44e3-9754-2b18d38f9bb5 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:44:10.748094 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b5320-ac6d-46c7-970f-89d67a930240 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908d23b035f14756b438b3a61a63b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:44:10.748736 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b5320-ac6d-46c7-970f-89d67a930240 service placement] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:44:10.749020 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b5320-ac6d-46c7-970f-89d67a930240 service placement] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:44:10.749295 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b5320-ac6d-46c7-970f-89d67a930240 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:44:10.751039 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-d18b5320-ac6d-46c7-970f-89d67a930240 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:44:10.762291 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b5320-ac6d-46c7-970f-89d67a930240 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:44:10.763899 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b5320-ac6d-46c7-970f-89d67a930240 service placement] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:44:10.773476 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1388/2807] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:44:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:44:13.746157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0b664-f84a-49a3-8e8f-909f1d669a1e service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:44:13.747653 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-49d0b664-f84a-49a3-8e8f-909f1d669a1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:44:13.763655 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0b664-f84a-49a3-8e8f-909f1d669a1e service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:44:13.769816 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c854b6-6980-4943-9d9b-1b39b03f3752 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:44:13.770455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c854b6-6980-4943-9d9b-1b39b03f3752 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:44:13.770748 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c854b6-6980-4943-9d9b-1b39b03f3752 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:44:13.771053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c854b6-6980-4943-9d9b-1b39b03f3752 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:44:13.772888 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-79c854b6-6980-4943-9d9b-1b39b03f3752 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:44:13.829278 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c854b6-6980-4943-9d9b-1b39b03f3752 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:44:13.830903 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c854b6-6980-4943-9d9b-1b39b03f3752 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:44:13.840062 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1420/2808] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:44:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:44:13.891569 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b5320-ac6d-46c7-970f-89d67a930240 service placement] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:44:13.892947 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-d18b5320-ac6d-46c7-970f-89d67a930240 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:44:13.948790 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b5320-ac6d-46c7-970f-89d67a930240 service placement] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:44:13.952591 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2849d-d7cb-4ab9-95a8-462f06fbd704 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:44:13.953233 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2849d-d7cb-4ab9-95a8-462f06fbd704 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:44:13.953516 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2849d-d7cb-4ab9-95a8-462f06fbd704 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:44:13.953794 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2849d-d7cb-4ab9-95a8-462f06fbd704 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:44:13.955548 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-8af2849d-d7cb-4ab9-95a8-462f06fbd704 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:44:13.972153 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2849d-d7cb-4ab9-95a8-462f06fbd704 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:44:13.974657 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2849d-d7cb-4ab9-95a8-462f06fbd704 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:44:13.988784 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1389/2809] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:44:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:44:17.600460 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c854b6-6980-4943-9d9b-1b39b03f3752 service nova] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:44:17.610372 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c854b6-6980-4943-9d9b-1b39b03f3752 service nova] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:44:17.613950 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98823286-7511-4f91-addf-88e506098d4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:44:17.614586 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98823286-7511-4f91-addf-88e506098d4e service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:44:17.614997 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98823286-7511-4f91-addf-88e506098d4e service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:44:17.615286 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98823286-7511-4f91-addf-88e506098d4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:44:17.617099 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-98823286-7511-4f91-addf-88e506098d4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:44:17.630353 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98823286-7511-4f91-addf-88e506098d4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:44:17.631817 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98823286-7511-4f91-addf-88e506098d4e service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:44:17.643863 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1421/2810] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:44:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:44:21.508852 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2849d-d7cb-4ab9-95a8-462f06fbd704 service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:44:21.519091 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2849d-d7cb-4ab9-95a8-462f06fbd704 service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:44:21.522605 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62ddd5-1734-48d7-8f1e-7fa9630c167b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:44:21.523282 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62ddd5-1734-48d7-8f1e-7fa9630c167b service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:44:21.523564 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62ddd5-1734-48d7-8f1e-7fa9630c167b service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:44:21.523840 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62ddd5-1734-48d7-8f1e-7fa9630c167b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:44:21.525632 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-cb62ddd5-1734-48d7-8f1e-7fa9630c167b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:44:21.536114 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62ddd5-1734-48d7-8f1e-7fa9630c167b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:44:21.537530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62ddd5-1734-48d7-8f1e-7fa9630c167b service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:44:21.545380 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1390/2811] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:44:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:44:21.980082 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98823286-7511-4f91-addf-88e506098d4e service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:44:21.981433 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-98823286-7511-4f91-addf-88e506098d4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:44:21.995541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98823286-7511-4f91-addf-88e506098d4e service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:44:22.001327 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12302b64-33f9-4c9d-8782-35e7d3f2db00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908d23b035f14756b438b3a61a63b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:44:22.002064 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12302b64-33f9-4c9d-8782-35e7d3f2db00 service placement] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:44:22.002373 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12302b64-33f9-4c9d-8782-35e7d3f2db00 service placement] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:44:22.002651 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12302b64-33f9-4c9d-8782-35e7d3f2db00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:44:22.004484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-12302b64-33f9-4c9d-8782-35e7d3f2db00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:44:22.017369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12302b64-33f9-4c9d-8782-35e7d3f2db00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:44:22.018964 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12302b64-33f9-4c9d-8782-35e7d3f2db00 service placement] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:44:22.029551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1422/2812] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:44:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:44:24.588499 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62ddd5-1734-48d7-8f1e-7fa9630c167b service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:44:24.609599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62ddd5-1734-48d7-8f1e-7fa9630c167b service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:44:24.618361 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41014548-6d2c-4c96-8b5c-b05a9d354400 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:44:24.619091 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41014548-6d2c-4c96-8b5c-b05a9d354400 service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:44:24.619371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41014548-6d2c-4c96-8b5c-b05a9d354400 service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:44:24.619647 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41014548-6d2c-4c96-8b5c-b05a9d354400 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:44:24.621861 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-41014548-6d2c-4c96-8b5c-b05a9d354400 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:44:24.636014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41014548-6d2c-4c96-8b5c-b05a9d354400 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:44:24.637632 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41014548-6d2c-4c96-8b5c-b05a9d354400 service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:44:24.649437 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1391/2813] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:44:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:44:36.378960 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12302b64-33f9-4c9d-8782-35e7d3f2db00 service placement] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:44:36.391590 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12302b64-33f9-4c9d-8782-35e7d3f2db00 service placement] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:44:36.397107 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1915bc-4961-4e51-a986-20afd57157f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:44:36.397761 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1915bc-4961-4e51-a986-20afd57157f6 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:44:36.398043 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1915bc-4961-4e51-a986-20afd57157f6 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:44:36.398319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1915bc-4961-4e51-a986-20afd57157f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:44:36.400119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-8f1915bc-4961-4e51-a986-20afd57157f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:44:36.413282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1915bc-4961-4e51-a986-20afd57157f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:44:36.414878 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1915bc-4961-4e51-a986-20afd57157f6 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:44:36.426335 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1423/2814] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:44:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:44:39.825165 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41014548-6d2c-4c96-8b5c-b05a9d354400 service nova] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:44:39.834845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41014548-6d2c-4c96-8b5c-b05a9d354400 service nova] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:44:39.839230 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361406c-d4ff-4125-b31d-9f5dff31201a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:44:39.839869 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361406c-d4ff-4125-b31d-9f5dff31201a service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:44:39.840150 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361406c-d4ff-4125-b31d-9f5dff31201a service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:44:39.840425 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361406c-d4ff-4125-b31d-9f5dff31201a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:44:39.850196 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361406c-d4ff-4125-b31d-9f5dff31201a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:44:39.851630 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361406c-d4ff-4125-b31d-9f5dff31201a service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:44:39.860854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1392/2815] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:44:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:45:48.404638 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d3ee0-6f44-4ab7-9c78-a53667dd22e5 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:45:48.405185 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d3ee0-6f44-4ab7-9c78-a53667dd22e5 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:45:48.405326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d3ee0-6f44-4ab7-9c78-a53667dd22e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:45:48.423121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-cd2d3ee0-6f44-4ab7-9c78-a53667dd22e5 None None] MFA Rules not processed for user `246ea5852be548f791046f765f3bcf45`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:45:48.424317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-cd2d3ee0-6f44-4ab7-9c78-a53667dd22e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:45:48.431185 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1424/2816] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:45:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:47:20.793967 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361406c-d4ff-4125-b31d-9f5dff31201a service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:47:20.802700 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361406c-d4ff-4125-b31d-9f5dff31201a service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:47:20.806392 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20bd1e-26d6-4792-a370-68d43eb97170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:47:20.807054 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20bd1e-26d6-4792-a370-68d43eb97170 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:20.807336 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20bd1e-26d6-4792-a370-68d43eb97170 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:20.807609 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20bd1e-26d6-4792-a370-68d43eb97170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:20.809395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-5b20bd1e-26d6-4792-a370-68d43eb97170 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:47:20.819539 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20bd1e-26d6-4792-a370-68d43eb97170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:47:20.821076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20bd1e-26d6-4792-a370-68d43eb97170 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:47:20.829213 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1393/2817] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:47:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:47:21.942484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d3ee0-6f44-4ab7-9c78-a53667dd22e5 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:47:21.951927 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d3ee0-6f44-4ab7-9c78-a53667dd22e5 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:47:21.955804 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d8492-a3ad-4d37-a7e4-2f7ccc4fc644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:47:21.956432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d8492-a3ad-4d37-a7e4-2f7ccc4fc644 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:21.956708 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d8492-a3ad-4d37-a7e4-2f7ccc4fc644 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:21.956977 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d8492-a3ad-4d37-a7e4-2f7ccc4fc644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:21.959363 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-3d3d8492-a3ad-4d37-a7e4-2f7ccc4fc644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:47:21.969128 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d8492-a3ad-4d37-a7e4-2f7ccc4fc644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:47:21.970552 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d8492-a3ad-4d37-a7e4-2f7ccc4fc644 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:47:21.979123 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1425/2818] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:47:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:47:23.076954 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20bd1e-26d6-4792-a370-68d43eb97170 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:47:23.086662 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20bd1e-26d6-4792-a370-68d43eb97170 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:47:23.091362 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a9692-a921-4383-90c0-75d1301673da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:47:23.092084 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a9692-a921-4383-90c0-75d1301673da service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:23.092592 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a9692-a921-4383-90c0-75d1301673da service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:23.093285 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a9692-a921-4383-90c0-75d1301673da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:23.095359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-df3a9692-a921-4383-90c0-75d1301673da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:47:23.127051 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a9692-a921-4383-90c0-75d1301673da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:47:23.128728 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a9692-a921-4383-90c0-75d1301673da service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:47:23.140699 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1394/2819] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:47:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:47:51.055676 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d8492-a3ad-4d37-a7e4-2f7ccc4fc644 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:47:51.065556 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d8492-a3ad-4d37-a7e4-2f7ccc4fc644 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:47:51.069255 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15471744-72ee-43ec-8300-12af4fff9c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:47:51.069894 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15471744-72ee-43ec-8300-12af4fff9c84 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:51.070668 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15471744-72ee-43ec-8300-12af4fff9c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:51.070976 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15471744-72ee-43ec-8300-12af4fff9c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:51.072704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-15471744-72ee-43ec-8300-12af4fff9c84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:47:51.136520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15471744-72ee-43ec-8300-12af4fff9c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:47:51.137962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15471744-72ee-43ec-8300-12af4fff9c84 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:47:51.147661 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1426/2820] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:47:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:47:54.442924 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a9692-a921-4383-90c0-75d1301673da service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:47:54.444558 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-df3a9692-a921-4383-90c0-75d1301673da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:47:54.461757 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a9692-a921-4383-90c0-75d1301673da service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:47:54.467587 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293aa6c9-d99c-432b-8c33-7b8aed551669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:47:54.468477 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293aa6c9-d99c-432b-8c33-7b8aed551669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:54.468763 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293aa6c9-d99c-432b-8c33-7b8aed551669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:54.469241 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293aa6c9-d99c-432b-8c33-7b8aed551669 admin admin] PATH_INFO: `/v3/users/246ea5852be548f791046f765f3bcf45` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:54.470687 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293aa6c9-d99c-432b-8c33-7b8aed551669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=246ea5852be548f791046f765f3bcf45)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:47:54.472870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293aa6c9-d99c-432b-8c33-7b8aed551669 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:47:54.525502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-293aa6c9-d99c-432b-8c33-7b8aed551669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '246ea5852be548f791046f765f3bcf45'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:47:54.541882 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-293aa6c9-d99c-432b-8c33-7b8aed551669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '246ea5852be548f791046f765f3bcf45'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:47:54.558950 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-293aa6c9-d99c-432b-8c33-7b8aed551669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '246ea5852be548f791046f765f3bcf45'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:47:54.560899 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-293aa6c9-d99c-432b-8c33-7b8aed551669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '246ea5852be548f791046f765f3bcf45'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:47:54.568038 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-293aa6c9-d99c-432b-8c33-7b8aed551669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '246ea5852be548f791046f765f3bcf45'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:47:54.574361 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1395/2821] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:47:54 2022] DELETE /identity/v3/users/246ea5852be548f791046f765f3bcf45 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:47:54.758088 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15471744-72ee-43ec-8300-12af4fff9c84 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:47:54.768254 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15471744-72ee-43ec-8300-12af4fff9c84 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:47:54.826799 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacfdf5-6753-4a73-a4fe-e1bb55241068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:47:54.827610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacfdf5-6753-4a73-a4fe-e1bb55241068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:54.827892 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacfdf5-6753-4a73-a4fe-e1bb55241068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:54.828164 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacfdf5-6753-4a73-a4fe-e1bb55241068 admin admin] PATH_INFO: `/v3/projects/a8740291e9c9462d8b4b3d76762d1930` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:54.829351 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aacfdf5-6753-4a73-a4fe-e1bb55241068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8740291e9c9462d8b4b3d76762d1930)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:47:54.831332 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aacfdf5-6753-4a73-a4fe-e1bb55241068 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:47:54.877906 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1aacfdf5-6753-4a73-a4fe-e1bb55241068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8740291e9c9462d8b4b3d76762d1930', 'request_id': 'req-1aacfdf5-6753-4a73-a4fe-e1bb55241068'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:47:54.884484 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1aacfdf5-6753-4a73-a4fe-e1bb55241068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8740291e9c9462d8b4b3d76762d1930', 'request_id': 'req-1aacfdf5-6753-4a73-a4fe-e1bb55241068'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:47:54.892006 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1aacfdf5-6753-4a73-a4fe-e1bb55241068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8740291e9c9462d8b4b3d76762d1930', 'request_id': 'req-1aacfdf5-6753-4a73-a4fe-e1bb55241068'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:47:54.903704 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1aacfdf5-6753-4a73-a4fe-e1bb55241068 admin admin] The token cache is being invalidate because project a8740291e9c9462d8b4b3d76762d1930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:47:54.904273 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1aacfdf5-6753-4a73-a4fe-e1bb55241068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:47:54.905193 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-1aacfdf5-6753-4a73-a4fe-e1bb55241068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:47:54.906793 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1427/2822] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:47:54 2022] DELETE /identity/v3/projects/a8740291e9c9462d8b4b3d76762d1930 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:47:54.911694 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2a369-eb84-45e7-ac94-9418efd9ca75 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:54.911985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2a369-eb84-45e7-ac94-9418efd9ca75 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:54.912265 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2a369-eb84-45e7-ac94-9418efd9ca75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:54.931398 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-b3a2a369-eb84-45e7-ac94-9418efd9ca75 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:47:54.932597 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-b3a2a369-eb84-45e7-ac94-9418efd9ca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:47:54.988789 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1396/2823] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:47:54.997254 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee24df-3e10-4def-916e-bdf205bd21a8 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:54.997539 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee24df-3e10-4def-916e-bdf205bd21a8 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:54.997812 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee24df-3e10-4def-916e-bdf205bd21a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:55.016087 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-37ee24df-3e10-4def-916e-bdf205bd21a8 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:47:55.017282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-37ee24df-3e10-4def-916e-bdf205bd21a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:47:55.025084 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1428/2824] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:47:55.029373 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2a369-eb84-45e7-ac94-9418efd9ca75 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:47:55.039130 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2a369-eb84-45e7-ac94-9418efd9ca75 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:47:55.043612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde0336-cdc2-475f-8aa2-96c5f48900f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:47:55.044258 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde0336-cdc2-475f-8aa2-96c5f48900f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:55.044541 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde0336-cdc2-475f-8aa2-96c5f48900f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:55.044818 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde0336-cdc2-475f-8aa2-96c5f48900f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:55.045537 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde0336-cdc2-475f-8aa2-96c5f48900f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:47:55.045841 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde0336-cdc2-475f-8aa2-96c5f48900f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:47:55.047481 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde0336-cdc2-475f-8aa2-96c5f48900f1 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:47:55.059310 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1397/2825] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 15:47:55.063677 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee24df-3e10-4def-916e-bdf205bd21a8 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:47:55.073325 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee24df-3e10-4def-916e-bdf205bd21a8 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:47:55.077948 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547a14c-e6eb-4bc5-ba98-ab2647b39072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:47:55.078526 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547a14c-e6eb-4bc5-ba98-ab2647b39072 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:55.078798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547a14c-e6eb-4bc5-ba98-ab2647b39072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:55.079098 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547a14c-e6eb-4bc5-ba98-ab2647b39072 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:55.079773 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547a14c-e6eb-4bc5-ba98-ab2647b39072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:47:55.081642 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547a14c-e6eb-4bc5-ba98-ab2647b39072 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:47:55.106117 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1429/2826] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:47:55 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:47:55.110316 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde0336-cdc2-475f-8aa2-96c5f48900f1 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:47:55.120886 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde0336-cdc2-475f-8aa2-96c5f48900f1 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:47:55.175510 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168eee3-9aca-4f4c-9184-da43a231ee35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:47:55.176175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168eee3-9aca-4f4c-9184-da43a231ee35 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:55.176456 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168eee3-9aca-4f4c-9184-da43a231ee35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:55.176731 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168eee3-9aca-4f4c-9184-da43a231ee35 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:55.177410 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168eee3-9aca-4f4c-9184-da43a231ee35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:47:55.179353 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168eee3-9aca-4f4c-9184-da43a231ee35 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:47:55.201023 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1398/2827] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:47:55 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:47:55.205015 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547a14c-e6eb-4bc5-ba98-ab2647b39072 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:47:55.215852 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547a14c-e6eb-4bc5-ba98-ab2647b39072 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:47:55.220513 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d01cc-2c29-4451-b50d-3351c57fda30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:47:55.221170 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d01cc-2c29-4451-b50d-3351c57fda30 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:55.221540 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d01cc-2c29-4451-b50d-3351c57fda30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:55.221989 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d01cc-2c29-4451-b50d-3351c57fda30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:55.222997 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d01cc-2c29-4451-b50d-3351c57fda30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:47:55.224604 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d01cc-2c29-4451-b50d-3351c57fda30 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:47:55.235753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1430/2828] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:47:55.239679 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168eee3-9aca-4f4c-9184-da43a231ee35 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:47:55.249284 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168eee3-9aca-4f4c-9184-da43a231ee35 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:47:55.253811 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9fbb3-2ca9-4493-9f02-ccdb6cc6c98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:47:55.254464 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9fbb3-2ca9-4493-9f02-ccdb6cc6c98b admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:55.254738 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9fbb3-2ca9-4493-9f02-ccdb6cc6c98b admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:55.255046 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9fbb3-2ca9-4493-9f02-ccdb6cc6c98b admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:55.255759 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9fbb3-2ca9-4493-9f02-ccdb6cc6c98b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:47:55.257332 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9fbb3-2ca9-4493-9f02-ccdb6cc6c98b admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:47:55.268689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1399/2829] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:47:55.272913 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d01cc-2c29-4451-b50d-3351c57fda30 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:47:55.283492 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d01cc-2c29-4451-b50d-3351c57fda30 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:47:55.288018 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b94cd1-3cf9-4ba0-a8b1-70ea2f963635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:47:55.288880 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b94cd1-3cf9-4ba0-a8b1-70ea2f963635 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:55.289830 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b94cd1-3cf9-4ba0-a8b1-70ea2f963635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:55.290103 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b94cd1-3cf9-4ba0-a8b1-70ea2f963635 admin admin] PATH_INFO: `/v3/projects/130be74b0e604afcbae99bd7dc02672c/users/9c2b589812354216a6abdf956b409e1f/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:55.304216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b94cd1-3cf9-4ba0-a8b1-70ea2f963635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=130be74b0e604afcbae99bd7dc02672c, user_id=9c2b589812354216a6abdf956b409e1f, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:47:55.307056 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b94cd1-3cf9-4ba0-a8b1-70ea2f963635 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:47:55.319613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1431/2830] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:47:55 2022] PUT /identity/v3/projects/130be74b0e604afcbae99bd7dc02672c/users/9c2b589812354216a6abdf956b409e1f/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:47:55.329966 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0aa0c1-078c-4d4e-9af1-cee4c8add953 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:55.330192 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0aa0c1-078c-4d4e-9af1-cee4c8add953 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:55.330465 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0aa0c1-078c-4d4e-9af1-cee4c8add953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:55.355827 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-5d0aa0c1-078c-4d4e-9af1-cee4c8add953 None None] MFA Rules not processed for user `9c2b589812354216a6abdf956b409e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:47:55.357003 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-5d0aa0c1-078c-4d4e-9af1-cee4c8add953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:47:55.417791 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1400/2831] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:47:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:47:55.422331 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b94cd1-3cf9-4ba0-a8b1-70ea2f963635 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:47:55.481928 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b94cd1-3cf9-4ba0-a8b1-70ea2f963635 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:47:55.486631 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbb088-2f20-4ce1-9f56-9d1ea38319cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:47:55.487327 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbb088-2f20-4ce1-9f56-9d1ea38319cc admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:55.487618 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbb088-2f20-4ce1-9f56-9d1ea38319cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:55.487893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbb088-2f20-4ce1-9f56-9d1ea38319cc admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:55.488610 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fbb088-2f20-4ce1-9f56-9d1ea38319cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:47:55.490494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fbb088-2f20-4ce1-9f56-9d1ea38319cc admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:47:55.516121 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1432/2832] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:47:55 2022] POST /identity/v3/projects => generated 363 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:47:55.520239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0aa0c1-078c-4d4e-9af1-cee4c8add953 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:47:55.531570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0aa0c1-078c-4d4e-9af1-cee4c8add953 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:47:55.588691 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347b6d2-b763-4ac0-bf72-fd51a80f5c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:47:55.589278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347b6d2-b763-4ac0-bf72-fd51a80f5c23 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:55.589727 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347b6d2-b763-4ac0-bf72-fd51a80f5c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:55.589986 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347b6d2-b763-4ac0-bf72-fd51a80f5c23 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:55.590675 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347b6d2-b763-4ac0-bf72-fd51a80f5c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:47:55.592634 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347b6d2-b763-4ac0-bf72-fd51a80f5c23 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:47:55.611875 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1401/2833] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:47:55 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:47:55.616068 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbb088-2f20-4ce1-9f56-9d1ea38319cc admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:47:55.626436 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbb088-2f20-4ce1-9f56-9d1ea38319cc admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:47:55.631532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd434f-a247-4958-ae8b-b9ea873197ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:47:55.632202 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd434f-a247-4958-ae8b-b9ea873197ee admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:55.632487 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd434f-a247-4958-ae8b-b9ea873197ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:55.633303 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd434f-a247-4958-ae8b-b9ea873197ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:55.634063 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd434f-a247-4958-ae8b-b9ea873197ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:47:55.635709 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd434f-a247-4958-ae8b-b9ea873197ee admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:47:55.646481 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1433/2834] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:47:55.651289 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347b6d2-b763-4ac0-bf72-fd51a80f5c23 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:47:55.661177 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347b6d2-b763-4ac0-bf72-fd51a80f5c23 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:47:55.665759 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027be94-d5c6-42a5-b9d1-edf448deede7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:47:55.666632 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027be94-d5c6-42a5-b9d1-edf448deede7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:55.666946 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027be94-d5c6-42a5-b9d1-edf448deede7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:55.667216 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027be94-d5c6-42a5-b9d1-edf448deede7 admin admin] PATH_INFO: `/v3/projects/4617a01014cd4335bd60e46351b798dd/users/5db4cd1f5d1146f4b60d9c2030c8931d/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:55.682332 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027be94-d5c6-42a5-b9d1-edf448deede7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4617a01014cd4335bd60e46351b798dd, user_id=5db4cd1f5d1146f4b60d9c2030c8931d, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:47:55.685095 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027be94-d5c6-42a5-b9d1-edf448deede7 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:47:55.698657 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1402/2835] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:47:55 2022] PUT /identity/v3/projects/4617a01014cd4335bd60e46351b798dd/users/5db4cd1f5d1146f4b60d9c2030c8931d/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:47:55.702622 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd434f-a247-4958-ae8b-b9ea873197ee admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:47:55.712475 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd434f-a247-4958-ae8b-b9ea873197ee admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:47:55.769271 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2e5cb-28f6-4889-81c0-ed505708a8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:47:55.769944 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2e5cb-28f6-4889-81c0-ed505708a8cf admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:55.770228 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2e5cb-28f6-4889-81c0-ed505708a8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:55.770507 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2e5cb-28f6-4889-81c0-ed505708a8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:55.771294 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2e5cb-28f6-4889-81c0-ed505708a8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:47:55.772979 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2e5cb-28f6-4889-81c0-ed505708a8cf admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:47:55.782918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1434/2836] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:47:55.787039 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027be94-d5c6-42a5-b9d1-edf448deede7 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:47:55.797508 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027be94-d5c6-42a5-b9d1-edf448deede7 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:47:55.801965 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dc470-592e-40e7-b684-5ddea5b4e780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:47:55.802847 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dc470-592e-40e7-b684-5ddea5b4e780 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:55.803122 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dc470-592e-40e7-b684-5ddea5b4e780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:55.803420 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dc470-592e-40e7-b684-5ddea5b4e780 admin admin] PATH_INFO: `/v3/projects/4617a01014cd4335bd60e46351b798dd/users/5db4cd1f5d1146f4b60d9c2030c8931d/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:55.805877 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9dc470-592e-40e7-b684-5ddea5b4e780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4617a01014cd4335bd60e46351b798dd, user_id=5db4cd1f5d1146f4b60d9c2030c8931d, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:47:55.808520 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9dc470-592e-40e7-b684-5ddea5b4e780 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:47:55.818652 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1403/2837] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:47:55 2022] PUT /identity/v3/projects/4617a01014cd4335bd60e46351b798dd/users/5db4cd1f5d1146f4b60d9c2030c8931d/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:47:55.830864 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd8904-9c30-40ad-820e-773287aec427 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:55.831192 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd8904-9c30-40ad-820e-773287aec427 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:55.831494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd8904-9c30-40ad-820e-773287aec427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:55.858458 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-07bd8904-9c30-40ad-820e-773287aec427 None None] MFA Rules not processed for user `5db4cd1f5d1146f4b60d9c2030c8931d`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:47:55.859685 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-07bd8904-9c30-40ad-820e-773287aec427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:47:55.928574 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1435/2838] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:47:55 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:47:55.940442 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dc470-592e-40e7-b684-5ddea5b4e780 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:47:55.942149 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ad9dc470-592e-40e7-b684-5ddea5b4e780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:47:55.997438 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dc470-592e-40e7-b684-5ddea5b4e780 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:47:56.001046 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1641d-0640-49a0-a980-a91c6a190c0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:47:56.001679 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1641d-0640-49a0-a980-a91c6a190c0e service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:56.001957 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1641d-0640-49a0-a980-a91c6a190c0e service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:56.002230 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1641d-0640-49a0-a980-a91c6a190c0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:56.011624 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1641d-0640-49a0-a980-a91c6a190c0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:47:56.013035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1641d-0640-49a0-a980-a91c6a190c0e service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:47:56.022347 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1404/2839] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:47:55 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:47:56.096832 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd8904-9c30-40ad-820e-773287aec427 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:47:56.107009 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd8904-9c30-40ad-820e-773287aec427 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:47:56.110848 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba94e4-7fc9-4cdb-8a41-e62b22501924 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:47:56.111419 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba94e4-7fc9-4cdb-8a41-e62b22501924 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:47:56.111698 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba94e4-7fc9-4cdb-8a41-e62b22501924 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:47:56.111972 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba94e4-7fc9-4cdb-8a41-e62b22501924 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:47:56.170560 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba94e4-7fc9-4cdb-8a41-e62b22501924 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:47:56.172038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba94e4-7fc9-4cdb-8a41-e62b22501924 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:47:56.181611 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1436/2840] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:47:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:48:08.416829 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1641d-0640-49a0-a980-a91c6a190c0e service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:08.477345 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1641d-0640-49a0-a980-a91c6a190c0e service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:08.481922 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399b223-b28c-4e96-89a1-313f69f3afae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:08.482795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399b223-b28c-4e96-89a1-313f69f3afae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:08.483103 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399b223-b28c-4e96-89a1-313f69f3afae admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:08.483383 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399b223-b28c-4e96-89a1-313f69f3afae admin admin] PATH_INFO: `/v3/users/9c2b589812354216a6abdf956b409e1f` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:08.484570 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399b223-b28c-4e96-89a1-313f69f3afae admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c2b589812354216a6abdf956b409e1f)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:08.486629 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399b223-b28c-4e96-89a1-313f69f3afae admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:08.532831 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6399b223-b28c-4e96-89a1-313f69f3afae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c2b589812354216a6abdf956b409e1f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:08.539543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6399b223-b28c-4e96-89a1-313f69f3afae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c2b589812354216a6abdf956b409e1f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:08.551339 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6399b223-b28c-4e96-89a1-313f69f3afae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c2b589812354216a6abdf956b409e1f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:08.551978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6399b223-b28c-4e96-89a1-313f69f3afae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c2b589812354216a6abdf956b409e1f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:08.559168 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-6399b223-b28c-4e96-89a1-313f69f3afae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c2b589812354216a6abdf956b409e1f'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:08.564944 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1405/2841] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:48:08 2022] DELETE /identity/v3/users/9c2b589812354216a6abdf956b409e1f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:48:08.569473 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed7b35-3d65-4aaa-9e5b-d738e8749021 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:08.569955 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed7b35-3d65-4aaa-9e5b-d738e8749021 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:08.570049 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed7b35-3d65-4aaa-9e5b-d738e8749021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:08.587432 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-33ed7b35-3d65-4aaa-9e5b-d738e8749021 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:48:08.588633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-33ed7b35-3d65-4aaa-9e5b-d738e8749021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:08.647105 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1437/2842] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:48:08.657566 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399b223-b28c-4e96-89a1-313f69f3afae admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:08.658992 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-6399b223-b28c-4e96-89a1-313f69f3afae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:08.715540 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399b223-b28c-4e96-89a1-313f69f3afae admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:08.719232 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f929b-d4d0-4366-9a2f-be2ec5516fd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:08.719873 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f929b-d4d0-4366-9a2f-be2ec5516fd8 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:08.720161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f929b-d4d0-4366-9a2f-be2ec5516fd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:08.720433 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f929b-d4d0-4366-9a2f-be2ec5516fd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:08.729209 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f929b-d4d0-4366-9a2f-be2ec5516fd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:08.730637 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f929b-d4d0-4366-9a2f-be2ec5516fd8 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:08.739869 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1406/2843] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:48:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:48:09.006143 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed7b35-3d65-4aaa-9e5b-d738e8749021 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:09.007737 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-33ed7b35-3d65-4aaa-9e5b-d738e8749021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:09.021383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed7b35-3d65-4aaa-9e5b-d738e8749021 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:09.025940 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825772b-07fb-415f-9afc-ec29a6ae9dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:09.026806 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825772b-07fb-415f-9afc-ec29a6ae9dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:09.027124 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825772b-07fb-415f-9afc-ec29a6ae9dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:09.027400 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825772b-07fb-415f-9afc-ec29a6ae9dc6 admin admin] PATH_INFO: `/v3/projects/130be74b0e604afcbae99bd7dc02672c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:09.028778 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825772b-07fb-415f-9afc-ec29a6ae9dc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=130be74b0e604afcbae99bd7dc02672c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:09.031116 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825772b-07fb-415f-9afc-ec29a6ae9dc6 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:09.075811 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d825772b-07fb-415f-9afc-ec29a6ae9dc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '130be74b0e604afcbae99bd7dc02672c', 'request_id': 'req-d825772b-07fb-415f-9afc-ec29a6ae9dc6'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:09.081687 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d825772b-07fb-415f-9afc-ec29a6ae9dc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '130be74b0e604afcbae99bd7dc02672c', 'request_id': 'req-d825772b-07fb-415f-9afc-ec29a6ae9dc6'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:09.088869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d825772b-07fb-415f-9afc-ec29a6ae9dc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '130be74b0e604afcbae99bd7dc02672c', 'request_id': 'req-d825772b-07fb-415f-9afc-ec29a6ae9dc6'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:09.098848 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d825772b-07fb-415f-9afc-ec29a6ae9dc6 admin admin] The token cache is being invalidate because project 130be74b0e604afcbae99bd7dc02672c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:48:09.099157 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d825772b-07fb-415f-9afc-ec29a6ae9dc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:09.099825 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-d825772b-07fb-415f-9afc-ec29a6ae9dc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:09.101373 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1438/2844] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:48:09 2022] DELETE /identity/v3/projects/130be74b0e604afcbae99bd7dc02672c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:48:09.105830 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f929b-d4d0-4366-9a2f-be2ec5516fd8 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:09.115208 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f929b-d4d0-4366-9a2f-be2ec5516fd8 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:09.171610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c784ad-b129-44c8-bd52-4659937d0f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:09.172481 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c784ad-b129-44c8-bd52-4659937d0f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:09.172793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c784ad-b129-44c8-bd52-4659937d0f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:09.173068 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c784ad-b129-44c8-bd52-4659937d0f3e admin admin] PATH_INFO: `/v3/users/5db4cd1f5d1146f4b60d9c2030c8931d` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:09.174243 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c784ad-b129-44c8-bd52-4659937d0f3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5db4cd1f5d1146f4b60d9c2030c8931d)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:09.176215 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c784ad-b129-44c8-bd52-4659937d0f3e admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:09.221688 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-97c784ad-b129-44c8-bd52-4659937d0f3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5db4cd1f5d1146f4b60d9c2030c8931d'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:09.228622 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-97c784ad-b129-44c8-bd52-4659937d0f3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5db4cd1f5d1146f4b60d9c2030c8931d'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:09.240567 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-97c784ad-b129-44c8-bd52-4659937d0f3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5db4cd1f5d1146f4b60d9c2030c8931d'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:09.241225 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-97c784ad-b129-44c8-bd52-4659937d0f3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5db4cd1f5d1146f4b60d9c2030c8931d'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:09.247976 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-97c784ad-b129-44c8-bd52-4659937d0f3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5db4cd1f5d1146f4b60d9c2030c8931d'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:09.254003 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1407/2845] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:48:09 2022] DELETE /identity/v3/users/5db4cd1f5d1146f4b60d9c2030c8931d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:48:09.514360 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825772b-07fb-415f-9afc-ec29a6ae9dc6 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:09.515798 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-d825772b-07fb-415f-9afc-ec29a6ae9dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:09.529034 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825772b-07fb-415f-9afc-ec29a6ae9dc6 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:09.585311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3d158-70b7-4b15-81d8-0b68bf860fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:09.586169 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3d158-70b7-4b15-81d8-0b68bf860fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:09.586447 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3d158-70b7-4b15-81d8-0b68bf860fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:09.586718 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3d158-70b7-4b15-81d8-0b68bf860fea admin admin] PATH_INFO: `/v3/projects/4617a01014cd4335bd60e46351b798dd` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:09.588492 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3d158-70b7-4b15-81d8-0b68bf860fea admin admin] RBAC: Authorizing `identity:delete_project(project_id=4617a01014cd4335bd60e46351b798dd)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:09.590416 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3d158-70b7-4b15-81d8-0b68bf860fea admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:09.635690 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-f9c3d158-70b7-4b15-81d8-0b68bf860fea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4617a01014cd4335bd60e46351b798dd', 'request_id': 'req-f9c3d158-70b7-4b15-81d8-0b68bf860fea'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:09.641645 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-f9c3d158-70b7-4b15-81d8-0b68bf860fea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4617a01014cd4335bd60e46351b798dd', 'request_id': 'req-f9c3d158-70b7-4b15-81d8-0b68bf860fea'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:09.648711 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-f9c3d158-70b7-4b15-81d8-0b68bf860fea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4617a01014cd4335bd60e46351b798dd', 'request_id': 'req-f9c3d158-70b7-4b15-81d8-0b68bf860fea'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:09.659767 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-f9c3d158-70b7-4b15-81d8-0b68bf860fea admin admin] The token cache is being invalidate because project 4617a01014cd4335bd60e46351b798dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:48:09.660053 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-f9c3d158-70b7-4b15-81d8-0b68bf860fea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:09.660720 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-f9c3d158-70b7-4b15-81d8-0b68bf860fea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:09.662282 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1439/2846] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:48:09 2022] DELETE /identity/v3/projects/4617a01014cd4335bd60e46351b798dd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:48:09.667266 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8850b7-9c8e-4be8-aea9-58bc1472d6ad None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:09.667773 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8850b7-9c8e-4be8-aea9-58bc1472d6ad None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:09.667940 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8850b7-9c8e-4be8-aea9-58bc1472d6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:09.685824 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-ab8850b7-9c8e-4be8-aea9-58bc1472d6ad None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:48:09.687249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ab8850b7-9c8e-4be8-aea9-58bc1472d6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:09.746935 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1408/2847] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:48:09.754657 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680e6af-f8b8-427d-b3b5-9e865f30ab58 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:09.754984 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680e6af-f8b8-427d-b3b5-9e865f30ab58 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:09.755267 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680e6af-f8b8-427d-b3b5-9e865f30ab58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:09.773990 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-1680e6af-f8b8-427d-b3b5-9e865f30ab58 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:48:09.775862 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-1680e6af-f8b8-427d-b3b5-9e865f30ab58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:09.784000 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1440/2848] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:48:09.788124 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8850b7-9c8e-4be8-aea9-58bc1472d6ad None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:09.797708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8850b7-9c8e-4be8-aea9-58bc1472d6ad None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:09.802348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399bb4f-30d3-4991-96ca-fb4e0a15aee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:09.803038 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399bb4f-30d3-4991-96ca-fb4e0a15aee6 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:09.803327 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399bb4f-30d3-4991-96ca-fb4e0a15aee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:09.803609 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399bb4f-30d3-4991-96ca-fb4e0a15aee6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:09.804329 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399bb4f-30d3-4991-96ca-fb4e0a15aee6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79916) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:48:09.804635 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399bb4f-30d3-4991-96ca-fb4e0a15aee6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:09.806299 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399bb4f-30d3-4991-96ca-fb4e0a15aee6 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:09.817547 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1409/2849] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:48:09.822262 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680e6af-f8b8-427d-b3b5-9e865f30ab58 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:09.831311 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680e6af-f8b8-427d-b3b5-9e865f30ab58 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:09.836010 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06962738-89d3-4e7f-b3a1-fd46f2efdfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:09.836659 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06962738-89d3-4e7f-b3a1-fd46f2efdfd1 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:09.837563 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06962738-89d3-4e7f-b3a1-fd46f2efdfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:09.837845 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06962738-89d3-4e7f-b3a1-fd46f2efdfd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:09.838520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06962738-89d3-4e7f-b3a1-fd46f2efdfd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:09.840425 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06962738-89d3-4e7f-b3a1-fd46f2efdfd1 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:09.864812 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1441/2850] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:48:09 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:48:09.868926 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399bb4f-30d3-4991-96ca-fb4e0a15aee6 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:09.878573 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399bb4f-30d3-4991-96ca-fb4e0a15aee6 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:09.934342 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0f579-d6ee-4f84-a381-307ef54e4167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:09.935047 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0f579-d6ee-4f84-a381-307ef54e4167 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:09.935328 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0f579-d6ee-4f84-a381-307ef54e4167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:09.935602 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0f579-d6ee-4f84-a381-307ef54e4167 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:09.936278 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0f579-d6ee-4f84-a381-307ef54e4167 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:09.938175 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0f579-d6ee-4f84-a381-307ef54e4167 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:09.957890 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1410/2851] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:48:09 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:48:09.962016 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06962738-89d3-4e7f-b3a1-fd46f2efdfd1 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:09.972661 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06962738-89d3-4e7f-b3a1-fd46f2efdfd1 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:09.977290 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc421c-5514-4d93-aaa7-dd5ff8e431d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:09.977914 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc421c-5514-4d93-aaa7-dd5ff8e431d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:09.978196 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc421c-5514-4d93-aaa7-dd5ff8e431d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:09.978469 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc421c-5514-4d93-aaa7-dd5ff8e431d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:09.979236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc421c-5514-4d93-aaa7-dd5ff8e431d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:09.980822 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc421c-5514-4d93-aaa7-dd5ff8e431d3 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:09.990883 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1442/2852] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:48:09.994809 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0f579-d6ee-4f84-a381-307ef54e4167 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:10.004724 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0f579-d6ee-4f84-a381-307ef54e4167 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:10.009861 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626abf5-9fd7-4fe1-970b-62d6c4ae2ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:10.010509 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626abf5-9fd7-4fe1-970b-62d6c4ae2ded admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:10.010797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626abf5-9fd7-4fe1-970b-62d6c4ae2ded admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:10.011102 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626abf5-9fd7-4fe1-970b-62d6c4ae2ded admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:10.011819 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626abf5-9fd7-4fe1-970b-62d6c4ae2ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:10.013397 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626abf5-9fd7-4fe1-970b-62d6c4ae2ded admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:10.023152 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1411/2853] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:48:10.027770 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc421c-5514-4d93-aaa7-dd5ff8e431d3 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:10.037752 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc421c-5514-4d93-aaa7-dd5ff8e431d3 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:10.042339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6f9c7-b16f-45b6-b8e8-06fe4daf5dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:10.043235 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6f9c7-b16f-45b6-b8e8-06fe4daf5dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:10.043512 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6f9c7-b16f-45b6-b8e8-06fe4daf5dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:10.043782 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6f9c7-b16f-45b6-b8e8-06fe4daf5dc9 admin admin] PATH_INFO: `/v3/projects/ed3f796946124f63a91320c1bffca66d/users/a4876a6b1300424f9f122d06b670cd31/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:10.058277 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6f9c7-b16f-45b6-b8e8-06fe4daf5dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3f796946124f63a91320c1bffca66d, user_id=a4876a6b1300424f9f122d06b670cd31, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:10.060941 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6f9c7-b16f-45b6-b8e8-06fe4daf5dc9 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:10.073902 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1443/2854] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:48:10 2022] PUT /identity/v3/projects/ed3f796946124f63a91320c1bffca66d/users/a4876a6b1300424f9f122d06b670cd31/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:48:10.084248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bfc10-8cfa-4704-be83-a7fb49219e4d None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:10.084562 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bfc10-8cfa-4704-be83-a7fb49219e4d None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:10.084842 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bfc10-8cfa-4704-be83-a7fb49219e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:10.111474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-c59bfc10-8cfa-4704-be83-a7fb49219e4d None None] MFA Rules not processed for user `a4876a6b1300424f9f122d06b670cd31`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:48:10.112702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c59bfc10-8cfa-4704-be83-a7fb49219e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:10.206945 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1412/2855] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:48:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:48:10.211541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6f9c7-b16f-45b6-b8e8-06fe4daf5dc9 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:10.272815 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6f9c7-b16f-45b6-b8e8-06fe4daf5dc9 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:10.278016 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee41b43-e19d-4f00-9e16-519b0a5749ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:10.278675 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee41b43-e19d-4f00-9e16-519b0a5749ed admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:10.278982 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee41b43-e19d-4f00-9e16-519b0a5749ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:10.279256 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee41b43-e19d-4f00-9e16-519b0a5749ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:10.279951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee41b43-e19d-4f00-9e16-519b0a5749ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:10.282079 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee41b43-e19d-4f00-9e16-519b0a5749ed admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:10.306551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1444/2856] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:48:10 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:48:10.310612 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bfc10-8cfa-4704-be83-a7fb49219e4d None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:10.321024 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bfc10-8cfa-4704-be83-a7fb49219e4d None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:10.375563 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652d728-e076-4406-a645-36234966d179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:10.376228 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652d728-e076-4406-a645-36234966d179 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:10.376514 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652d728-e076-4406-a645-36234966d179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:10.376801 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652d728-e076-4406-a645-36234966d179 admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:10.377491 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652d728-e076-4406-a645-36234966d179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:10.379471 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652d728-e076-4406-a645-36234966d179 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:10.399861 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1413/2857] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:48:10 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:48:10.403816 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee41b43-e19d-4f00-9e16-519b0a5749ed admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:10.414176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee41b43-e19d-4f00-9e16-519b0a5749ed admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:10.418902 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1812c4-1ed0-4519-97cd-02043b01ad46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:10.419561 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1812c4-1ed0-4519-97cd-02043b01ad46 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:10.419844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1812c4-1ed0-4519-97cd-02043b01ad46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:10.420119 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1812c4-1ed0-4519-97cd-02043b01ad46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:10.420835 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1812c4-1ed0-4519-97cd-02043b01ad46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:10.422430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1812c4-1ed0-4519-97cd-02043b01ad46 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:10.433236 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1445/2858] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:48:10.437124 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652d728-e076-4406-a645-36234966d179 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:10.447854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652d728-e076-4406-a645-36234966d179 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:10.452506 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20bf12-269a-43b1-abb8-a839bb95d21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:10.453158 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20bf12-269a-43b1-abb8-a839bb95d21a admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:10.453444 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20bf12-269a-43b1-abb8-a839bb95d21a admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:10.453719 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20bf12-269a-43b1-abb8-a839bb95d21a admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:10.454478 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20bf12-269a-43b1-abb8-a839bb95d21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:10.456119 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20bf12-269a-43b1-abb8-a839bb95d21a admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:10.466312 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1414/2859] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:48:10.470365 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1812c4-1ed0-4519-97cd-02043b01ad46 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:10.480209 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1812c4-1ed0-4519-97cd-02043b01ad46 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:10.484728 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266492b-56b0-49e3-a4a7-2e79a1be3411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:10.485595 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266492b-56b0-49e3-a4a7-2e79a1be3411 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:10.485873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266492b-56b0-49e3-a4a7-2e79a1be3411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:10.486143 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266492b-56b0-49e3-a4a7-2e79a1be3411 admin admin] PATH_INFO: `/v3/projects/05d4a308b96a438d99c42e2d9e48559b/users/95804b7ec0c845c3889da449d4a94c38/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:10.500699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266492b-56b0-49e3-a4a7-2e79a1be3411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d4a308b96a438d99c42e2d9e48559b, user_id=95804b7ec0c845c3889da449d4a94c38, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:10.503369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266492b-56b0-49e3-a4a7-2e79a1be3411 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:10.516957 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1446/2860] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:48:10 2022] PUT /identity/v3/projects/05d4a308b96a438d99c42e2d9e48559b/users/95804b7ec0c845c3889da449d4a94c38/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:48:10.574044 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee880867-837a-4e2b-85e1-a5538aee2343 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:10.574334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee880867-837a-4e2b-85e1-a5538aee2343 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:10.574609 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee880867-837a-4e2b-85e1-a5538aee2343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:10.600457 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-ee880867-837a-4e2b-85e1-a5538aee2343 None None] MFA Rules not processed for user `95804b7ec0c845c3889da449d4a94c38`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:48:10.601657 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ee880867-837a-4e2b-85e1-a5538aee2343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:10.663366 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1415/2861] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:48:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:48:10.668319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266492b-56b0-49e3-a4a7-2e79a1be3411 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:10.726962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266492b-56b0-49e3-a4a7-2e79a1be3411 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:10.732363 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e732662-9599-4e3b-b768-0f6f24827986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:10.733036 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e732662-9599-4e3b-b768-0f6f24827986 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:10.733321 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e732662-9599-4e3b-b768-0f6f24827986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:10.733599 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e732662-9599-4e3b-b768-0f6f24827986 admin admin] PATH_INFO: `/v3/projects` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:10.734285 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e732662-9599-4e3b-b768-0f6f24827986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:10.736241 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e732662-9599-4e3b-b768-0f6f24827986 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:10.761315 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1447/2862] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:48:10 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:48:10.765514 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee880867-837a-4e2b-85e1-a5538aee2343 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:10.776112 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee880867-837a-4e2b-85e1-a5538aee2343 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:10.832046 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c660ba1-afbf-4245-81d9-3df4f7d9e51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:10.832716 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c660ba1-afbf-4245-81d9-3df4f7d9e51c admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:10.833000 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c660ba1-afbf-4245-81d9-3df4f7d9e51c admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:10.833277 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c660ba1-afbf-4245-81d9-3df4f7d9e51c admin admin] PATH_INFO: `/v3/users` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:10.833994 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c660ba1-afbf-4245-81d9-3df4f7d9e51c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:10.835994 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c660ba1-afbf-4245-81d9-3df4f7d9e51c admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:10.855996 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1416/2863] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:48:10 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:48:10.860349 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e732662-9599-4e3b-b768-0f6f24827986 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:10.870452 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e732662-9599-4e3b-b768-0f6f24827986 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:10.874978 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc9546-eec2-47f7-b6dd-6f0116138998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:10.875624 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc9546-eec2-47f7-b6dd-6f0116138998 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:10.875902 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc9546-eec2-47f7-b6dd-6f0116138998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:10.876171 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc9546-eec2-47f7-b6dd-6f0116138998 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:10.876876 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc9546-eec2-47f7-b6dd-6f0116138998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:10.878452 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc9546-eec2-47f7-b6dd-6f0116138998 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:10.889437 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1448/2864] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:48:10.893543 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c660ba1-afbf-4245-81d9-3df4f7d9e51c admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:10.904039 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c660ba1-afbf-4245-81d9-3df4f7d9e51c admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:10.908936 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb9a47-ae3c-4f41-ac7f-f92f68e1656f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:10.909829 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb9a47-ae3c-4f41-ac7f-f92f68e1656f admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:10.910103 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb9a47-ae3c-4f41-ac7f-f92f68e1656f admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:10.910377 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb9a47-ae3c-4f41-ac7f-f92f68e1656f admin admin] PATH_INFO: `/v3/projects/8d2c274475014ea19f391ee63539a290/users/119ed48437f94812b1ddd282b94bcff0/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:10.925876 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb9a47-ae3c-4f41-ac7f-f92f68e1656f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d2c274475014ea19f391ee63539a290, user_id=119ed48437f94812b1ddd282b94bcff0, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:10.928615 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb9a47-ae3c-4f41-ac7f-f92f68e1656f admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:10.941518 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1417/2865] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:48:10 2022] PUT /identity/v3/projects/8d2c274475014ea19f391ee63539a290/users/119ed48437f94812b1ddd282b94bcff0/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:48:10.945695 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc9546-eec2-47f7-b6dd-6f0116138998 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:10.955955 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc9546-eec2-47f7-b6dd-6f0116138998 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:11.010140 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f5a54-1de4-4268-b251-dcabd9c305cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:11.010715 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f5a54-1de4-4268-b251-dcabd9c305cc admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:11.011024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f5a54-1de4-4268-b251-dcabd9c305cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:11.011303 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f5a54-1de4-4268-b251-dcabd9c305cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:11.012040 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f5a54-1de4-4268-b251-dcabd9c305cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:11.013647 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f5a54-1de4-4268-b251-dcabd9c305cc admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:11.023240 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1449/2866] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:48:11.027962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb9a47-ae3c-4f41-ac7f-f92f68e1656f admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:11.038328 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb9a47-ae3c-4f41-ac7f-f92f68e1656f admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:11.042990 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bcdee5-853d-4426-82a3-87d035f99a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:11.043854 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcdee5-853d-4426-82a3-87d035f99a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:11.044137 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcdee5-853d-4426-82a3-87d035f99a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:11.044410 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcdee5-853d-4426-82a3-87d035f99a56 admin admin] PATH_INFO: `/v3/projects/8d2c274475014ea19f391ee63539a290/users/119ed48437f94812b1ddd282b94bcff0/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:11.046366 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bcdee5-853d-4426-82a3-87d035f99a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d2c274475014ea19f391ee63539a290, user_id=119ed48437f94812b1ddd282b94bcff0, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:11.049005 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bcdee5-853d-4426-82a3-87d035f99a56 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:11.059365 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1418/2867] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:48:11 2022] PUT /identity/v3/projects/8d2c274475014ea19f391ee63539a290/users/119ed48437f94812b1ddd282b94bcff0/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:48:11.069357 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006a76-de65-48be-ab66-19199f62b730 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:11.069680 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006a76-de65-48be-ab66-19199f62b730 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:11.069989 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006a76-de65-48be-ab66-19199f62b730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:11.095837 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-c0006a76-de65-48be-ab66-19199f62b730 None None] MFA Rules not processed for user `119ed48437f94812b1ddd282b94bcff0`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:48:11.097039 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-c0006a76-de65-48be-ab66-19199f62b730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:11.163946 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1450/2868] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:48:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:48:11.175376 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bcdee5-853d-4426-82a3-87d035f99a56 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:11.177107 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-82bcdee5-853d-4426-82a3-87d035f99a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:11.232950 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bcdee5-853d-4426-82a3-87d035f99a56 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:11.236599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744f1a7-4ac1-4402-a3f2-84fd34eedfc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:11.237319 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744f1a7-4ac1-4402-a3f2-84fd34eedfc7 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:11.237680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744f1a7-4ac1-4402-a3f2-84fd34eedfc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:11.238165 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744f1a7-4ac1-4402-a3f2-84fd34eedfc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:11.247618 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744f1a7-4ac1-4402-a3f2-84fd34eedfc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:11.249048 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744f1a7-4ac1-4402-a3f2-84fd34eedfc7 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:11.258562 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1419/2869] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:48:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:48:11.728909 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0006a76-de65-48be-ab66-19199f62b730 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:11.731356 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-c0006a76-de65-48be-ab66-19199f62b730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:11.743017 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0006a76-de65-48be-ab66-19199f62b730 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:11.747176 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e8bc3-f3c3-4d9a-8d83-e4436c363953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:11.747806 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e8bc3-f3c3-4d9a-8d83-e4436c363953 service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:11.748080 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e8bc3-f3c3-4d9a-8d83-e4436c363953 service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:11.748349 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e8bc3-f3c3-4d9a-8d83-e4436c363953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:11.809085 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e8bc3-f3c3-4d9a-8d83-e4436c363953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:11.810505 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e8bc3-f3c3-4d9a-8d83-e4436c363953 service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:11.819146 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1451/2870] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:48:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:48:15.777240 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744f1a7-4ac1-4402-a3f2-84fd34eedfc7 service cinder] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:15.792401 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744f1a7-4ac1-4402-a3f2-84fd34eedfc7 service cinder] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:15.795942 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf1585-a54e-47f7-aadc-b63c95592eac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:15.796573 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf1585-a54e-47f7-aadc-b63c95592eac service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:15.796852 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf1585-a54e-47f7-aadc-b63c95592eac service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:15.797126 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf1585-a54e-47f7-aadc-b63c95592eac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:15.852628 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf1585-a54e-47f7-aadc-b63c95592eac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:15.854099 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf1585-a54e-47f7-aadc-b63c95592eac service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:15.863796 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1420/2871] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:48:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:48:17.913145 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e8bc3-f3c3-4d9a-8d83-e4436c363953 service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:18.000184 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e8bc3-f3c3-4d9a-8d83-e4436c363953 service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:18.004759 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13958a81-5ea3-4e93-acd3-d87ea09282a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:18.005648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13958a81-5ea3-4e93-acd3-d87ea09282a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:18.005931 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13958a81-5ea3-4e93-acd3-d87ea09282a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:18.006201 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13958a81-5ea3-4e93-acd3-d87ea09282a4 admin admin] PATH_INFO: `/v3/users/a4876a6b1300424f9f122d06b670cd31` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:18.007413 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13958a81-5ea3-4e93-acd3-d87ea09282a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4876a6b1300424f9f122d06b670cd31)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:18.009327 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13958a81-5ea3-4e93-acd3-d87ea09282a4 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:18.055455 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-13958a81-5ea3-4e93-acd3-d87ea09282a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4876a6b1300424f9f122d06b670cd31'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:18.067042 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-13958a81-5ea3-4e93-acd3-d87ea09282a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4876a6b1300424f9f122d06b670cd31'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:18.067699 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-13958a81-5ea3-4e93-acd3-d87ea09282a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4876a6b1300424f9f122d06b670cd31'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:18.068294 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-13958a81-5ea3-4e93-acd3-d87ea09282a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4876a6b1300424f9f122d06b670cd31'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:18.075406 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-13958a81-5ea3-4e93-acd3-d87ea09282a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4876a6b1300424f9f122d06b670cd31'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:18.088002 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1452/2872] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:48:17 2022] DELETE /identity/v3/users/a4876a6b1300424f9f122d06b670cd31 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:48:18.092538 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c583a-3ef5-4ad5-9dd5-fde06e37e914 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:18.093006 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c583a-3ef5-4ad5-9dd5-fde06e37e914 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:18.093095 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c583a-3ef5-4ad5-9dd5-fde06e37e914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:18.119870 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-474c583a-3ef5-4ad5-9dd5-fde06e37e914 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:48:18.121625 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-474c583a-3ef5-4ad5-9dd5-fde06e37e914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:18.177494 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1421/2873] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:48:18.187869 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13958a81-5ea3-4e93-acd3-d87ea09282a4 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:18.189274 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-13958a81-5ea3-4e93-acd3-d87ea09282a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:18.266502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13958a81-5ea3-4e93-acd3-d87ea09282a4 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:18.270113 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae03872-86d4-4c5e-80b5-27c0faadaf41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:18.270753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae03872-86d4-4c5e-80b5-27c0faadaf41 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:18.271067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae03872-86d4-4c5e-80b5-27c0faadaf41 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:18.271333 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae03872-86d4-4c5e-80b5-27c0faadaf41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:18.280972 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae03872-86d4-4c5e-80b5-27c0faadaf41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:18.282634 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae03872-86d4-4c5e-80b5-27c0faadaf41 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:18.291772 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1453/2874] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:48:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:48:18.546179 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c583a-3ef5-4ad5-9dd5-fde06e37e914 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:18.547736 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-474c583a-3ef5-4ad5-9dd5-fde06e37e914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:18.566481 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c583a-3ef5-4ad5-9dd5-fde06e37e914 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:18.571524 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11387ab2-18fe-4ba5-aff7-258defd518b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:18.572554 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11387ab2-18fe-4ba5-aff7-258defd518b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:18.572816 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11387ab2-18fe-4ba5-aff7-258defd518b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:18.573173 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11387ab2-18fe-4ba5-aff7-258defd518b3 admin admin] PATH_INFO: `/v3/projects/ed3f796946124f63a91320c1bffca66d` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:18.574899 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11387ab2-18fe-4ba5-aff7-258defd518b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed3f796946124f63a91320c1bffca66d)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:18.576823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11387ab2-18fe-4ba5-aff7-258defd518b3 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:18.622073 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-11387ab2-18fe-4ba5-aff7-258defd518b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed3f796946124f63a91320c1bffca66d', 'request_id': 'req-11387ab2-18fe-4ba5-aff7-258defd518b3'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:18.628006 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-11387ab2-18fe-4ba5-aff7-258defd518b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed3f796946124f63a91320c1bffca66d', 'request_id': 'req-11387ab2-18fe-4ba5-aff7-258defd518b3'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:18.633248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-11387ab2-18fe-4ba5-aff7-258defd518b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed3f796946124f63a91320c1bffca66d', 'request_id': 'req-11387ab2-18fe-4ba5-aff7-258defd518b3'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:18.646501 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-11387ab2-18fe-4ba5-aff7-258defd518b3 admin admin] The token cache is being invalidate because project ed3f796946124f63a91320c1bffca66d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:48:18.646782 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-11387ab2-18fe-4ba5-aff7-258defd518b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:18.647452 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-11387ab2-18fe-4ba5-aff7-258defd518b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:18.648989 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1422/2875] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:48:18 2022] DELETE /identity/v3/projects/ed3f796946124f63a91320c1bffca66d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:48:18.653636 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae03872-86d4-4c5e-80b5-27c0faadaf41 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:18.666369 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae03872-86d4-4c5e-80b5-27c0faadaf41 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:18.719678 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f71bd-2c10-47b9-8745-2eceb8d6df45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:18.720542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f71bd-2c10-47b9-8745-2eceb8d6df45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:18.720823 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f71bd-2c10-47b9-8745-2eceb8d6df45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:18.721122 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f71bd-2c10-47b9-8745-2eceb8d6df45 admin admin] PATH_INFO: `/v3/users/95804b7ec0c845c3889da449d4a94c38` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:18.722293 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f71bd-2c10-47b9-8745-2eceb8d6df45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95804b7ec0c845c3889da449d4a94c38)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:18.724230 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f71bd-2c10-47b9-8745-2eceb8d6df45 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:18.771822 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ff4f71bd-2c10-47b9-8745-2eceb8d6df45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95804b7ec0c845c3889da449d4a94c38'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:18.783606 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ff4f71bd-2c10-47b9-8745-2eceb8d6df45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95804b7ec0c845c3889da449d4a94c38'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:18.784274 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ff4f71bd-2c10-47b9-8745-2eceb8d6df45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95804b7ec0c845c3889da449d4a94c38'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:18.784906 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ff4f71bd-2c10-47b9-8745-2eceb8d6df45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95804b7ec0c845c3889da449d4a94c38'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:18.791593 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-ff4f71bd-2c10-47b9-8745-2eceb8d6df45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95804b7ec0c845c3889da449d4a94c38'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:18.803951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1454/2876] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:48:18 2022] DELETE /identity/v3/users/95804b7ec0c845c3889da449d4a94c38 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:48:19.070094 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11387ab2-18fe-4ba5-aff7-258defd518b3 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:19.071537 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-11387ab2-18fe-4ba5-aff7-258defd518b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:19.084554 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11387ab2-18fe-4ba5-aff7-258defd518b3 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:19.141308 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929b2fa-9099-4f52-9f5e-59ffd3a44fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:19.142170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929b2fa-9099-4f52-9f5e-59ffd3a44fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:19.142456 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929b2fa-9099-4f52-9f5e-59ffd3a44fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:19.142730 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929b2fa-9099-4f52-9f5e-59ffd3a44fa8 admin admin] PATH_INFO: `/v3/projects/05d4a308b96a438d99c42e2d9e48559b` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:19.143962 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929b2fa-9099-4f52-9f5e-59ffd3a44fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d4a308b96a438d99c42e2d9e48559b)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:19.145885 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929b2fa-9099-4f52-9f5e-59ffd3a44fa8 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:19.190689 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-8929b2fa-9099-4f52-9f5e-59ffd3a44fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d4a308b96a438d99c42e2d9e48559b', 'request_id': 'req-8929b2fa-9099-4f52-9f5e-59ffd3a44fa8'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:19.196518 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-8929b2fa-9099-4f52-9f5e-59ffd3a44fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d4a308b96a438d99c42e2d9e48559b', 'request_id': 'req-8929b2fa-9099-4f52-9f5e-59ffd3a44fa8'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:19.201774 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-8929b2fa-9099-4f52-9f5e-59ffd3a44fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d4a308b96a438d99c42e2d9e48559b', 'request_id': 'req-8929b2fa-9099-4f52-9f5e-59ffd3a44fa8'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:19.214681 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-8929b2fa-9099-4f52-9f5e-59ffd3a44fa8 admin admin] The token cache is being invalidate because project 05d4a308b96a438d99c42e2d9e48559b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:48:19.215119 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-8929b2fa-9099-4f52-9f5e-59ffd3a44fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:19.215886 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-8929b2fa-9099-4f52-9f5e-59ffd3a44fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:19.217953 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1423/2877] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:48:19 2022] DELETE /identity/v3/projects/05d4a308b96a438d99c42e2d9e48559b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:48:19.221967 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f71bd-2c10-47b9-8745-2eceb8d6df45 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:19.223396 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ff4f71bd-2c10-47b9-8745-2eceb8d6df45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:19.236356 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f71bd-2c10-47b9-8745-2eceb8d6df45 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:19.297555 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda80567-6fe3-4dfc-9f2d-9fb8e230ab6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:19.298415 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda80567-6fe3-4dfc-9f2d-9fb8e230ab6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:19.298696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda80567-6fe3-4dfc-9f2d-9fb8e230ab6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:19.299011 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda80567-6fe3-4dfc-9f2d-9fb8e230ab6e admin admin] PATH_INFO: `/v3/users/119ed48437f94812b1ddd282b94bcff0` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:19.300215 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda80567-6fe3-4dfc-9f2d-9fb8e230ab6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=119ed48437f94812b1ddd282b94bcff0)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:19.302138 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda80567-6fe3-4dfc-9f2d-9fb8e230ab6e admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:19.347523 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-cda80567-6fe3-4dfc-9f2d-9fb8e230ab6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '119ed48437f94812b1ddd282b94bcff0'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:19.360464 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-cda80567-6fe3-4dfc-9f2d-9fb8e230ab6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '119ed48437f94812b1ddd282b94bcff0'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:19.361169 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-cda80567-6fe3-4dfc-9f2d-9fb8e230ab6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '119ed48437f94812b1ddd282b94bcff0'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:19.361818 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-cda80567-6fe3-4dfc-9f2d-9fb8e230ab6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '119ed48437f94812b1ddd282b94bcff0'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:19.368429 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-cda80567-6fe3-4dfc-9f2d-9fb8e230ab6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '119ed48437f94812b1ddd282b94bcff0'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:19.381666 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1455/2878] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:48:19 2022] DELETE /identity/v3/users/119ed48437f94812b1ddd282b94bcff0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:48:19.651026 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929b2fa-9099-4f52-9f5e-59ffd3a44fa8 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:19.653120 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-8929b2fa-9099-4f52-9f5e-59ffd3a44fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:19.666150 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929b2fa-9099-4f52-9f5e-59ffd3a44fa8 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:19.724608 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17919198-f755-4f80-8acc-8d08c386c3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:19.725465 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17919198-f755-4f80-8acc-8d08c386c3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:19.725746 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17919198-f755-4f80-8acc-8d08c386c3de admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:19.726020 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17919198-f755-4f80-8acc-8d08c386c3de admin admin] PATH_INFO: `/v3/projects/8d2c274475014ea19f391ee63539a290` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:19.727419 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17919198-f755-4f80-8acc-8d08c386c3de admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d2c274475014ea19f391ee63539a290)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:19.729262 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17919198-f755-4f80-8acc-8d08c386c3de admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:19.773364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-17919198-f755-4f80-8acc-8d08c386c3de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d2c274475014ea19f391ee63539a290', 'request_id': 'req-17919198-f755-4f80-8acc-8d08c386c3de'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:19.780406 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-17919198-f755-4f80-8acc-8d08c386c3de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d2c274475014ea19f391ee63539a290', 'request_id': 'req-17919198-f755-4f80-8acc-8d08c386c3de'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:19.785978 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-17919198-f755-4f80-8acc-8d08c386c3de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d2c274475014ea19f391ee63539a290', 'request_id': 'req-17919198-f755-4f80-8acc-8d08c386c3de'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:19.797271 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-17919198-f755-4f80-8acc-8d08c386c3de admin admin] The token cache is being invalidate because project 8d2c274475014ea19f391ee63539a290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:48:19.797550 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-17919198-f755-4f80-8acc-8d08c386c3de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:19.798184 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-17919198-f755-4f80-8acc-8d08c386c3de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:19.799809 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1424/2879] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:48:19 2022] DELETE /identity/v3/projects/8d2c274475014ea19f391ee63539a290 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:48:19.805776 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4aba8-65a0-4156-8240-43728c0d8a41 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:19.806063 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4aba8-65a0-4156-8240-43728c0d8a41 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:19.806339 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4aba8-65a0-4156-8240-43728c0d8a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:19.825449 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-dbb4aba8-65a0-4156-8240-43728c0d8a41 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:48:19.826628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-dbb4aba8-65a0-4156-8240-43728c0d8a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:19.883503 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1456/2880] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:48:19.893472 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcebd1-50ac-4cbf-8821-48715daa7a7c None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:19.893761 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcebd1-50ac-4cbf-8821-48715daa7a7c None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:19.894059 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcebd1-50ac-4cbf-8821-48715daa7a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:19.913190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-51bcebd1-50ac-4cbf-8821-48715daa7a7c None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:48:19.914465 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-51bcebd1-50ac-4cbf-8821-48715daa7a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:19.922414 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1425/2881] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:48:19.926734 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4aba8-65a0-4156-8240-43728c0d8a41 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:19.936384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4aba8-65a0-4156-8240-43728c0d8a41 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:19.941101 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcbe43-ad9b-4d47-bf03-d7cd83fc9796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:19.941962 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcbe43-ad9b-4d47-bf03-d7cd83fc9796 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:19.942075 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcbe43-ad9b-4d47-bf03-d7cd83fc9796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:19.942328 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcbe43-ad9b-4d47-bf03-d7cd83fc9796 admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:19.943086 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcbe43-ad9b-4d47-bf03-d7cd83fc9796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:48:19.943411 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcbe43-ad9b-4d47-bf03-d7cd83fc9796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:19.944994 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcbe43-ad9b-4d47-bf03-d7cd83fc9796 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:19.957099 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1457/2882] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:48:19.961334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcebd1-50ac-4cbf-8821-48715daa7a7c None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:19.972201 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcebd1-50ac-4cbf-8821-48715daa7a7c None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:19.976970 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638fb09-4b80-4093-a0db-30d0dd35af5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:19.977777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638fb09-4b80-4093-a0db-30d0dd35af5d admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:19.977952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638fb09-4b80-4093-a0db-30d0dd35af5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:19.978195 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638fb09-4b80-4093-a0db-30d0dd35af5d admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:19.978918 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638fb09-4b80-4093-a0db-30d0dd35af5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:19.980814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638fb09-4b80-4093-a0db-30d0dd35af5d admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:20.006425 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1426/2883] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:48:19 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:48:20.010502 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcbe43-ad9b-4d47-bf03-d7cd83fc9796 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:20.021272 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcbe43-ad9b-4d47-bf03-d7cd83fc9796 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:20.077223 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7407f86-6e8a-4837-9f47-c69334341011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:20.077889 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7407f86-6e8a-4837-9f47-c69334341011 admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:20.078172 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7407f86-6e8a-4837-9f47-c69334341011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:20.078441 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7407f86-6e8a-4837-9f47-c69334341011 admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:20.079169 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7407f86-6e8a-4837-9f47-c69334341011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:20.081078 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7407f86-6e8a-4837-9f47-c69334341011 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:20.100382 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1458/2884] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:48:20 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:48:20.104701 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638fb09-4b80-4093-a0db-30d0dd35af5d admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:20.114918 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638fb09-4b80-4093-a0db-30d0dd35af5d admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:20.119577 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c2ffe-4b4b-4ded-859b-c4ecb667079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:20.120233 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c2ffe-4b4b-4ded-859b-c4ecb667079d admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:20.120516 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c2ffe-4b4b-4ded-859b-c4ecb667079d admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:20.120795 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c2ffe-4b4b-4ded-859b-c4ecb667079d admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:20.121517 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c2ffe-4b4b-4ded-859b-c4ecb667079d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:20.123155 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c2ffe-4b4b-4ded-859b-c4ecb667079d admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:20.134525 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1427/2885] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:48:20.140225 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7407f86-6e8a-4837-9f47-c69334341011 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:20.153187 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7407f86-6e8a-4837-9f47-c69334341011 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:20.158212 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dea4c-91fb-45d1-82cf-30f60b4a57c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:20.158907 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dea4c-91fb-45d1-82cf-30f60b4a57c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:20.159191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dea4c-91fb-45d1-82cf-30f60b4a57c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:20.159463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dea4c-91fb-45d1-82cf-30f60b4a57c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:20.160181 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87dea4c-91fb-45d1-82cf-30f60b4a57c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:20.161776 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87dea4c-91fb-45d1-82cf-30f60b4a57c8 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:20.173486 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1459/2886] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:48:20.177906 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c2ffe-4b4b-4ded-859b-c4ecb667079d admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:20.188590 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c2ffe-4b4b-4ded-859b-c4ecb667079d admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:20.193374 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3a593-954b-40ea-8d28-2c2b1c7a61d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:20.194249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3a593-954b-40ea-8d28-2c2b1c7a61d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:20.194527 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3a593-954b-40ea-8d28-2c2b1c7a61d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:20.194803 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3a593-954b-40ea-8d28-2c2b1c7a61d4 admin admin] PATH_INFO: `/v3/projects/9292621b378b462f9f38b64b707c65c2/users/30e19d42b7654c58ab937f1deb55787f/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:20.210273 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3a593-954b-40ea-8d28-2c2b1c7a61d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9292621b378b462f9f38b64b707c65c2, user_id=30e19d42b7654c58ab937f1deb55787f, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:20.213029 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3a593-954b-40ea-8d28-2c2b1c7a61d4 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:20.226135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1428/2887] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:48:20 2022] PUT /identity/v3/projects/9292621b378b462f9f38b64b707c65c2/users/30e19d42b7654c58ab937f1deb55787f/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:48:20.237413 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fff00b-31dd-4104-a07a-3a60b480c754 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:20.237922 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fff00b-31dd-4104-a07a-3a60b480c754 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:20.237922 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fff00b-31dd-4104-a07a-3a60b480c754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:20.266446 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-12fff00b-31dd-4104-a07a-3a60b480c754 None None] MFA Rules not processed for user `30e19d42b7654c58ab937f1deb55787f`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:48:20.267832 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-12fff00b-31dd-4104-a07a-3a60b480c754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:20.333315 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1460/2888] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:48:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:48:20.337948 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3a593-954b-40ea-8d28-2c2b1c7a61d4 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:20.398018 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3a593-954b-40ea-8d28-2c2b1c7a61d4 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:20.402774 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d7a3a-1ea1-4dbd-aa4b-688434bcd160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:20.403404 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d7a3a-1ea1-4dbd-aa4b-688434bcd160 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:20.403688 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d7a3a-1ea1-4dbd-aa4b-688434bcd160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:20.403965 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d7a3a-1ea1-4dbd-aa4b-688434bcd160 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:20.404664 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d7a3a-1ea1-4dbd-aa4b-688434bcd160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:20.407027 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d7a3a-1ea1-4dbd-aa4b-688434bcd160 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:20.432170 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1429/2889] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:48:20 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:48:20.436960 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fff00b-31dd-4104-a07a-3a60b480c754 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:20.447421 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fff00b-31dd-4104-a07a-3a60b480c754 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:20.500417 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ead0e-6fa2-4ab2-9f3e-ac3cc372e96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:20.500997 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ead0e-6fa2-4ab2-9f3e-ac3cc372e96d admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:20.501274 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ead0e-6fa2-4ab2-9f3e-ac3cc372e96d admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:20.501542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ead0e-6fa2-4ab2-9f3e-ac3cc372e96d admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:20.502208 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ead0e-6fa2-4ab2-9f3e-ac3cc372e96d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:20.504128 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ead0e-6fa2-4ab2-9f3e-ac3cc372e96d admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:20.524076 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1461/2890] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:48:20 2022] POST /identity/v3/users => generated 298 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:48:20.528111 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d7a3a-1ea1-4dbd-aa4b-688434bcd160 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:20.538358 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d7a3a-1ea1-4dbd-aa4b-688434bcd160 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:20.542996 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab947ee2-2739-4083-808c-eefede16dcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:20.543641 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab947ee2-2739-4083-808c-eefede16dcf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:20.543917 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab947ee2-2739-4083-808c-eefede16dcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:20.544186 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab947ee2-2739-4083-808c-eefede16dcf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:20.544898 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab947ee2-2739-4083-808c-eefede16dcf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:20.547024 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab947ee2-2739-4083-808c-eefede16dcf0 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:20.557409 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1430/2891] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:48:20.562102 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ead0e-6fa2-4ab2-9f3e-ac3cc372e96d admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:20.571660 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ead0e-6fa2-4ab2-9f3e-ac3cc372e96d admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:20.576187 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7d6bb-f0ee-4f4c-b6d9-d3da109d0eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:20.577081 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7d6bb-f0ee-4f4c-b6d9-d3da109d0eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:20.577370 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7d6bb-f0ee-4f4c-b6d9-d3da109d0eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:20.577624 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7d6bb-f0ee-4f4c-b6d9-d3da109d0eb3 admin admin] PATH_INFO: `/v3/projects/45bbd0fc29c449d2bd76c4c482b7f7e1/users/2ecefcf309134114adffb584d6d0f1b9/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:20.591553 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7d6bb-f0ee-4f4c-b6d9-d3da109d0eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45bbd0fc29c449d2bd76c4c482b7f7e1, user_id=2ecefcf309134114adffb584d6d0f1b9, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:20.594191 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7d6bb-f0ee-4f4c-b6d9-d3da109d0eb3 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:20.606985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1462/2892] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:48:20 2022] PUT /identity/v3/projects/45bbd0fc29c449d2bd76c4c482b7f7e1/users/2ecefcf309134114adffb584d6d0f1b9/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:48:20.611702 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab947ee2-2739-4083-808c-eefede16dcf0 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:20.621678 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab947ee2-2739-4083-808c-eefede16dcf0 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:20.676390 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8ea5c-c6c0-4558-b99f-65ae61a110e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:20.677066 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8ea5c-c6c0-4558-b99f-65ae61a110e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:20.677327 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8ea5c-c6c0-4558-b99f-65ae61a110e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:20.677599 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8ea5c-c6c0-4558-b99f-65ae61a110e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:20.678313 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8ea5c-c6c0-4558-b99f-65ae61a110e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:20.679933 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8ea5c-c6c0-4558-b99f-65ae61a110e4 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:20.689429 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1431/2893] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:48:20.693542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7d6bb-f0ee-4f4c-b6d9-d3da109d0eb3 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:20.704022 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7d6bb-f0ee-4f4c-b6d9-d3da109d0eb3 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:20.708666 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae54ad7-abf4-4916-8242-3886f5120206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:20.709551 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae54ad7-abf4-4916-8242-3886f5120206 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:20.709918 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae54ad7-abf4-4916-8242-3886f5120206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:20.710196 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae54ad7-abf4-4916-8242-3886f5120206 admin admin] PATH_INFO: `/v3/projects/45bbd0fc29c449d2bd76c4c482b7f7e1/users/2ecefcf309134114adffb584d6d0f1b9/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:20.712198 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae54ad7-abf4-4916-8242-3886f5120206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45bbd0fc29c449d2bd76c4c482b7f7e1, user_id=2ecefcf309134114adffb584d6d0f1b9, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:20.714790 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae54ad7-abf4-4916-8242-3886f5120206 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:20.725558 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1463/2894] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:48:20 2022] PUT /identity/v3/projects/45bbd0fc29c449d2bd76c4c482b7f7e1/users/2ecefcf309134114adffb584d6d0f1b9/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:48:20.736496 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dbd1d-de10-485d-b565-a987926e7283 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:20.736805 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dbd1d-de10-485d-b565-a987926e7283 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:20.737108 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dbd1d-de10-485d-b565-a987926e7283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:20.762275 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-831dbd1d-de10-485d-b565-a987926e7283 None None] MFA Rules not processed for user `2ecefcf309134114adffb584d6d0f1b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:48:20.763422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-831dbd1d-de10-485d-b565-a987926e7283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:20.829785 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1432/2895] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:48:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:48:20.840800 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae54ad7-abf4-4916-8242-3886f5120206 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:20.842995 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-dae54ad7-abf4-4916-8242-3886f5120206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:20.897955 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae54ad7-abf4-4916-8242-3886f5120206 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:20.901672 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878f482-91fe-4bba-86b0-bc062926508f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:20.902316 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878f482-91fe-4bba-86b0-bc062926508f service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:20.902598 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878f482-91fe-4bba-86b0-bc062926508f service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:20.902901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878f482-91fe-4bba-86b0-bc062926508f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:20.912676 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878f482-91fe-4bba-86b0-bc062926508f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:20.914102 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878f482-91fe-4bba-86b0-bc062926508f service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:20.924377 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1464/2896] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:48:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:48:21.020029 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dbd1d-de10-485d-b565-a987926e7283 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:21.029541 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dbd1d-de10-485d-b565-a987926e7283 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:21.033887 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b84151-13ac-4363-bae5-47063598ca73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:21.034522 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b84151-13ac-4363-bae5-47063598ca73 service cinder] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:21.034804 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b84151-13ac-4363-bae5-47063598ca73 service cinder] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:21.035109 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b84151-13ac-4363-bae5-47063598ca73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:21.090715 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b84151-13ac-4363-bae5-47063598ca73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:21.092189 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b84151-13ac-4363-bae5-47063598ca73 service cinder] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:21.101493 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1433/2897] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:48:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:48:23.640330 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878f482-91fe-4bba-86b0-bc062926508f service cinder] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:23.711027 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878f482-91fe-4bba-86b0-bc062926508f service cinder] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:23.715957 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422defb-1e73-4159-9ae9-9e4df765b4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:23.720919 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422defb-1e73-4159-9ae9-9e4df765b4f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:23.721216 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422defb-1e73-4159-9ae9-9e4df765b4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:23.721503 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422defb-1e73-4159-9ae9-9e4df765b4f0 admin admin] PATH_INFO: `/v3/users/30e19d42b7654c58ab937f1deb55787f` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:23.723453 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422defb-1e73-4159-9ae9-9e4df765b4f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30e19d42b7654c58ab937f1deb55787f)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:23.725529 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422defb-1e73-4159-9ae9-9e4df765b4f0 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:23.786317 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-6422defb-1e73-4159-9ae9-9e4df765b4f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30e19d42b7654c58ab937f1deb55787f'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:23.801926 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-6422defb-1e73-4159-9ae9-9e4df765b4f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30e19d42b7654c58ab937f1deb55787f'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:23.802628 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-6422defb-1e73-4159-9ae9-9e4df765b4f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30e19d42b7654c58ab937f1deb55787f'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:23.803260 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-6422defb-1e73-4159-9ae9-9e4df765b4f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30e19d42b7654c58ab937f1deb55787f'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:23.809958 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-6422defb-1e73-4159-9ae9-9e4df765b4f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30e19d42b7654c58ab937f1deb55787f'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:23.824371 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1465/2898] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:48:23 2022] DELETE /identity/v3/users/30e19d42b7654c58ab937f1deb55787f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:48:23.829635 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04975dfc-64ca-4c97-882a-ac32f481aa13 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:23.830182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04975dfc-64ca-4c97-882a-ac32f481aa13 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:23.830182 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04975dfc-64ca-4c97-882a-ac32f481aa13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:23.849773 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-04975dfc-64ca-4c97-882a-ac32f481aa13 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:48:23.851234 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-04975dfc-64ca-4c97-882a-ac32f481aa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:23.926171 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1434/2899] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:48:23.936204 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422defb-1e73-4159-9ae9-9e4df765b4f0 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:23.937626 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-6422defb-1e73-4159-9ae9-9e4df765b4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:23.996492 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422defb-1e73-4159-9ae9-9e4df765b4f0 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:24.000349 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f976032-442f-4bd4-9858-0f428f6e33b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:24.001025 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f976032-442f-4bd4-9858-0f428f6e33b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:24.001300 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f976032-442f-4bd4-9858-0f428f6e33b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:24.001570 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f976032-442f-4bd4-9858-0f428f6e33b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:24.011298 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f976032-442f-4bd4-9858-0f428f6e33b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:24.012753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f976032-442f-4bd4-9858-0f428f6e33b2 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:24.025789 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1466/2900] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:48:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:48:24.301661 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04975dfc-64ca-4c97-882a-ac32f481aa13 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:24.303161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-04975dfc-64ca-4c97-882a-ac32f481aa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:24.315032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04975dfc-64ca-4c97-882a-ac32f481aa13 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:24.319788 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b498e54-0ff1-4ce5-b497-6ab22b5d58f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:24.320651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b498e54-0ff1-4ce5-b497-6ab22b5d58f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:24.320926 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b498e54-0ff1-4ce5-b497-6ab22b5d58f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:24.321204 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b498e54-0ff1-4ce5-b497-6ab22b5d58f0 admin admin] PATH_INFO: `/v3/projects/9292621b378b462f9f38b64b707c65c2` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:24.322386 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b498e54-0ff1-4ce5-b497-6ab22b5d58f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9292621b378b462f9f38b64b707c65c2)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:24.324336 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b498e54-0ff1-4ce5-b497-6ab22b5d58f0 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:24.372459 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-8b498e54-0ff1-4ce5-b497-6ab22b5d58f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9292621b378b462f9f38b64b707c65c2', 'request_id': 'req-8b498e54-0ff1-4ce5-b497-6ab22b5d58f0'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:24.378548 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-8b498e54-0ff1-4ce5-b497-6ab22b5d58f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9292621b378b462f9f38b64b707c65c2', 'request_id': 'req-8b498e54-0ff1-4ce5-b497-6ab22b5d58f0'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:24.383890 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-8b498e54-0ff1-4ce5-b497-6ab22b5d58f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9292621b378b462f9f38b64b707c65c2', 'request_id': 'req-8b498e54-0ff1-4ce5-b497-6ab22b5d58f0'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:24.396135 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-8b498e54-0ff1-4ce5-b497-6ab22b5d58f0 admin admin] The token cache is being invalidate because project 9292621b378b462f9f38b64b707c65c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:48:24.396446 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-8b498e54-0ff1-4ce5-b497-6ab22b5d58f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:24.397083 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-8b498e54-0ff1-4ce5-b497-6ab22b5d58f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:24.398610 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1435/2901] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:48:24 2022] DELETE /identity/v3/projects/9292621b378b462f9f38b64b707c65c2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:48:24.402648 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f976032-442f-4bd4-9858-0f428f6e33b2 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:24.415765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f976032-442f-4bd4-9858-0f428f6e33b2 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:24.470337 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb71a7-a5bf-40bf-85ef-d031ff6ad2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:24.471178 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb71a7-a5bf-40bf-85ef-d031ff6ad2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:24.471460 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb71a7-a5bf-40bf-85ef-d031ff6ad2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:24.471733 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb71a7-a5bf-40bf-85ef-d031ff6ad2f2 admin admin] PATH_INFO: `/v3/users/2ecefcf309134114adffb584d6d0f1b9` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:24.472913 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb71a7-a5bf-40bf-85ef-d031ff6ad2f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ecefcf309134114adffb584d6d0f1b9)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:24.474844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb71a7-a5bf-40bf-85ef-d031ff6ad2f2 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:24.517780 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-10eb71a7-a5bf-40bf-85ef-d031ff6ad2f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ecefcf309134114adffb584d6d0f1b9'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:24.531131 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-10eb71a7-a5bf-40bf-85ef-d031ff6ad2f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ecefcf309134114adffb584d6d0f1b9'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:24.532152 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-10eb71a7-a5bf-40bf-85ef-d031ff6ad2f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ecefcf309134114adffb584d6d0f1b9'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:24.533088 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-10eb71a7-a5bf-40bf-85ef-d031ff6ad2f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ecefcf309134114adffb584d6d0f1b9'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:24.540202 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-10eb71a7-a5bf-40bf-85ef-d031ff6ad2f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ecefcf309134114adffb584d6d0f1b9'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:24.553844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1467/2902] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:48:24 2022] DELETE /identity/v3/users/2ecefcf309134114adffb584d6d0f1b9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:48:24.813667 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b498e54-0ff1-4ce5-b497-6ab22b5d58f0 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:24.815190 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-8b498e54-0ff1-4ce5-b497-6ab22b5d58f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:24.828073 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b498e54-0ff1-4ce5-b497-6ab22b5d58f0 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:24.884051 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8322db-7f26-4c83-a0d8-d8ef875a7f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:24.884920 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8322db-7f26-4c83-a0d8-d8ef875a7f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:24.885201 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8322db-7f26-4c83-a0d8-d8ef875a7f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:24.885474 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8322db-7f26-4c83-a0d8-d8ef875a7f20 admin admin] PATH_INFO: `/v3/projects/45bbd0fc29c449d2bd76c4c482b7f7e1` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:24.886685 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8322db-7f26-4c83-a0d8-d8ef875a7f20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45bbd0fc29c449d2bd76c4c482b7f7e1)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:24.888625 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8322db-7f26-4c83-a0d8-d8ef875a7f20 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:24.938956 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-5a8322db-7f26-4c83-a0d8-d8ef875a7f20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45bbd0fc29c449d2bd76c4c482b7f7e1', 'request_id': 'req-5a8322db-7f26-4c83-a0d8-d8ef875a7f20'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:24.944933 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-5a8322db-7f26-4c83-a0d8-d8ef875a7f20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45bbd0fc29c449d2bd76c4c482b7f7e1', 'request_id': 'req-5a8322db-7f26-4c83-a0d8-d8ef875a7f20'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:24.950228 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-5a8322db-7f26-4c83-a0d8-d8ef875a7f20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45bbd0fc29c449d2bd76c4c482b7f7e1', 'request_id': 'req-5a8322db-7f26-4c83-a0d8-d8ef875a7f20'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:24.962069 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-5a8322db-7f26-4c83-a0d8-d8ef875a7f20 admin admin] The token cache is being invalidate because project 45bbd0fc29c449d2bd76c4c482b7f7e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:48:24.962359 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-5a8322db-7f26-4c83-a0d8-d8ef875a7f20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:24.963006 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-5a8322db-7f26-4c83-a0d8-d8ef875a7f20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:48:24.964546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1436/2903] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:48:24 2022] DELETE /identity/v3/projects/45bbd0fc29c449d2bd76c4c482b7f7e1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:48:24.972270 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3829766-ec14-49e1-aae4-5c13f0e7fb72 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:24.972753 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3829766-ec14-49e1-aae4-5c13f0e7fb72 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:24.972874 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3829766-ec14-49e1-aae4-5c13f0e7fb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:24.990399 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-f3829766-ec14-49e1-aae4-5c13f0e7fb72 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:48:24.991555 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-f3829766-ec14-49e1-aae4-5c13f0e7fb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:25.049199 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1468/2904] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:48:25.057918 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cecdf-5589-4317-a398-8951dc9ac354 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:25.058209 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cecdf-5589-4317-a398-8951dc9ac354 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:25.058490 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cecdf-5589-4317-a398-8951dc9ac354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:25.076315 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-735cecdf-5589-4317-a398-8951dc9ac354 None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:48:25.078011 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-735cecdf-5589-4317-a398-8951dc9ac354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:25.085799 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1437/2905] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:48:25.089901 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3829766-ec14-49e1-aae4-5c13f0e7fb72 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:25.100060 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3829766-ec14-49e1-aae4-5c13f0e7fb72 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:25.104689 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec72d8-a41d-43f6-b24b-09760034150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:25.105341 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec72d8-a41d-43f6-b24b-09760034150a admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:25.105623 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec72d8-a41d-43f6-b24b-09760034150a admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:25.105904 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec72d8-a41d-43f6-b24b-09760034150a admin admin] PATH_INFO: `/v3/domains` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:25.106626 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec72d8-a41d-43f6-b24b-09760034150a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 15:48:25.106970 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec72d8-a41d-43f6-b24b-09760034150a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:25.108611 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec72d8-a41d-43f6-b24b-09760034150a admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:25.119686 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1469/2906] 10.222.0.73 () {58 vars in 1152 bytes} [Fri May 13 15:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 15:48:25.125469 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cecdf-5589-4317-a398-8951dc9ac354 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:25.132829 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cecdf-5589-4317-a398-8951dc9ac354 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:25.137452 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9240aa-9c50-49e6-8226-b033e600c0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:25.138105 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9240aa-9c50-49e6-8226-b033e600c0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:25.138382 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9240aa-9c50-49e6-8226-b033e600c0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:25.138651 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9240aa-9c50-49e6-8226-b033e600c0f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:25.139912 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9240aa-9c50-49e6-8226-b033e600c0f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:25.141806 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9240aa-9c50-49e6-8226-b033e600c0f1 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:25.166922 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1438/2907] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:48:25 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:48:25.170526 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec72d8-a41d-43f6-b24b-09760034150a admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:25.180237 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec72d8-a41d-43f6-b24b-09760034150a admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:25.236422 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb6257-75aa-4284-98e9-6be025a5174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:25.237088 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb6257-75aa-4284-98e9-6be025a5174d admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:25.237370 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb6257-75aa-4284-98e9-6be025a5174d admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:25.237650 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb6257-75aa-4284-98e9-6be025a5174d admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:25.238329 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb6257-75aa-4284-98e9-6be025a5174d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:25.240274 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb6257-75aa-4284-98e9-6be025a5174d admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:25.260127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1470/2908] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:48:25 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:48:25.264034 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9240aa-9c50-49e6-8226-b033e600c0f1 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:25.273986 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9240aa-9c50-49e6-8226-b033e600c0f1 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:25.278556 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24733a9-6b25-4be0-bf63-d4d9a47859af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:25.279249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24733a9-6b25-4be0-bf63-d4d9a47859af admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:25.279532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24733a9-6b25-4be0-bf63-d4d9a47859af admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:25.279807 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24733a9-6b25-4be0-bf63-d4d9a47859af admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:25.281078 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24733a9-6b25-4be0-bf63-d4d9a47859af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:25.282950 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24733a9-6b25-4be0-bf63-d4d9a47859af admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:25.292949 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1439/2909] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:48:25.297091 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb6257-75aa-4284-98e9-6be025a5174d admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:25.306754 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb6257-75aa-4284-98e9-6be025a5174d admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:25.311337 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd227626-0e27-4339-a7c4-2f48dd522adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:25.311985 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd227626-0e27-4339-a7c4-2f48dd522adf admin admin] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:25.312263 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd227626-0e27-4339-a7c4-2f48dd522adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:25.312537 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd227626-0e27-4339-a7c4-2f48dd522adf admin admin] PATH_INFO: `/v3/roles` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:25.313259 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd227626-0e27-4339-a7c4-2f48dd522adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:25.314844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd227626-0e27-4339-a7c4-2f48dd522adf admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:25.324404 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1471/2910] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:48:25.328111 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24733a9-6b25-4be0-bf63-d4d9a47859af admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:25.337591 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24733a9-6b25-4be0-bf63-d4d9a47859af admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:25.342125 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337febfe-acce-4411-a11d-e1e9ab2b41b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:25.343510 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337febfe-acce-4411-a11d-e1e9ab2b41b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:25.343791 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337febfe-acce-4411-a11d-e1e9ab2b41b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:25.344062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337febfe-acce-4411-a11d-e1e9ab2b41b6 admin admin] PATH_INFO: `/v3/projects/7b13da8e41254d1f9b1bec742ba4aec8/users/53c00c83210340ae9631b9f91ec07bb8/roles/0268e6ac6fb649eb89da825c5ae328ab` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:25.357771 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337febfe-acce-4411-a11d-e1e9ab2b41b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b13da8e41254d1f9b1bec742ba4aec8, user_id=53c00c83210340ae9631b9f91ec07bb8, role_id=0268e6ac6fb649eb89da825c5ae328ab)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:25.360985 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337febfe-acce-4411-a11d-e1e9ab2b41b6 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:25.373183 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1440/2911] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:48:25 2022] PUT /identity/v3/projects/7b13da8e41254d1f9b1bec742ba4aec8/users/53c00c83210340ae9631b9f91ec07bb8/roles/0268e6ac6fb649eb89da825c5ae328ab => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:48:25.378246 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ddc63-4bd8-409a-b1c4-ad2303ccd78b None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:25.378542 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ddc63-4bd8-409a-b1c4-ad2303ccd78b None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:25.378842 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ddc63-4bd8-409a-b1c4-ad2303ccd78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:25.396024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-465ddc63-4bd8-409a-b1c4-ad2303ccd78b None None] MFA Rules not processed for user `f5d162836f3c43f6919175fd34ffcf36`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:48:25.397215 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-465ddc63-4bd8-409a-b1c4-ad2303ccd78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:25.453935 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1472/2912] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:48:25.463592 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337febfe-acce-4411-a11d-e1e9ab2b41b6 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:25.465251 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-337febfe-acce-4411-a11d-e1e9ab2b41b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:25.519981 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337febfe-acce-4411-a11d-e1e9ab2b41b6 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:25.523573 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d1df6-c721-4bdd-969e-7fcf4f538693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:25.524209 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d1df6-c721-4bdd-969e-7fcf4f538693 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:25.524492 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d1df6-c721-4bdd-969e-7fcf4f538693 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:25.524767 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d1df6-c721-4bdd-969e-7fcf4f538693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:25.534381 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d1df6-c721-4bdd-969e-7fcf4f538693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:25.535822 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d1df6-c721-4bdd-969e-7fcf4f538693 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:25.544951 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1441/2913] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:48:29.537527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c78086-9c6b-4c58-80f4-4e2025e60feb None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:29.537993 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c78086-9c6b-4c58-80f4-4e2025e60feb None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:29.538095 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c78086-9c6b-4c58-80f4-4e2025e60feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:29.565067 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-a7c78086-9c6b-4c58-80f4-4e2025e60feb None None] MFA Rules not processed for user `53c00c83210340ae9631b9f91ec07bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:48:29.566404 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-a7c78086-9c6b-4c58-80f4-4e2025e60feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:29.633027 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1473/2914] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:48:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:48:29.637607 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d1df6-c721-4bdd-969e-7fcf4f538693 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:29.647843 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d1df6-c721-4bdd-969e-7fcf4f538693 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:29.652467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb098c5d-4211-4a9f-833c-96ddfed193c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:29.653043 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb098c5d-4211-4a9f-833c-96ddfed193c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:29.653326 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb098c5d-4211-4a9f-833c-96ddfed193c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:29.653600 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb098c5d-4211-4a9f-833c-96ddfed193c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:29.654279 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb098c5d-4211-4a9f-833c-96ddfed193c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:29.657056 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb098c5d-4211-4a9f-833c-96ddfed193c5 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:29.684177 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1442/2915] 10.222.0.73 () {60 vars in 1152 bytes} [Fri May 13 15:48:29 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 15:48:29.689249 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c78086-9c6b-4c58-80f4-4e2025e60feb None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:29.701189 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c78086-9c6b-4c58-80f4-4e2025e60feb None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:29.757171 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eacbda-55cf-45b9-8e17-2474fcdca05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:29.757842 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eacbda-55cf-45b9-8e17-2474fcdca05b admin admin] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:29.758118 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eacbda-55cf-45b9-8e17-2474fcdca05b admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:29.758389 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eacbda-55cf-45b9-8e17-2474fcdca05b admin admin] PATH_INFO: `/v3/users` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:29.759114 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eacbda-55cf-45b9-8e17-2474fcdca05b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:29.761047 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eacbda-55cf-45b9-8e17-2474fcdca05b admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:29.783069 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1474/2916] 10.222.0.73 () {60 vars in 1143 bytes} [Fri May 13 15:48:29 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 15:48:29.787161 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb098c5d-4211-4a9f-833c-96ddfed193c5 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:29.797888 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb098c5d-4211-4a9f-833c-96ddfed193c5 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:29.802546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15740766-7827-438c-ad22-7a54ddf88078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:29.803257 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15740766-7827-438c-ad22-7a54ddf88078 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:29.803535 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15740766-7827-438c-ad22-7a54ddf88078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:29.803807 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15740766-7827-438c-ad22-7a54ddf88078 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:29.804527 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15740766-7827-438c-ad22-7a54ddf88078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:29.806124 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15740766-7827-438c-ad22-7a54ddf88078 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:29.817559 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1443/2917] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 15:48:29.821874 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eacbda-55cf-45b9-8e17-2474fcdca05b admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:29.832765 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eacbda-55cf-45b9-8e17-2474fcdca05b admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:29.837532 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6095d59-4ae2-4715-a95d-8d38203396e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:29.838421 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6095d59-4ae2-4715-a95d-8d38203396e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:29.838696 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6095d59-4ae2-4715-a95d-8d38203396e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:29.839013 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6095d59-4ae2-4715-a95d-8d38203396e6 admin admin] PATH_INFO: `/v3/projects/c99b4a8219844cc7a1c49707df0841bc/users/47a3586c2dcc47a4844dd89d52eb1cfc/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:29.854237 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6095d59-4ae2-4715-a95d-8d38203396e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c99b4a8219844cc7a1c49707df0841bc, user_id=47a3586c2dcc47a4844dd89d52eb1cfc, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:29.857014 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6095d59-4ae2-4715-a95d-8d38203396e6 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:29.870963 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1475/2918] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:48:29 2022] PUT /identity/v3/projects/c99b4a8219844cc7a1c49707df0841bc/users/47a3586c2dcc47a4844dd89d52eb1cfc/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:48:29.875312 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15740766-7827-438c-ad22-7a54ddf88078 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:29.888695 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15740766-7827-438c-ad22-7a54ddf88078 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:29.955291 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f32a2e-6131-4686-b904-defd78297194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:29.955993 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f32a2e-6131-4686-b904-defd78297194 admin admin] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:29.956277 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f32a2e-6131-4686-b904-defd78297194 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:29.956669 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f32a2e-6131-4686-b904-defd78297194 admin admin] PATH_INFO: `/v3/roles` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:29.957398 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f32a2e-6131-4686-b904-defd78297194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:29.959446 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f32a2e-6131-4686-b904-defd78297194 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:29.969745 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1444/2919] 10.222.0.73 () {58 vars in 1121 bytes} [Fri May 13 15:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 15:48:29.973862 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6095d59-4ae2-4715-a95d-8d38203396e6 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:29.983965 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6095d59-4ae2-4715-a95d-8d38203396e6 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:29.988621 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457e1e6-a35e-42e8-8678-054afa487d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:29.989494 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457e1e6-a35e-42e8-8678-054afa487d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:29.989772 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457e1e6-a35e-42e8-8678-054afa487d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:29.990044 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457e1e6-a35e-42e8-8678-054afa487d9c admin admin] PATH_INFO: `/v3/projects/c99b4a8219844cc7a1c49707df0841bc/users/47a3586c2dcc47a4844dd89d52eb1cfc/roles/b6fbf976763d4795afbfb53a09ec6f6c` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:29.992012 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457e1e6-a35e-42e8-8678-054afa487d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c99b4a8219844cc7a1c49707df0841bc, user_id=47a3586c2dcc47a4844dd89d52eb1cfc, role_id=b6fbf976763d4795afbfb53a09ec6f6c)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:29.994641 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457e1e6-a35e-42e8-8678-054afa487d9c admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:30.005136 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1476/2920] 10.222.0.73 () {60 vars in 1482 bytes} [Fri May 13 15:48:29 2022] PUT /identity/v3/projects/c99b4a8219844cc7a1c49707df0841bc/users/47a3586c2dcc47a4844dd89d52eb1cfc/roles/b6fbf976763d4795afbfb53a09ec6f6c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:48:34.965713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f382aeb-e72c-4eed-bb63-23e228001c2f None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:34.966265 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f382aeb-e72c-4eed-bb63-23e228001c2f None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:34.966355 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f382aeb-e72c-4eed-bb63-23e228001c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:35.000249 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-3f382aeb-e72c-4eed-bb63-23e228001c2f None None] MFA Rules not processed for user `47a3586c2dcc47a4844dd89d52eb1cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:48:35.001986 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-3f382aeb-e72c-4eed-bb63-23e228001c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:35.088320 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1445/2921] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:48:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:48:35.102749 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457e1e6-a35e-42e8-8678-054afa487d9c admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:48:35.104594 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-3457e1e6-a35e-42e8-8678-054afa487d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:48:35.184624 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457e1e6-a35e-42e8-8678-054afa487d9c admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:48:35.192289 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc60356-e8c3-46a9-8ab7-14c69e0c4de9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:48:35.193241 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc60356-e8c3-46a9-8ab7-14c69e0c4de9 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:48:35.193602 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc60356-e8c3-46a9-8ab7-14c69e0c4de9 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:48:35.193955 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc60356-e8c3-46a9-8ab7-14c69e0c4de9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:48:35.260853 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc60356-e8c3-46a9-8ab7-14c69e0c4de9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:48:35.262430 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc60356-e8c3-46a9-8ab7-14c69e0c4de9 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:48:35.271400 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1477/2922] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:48:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:49:03.941438 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93e749-17f3-4b7c-aabe-4b9a1ec4b714 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:49:03.941900 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93e749-17f3-4b7c-aabe-4b9a1ec4b714 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:49:03.942102 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93e749-17f3-4b7c-aabe-4b9a1ec4b714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:49:03.961851 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-cb93e749-17f3-4b7c-aabe-4b9a1ec4b714 None None] MFA Rules not processed for user `53c00c83210340ae9631b9f91ec07bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:49:03.963058 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-cb93e749-17f3-4b7c-aabe-4b9a1ec4b714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:49:03.969799 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1446/2923] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:49:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:49:07.203670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc60356-e8c3-46a9-8ab7-14c69e0c4de9 service nova] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:49:07.205182 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-3fc60356-e8c3-46a9-8ab7-14c69e0c4de9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:49:07.273791 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc60356-e8c3-46a9-8ab7-14c69e0c4de9 service nova] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:49:07.277538 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786a64f-48ea-4558-a408-43e83046085f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:49:07.278222 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786a64f-48ea-4558-a408-43e83046085f service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:49:07.278506 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786a64f-48ea-4558-a408-43e83046085f service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:49:07.278785 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786a64f-48ea-4558-a408-43e83046085f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:49:07.280666 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-0786a64f-48ea-4558-a408-43e83046085f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:49:07.291127 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786a64f-48ea-4558-a408-43e83046085f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:49:07.292582 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786a64f-48ea-4558-a408-43e83046085f service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:49:07.301200 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1478/2924] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:49:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:49:15.153223 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93e749-17f3-4b7c-aabe-4b9a1ec4b714 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:49:15.163735 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93e749-17f3-4b7c-aabe-4b9a1ec4b714 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:49:15.167274 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd1375-3452-428e-9013-2030e6361a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:49:15.167904 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd1375-3452-428e-9013-2030e6361a4c service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:49:15.168189 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd1375-3452-428e-9013-2030e6361a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:49:15.168467 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd1375-3452-428e-9013-2030e6361a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:49:15.170216 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-40bd1375-3452-428e-9013-2030e6361a4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:49:15.183873 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd1375-3452-428e-9013-2030e6361a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:49:15.185244 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd1375-3452-428e-9013-2030e6361a4c service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:49:15.196014 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1447/2925] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:49:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:49:18.672535 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786a64f-48ea-4558-a408-43e83046085f service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:49:18.673942 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-0786a64f-48ea-4558-a408-43e83046085f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:49:18.690234 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd1375-3452-428e-9013-2030e6361a4c service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:49:18.698990 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd1375-3452-428e-9013-2030e6361a4c service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:49:18.702590 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e89ee9-5e6a-48d0-9d81-709ec1e53145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:49:18.703239 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e89ee9-5e6a-48d0-9d81-709ec1e53145 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:49:18.703519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e89ee9-5e6a-48d0-9d81-709ec1e53145 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:49:18.703788 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e89ee9-5e6a-48d0-9d81-709ec1e53145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:49:18.705544 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-d7e89ee9-5e6a-48d0-9d81-709ec1e53145 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:49:18.719422 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e89ee9-5e6a-48d0-9d81-709ec1e53145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:49:18.720835 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e89ee9-5e6a-48d0-9d81-709ec1e53145 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:49:18.731684 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1448/2926] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:49:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 15:49:18.754021 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786a64f-48ea-4558-a408-43e83046085f service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:49:18.759635 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece2804-b47f-4b6d-aac4-f8af7926aad6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908d23b035f14756b438b3a61a63b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:49:18.760281 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece2804-b47f-4b6d-aac4-f8af7926aad6 service placement] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:49:18.760563 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece2804-b47f-4b6d-aac4-f8af7926aad6 service placement] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:49:18.760838 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece2804-b47f-4b6d-aac4-f8af7926aad6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:49:18.762600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-3ece2804-b47f-4b6d-aac4-f8af7926aad6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:49:18.774903 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece2804-b47f-4b6d-aac4-f8af7926aad6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:49:18.776536 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece2804-b47f-4b6d-aac4-f8af7926aad6 service placement] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:49:18.786735 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1479/2927] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:49:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:49:21.249889 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e89ee9-5e6a-48d0-9d81-709ec1e53145 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:49:21.258213 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e89ee9-5e6a-48d0-9d81-709ec1e53145 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:49:21.261763 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba267033-38a8-41b3-a892-234ea650c3bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:49:21.262385 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba267033-38a8-41b3-a892-234ea650c3bc service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:49:21.262664 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba267033-38a8-41b3-a892-234ea650c3bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:49:21.262979 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba267033-38a8-41b3-a892-234ea650c3bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:49:21.264671 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-ba267033-38a8-41b3-a892-234ea650c3bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:49:21.320664 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba267033-38a8-41b3-a892-234ea650c3bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:49:21.322072 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba267033-38a8-41b3-a892-234ea650c3bc service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:49:21.330568 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1449/2928] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:49:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:49:22.220612 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece2804-b47f-4b6d-aac4-f8af7926aad6 service placement] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:49:22.233154 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece2804-b47f-4b6d-aac4-f8af7926aad6 service placement] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:49:22.238631 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd010fd-7225-40b7-a272-9c31be4a5d18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:49:22.239410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd010fd-7225-40b7-a272-9c31be4a5d18 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:49:22.239693 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd010fd-7225-40b7-a272-9c31be4a5d18 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:49:22.239969 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd010fd-7225-40b7-a272-9c31be4a5d18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:49:22.242330 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-1fd010fd-7225-40b7-a272-9c31be4a5d18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:49:22.254868 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd010fd-7225-40b7-a272-9c31be4a5d18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:49:22.256505 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd010fd-7225-40b7-a272-9c31be4a5d18 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:49:22.268382 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1480/2929] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:49:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:49:22.751290 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba267033-38a8-41b3-a892-234ea650c3bc service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:49:22.759858 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba267033-38a8-41b3-a892-234ea650c3bc service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:49:22.763544 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf07fc-b038-4a47-95e3-78ab14fbb335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:49:22.764183 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf07fc-b038-4a47-95e3-78ab14fbb335 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:49:22.764489 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf07fc-b038-4a47-95e3-78ab14fbb335 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:49:22.764762 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf07fc-b038-4a47-95e3-78ab14fbb335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:49:22.773917 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf07fc-b038-4a47-95e3-78ab14fbb335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:49:22.775383 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf07fc-b038-4a47-95e3-78ab14fbb335 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:49:22.785062 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1450/2930] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:49:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:49:24.666194 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd010fd-7225-40b7-a272-9c31be4a5d18 service nova] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:49:24.679442 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd010fd-7225-40b7-a272-9c31be4a5d18 service nova] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:49:24.685573 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91aa0b-ba61-4c04-b5f2-756374061723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:49:24.686469 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91aa0b-ba61-4c04-b5f2-756374061723 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:49:24.686844 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91aa0b-ba61-4c04-b5f2-756374061723 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:49:24.687330 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91aa0b-ba61-4c04-b5f2-756374061723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:49:24.689315 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ba91aa0b-ba61-4c04-b5f2-756374061723 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:49:24.705592 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91aa0b-ba61-4c04-b5f2-756374061723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:49:24.707775 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91aa0b-ba61-4c04-b5f2-756374061723 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:49:24.726557 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1481/2931] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:49:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:49:26.119507 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf07fc-b038-4a47-95e3-78ab14fbb335 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:49:26.128921 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf07fc-b038-4a47-95e3-78ab14fbb335 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:49:26.132722 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cd88d-0c87-4d13-8ad0-f1e04b24cd32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:49:26.133346 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cd88d-0c87-4d13-8ad0-f1e04b24cd32 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:49:26.133627 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cd88d-0c87-4d13-8ad0-f1e04b24cd32 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:49:26.133901 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cd88d-0c87-4d13-8ad0-f1e04b24cd32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:49:26.135673 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-c39cd88d-0c87-4d13-8ad0-f1e04b24cd32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:49:26.196700 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cd88d-0c87-4d13-8ad0-f1e04b24cd32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:49:26.198045 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cd88d-0c87-4d13-8ad0-f1e04b24cd32 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:49:26.207395 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1451/2932] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:49:32.476201 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91aa0b-ba61-4c04-b5f2-756374061723 service nova] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:49:32.477788 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-ba91aa0b-ba61-4c04-b5f2-756374061723 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:49:32.493125 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91aa0b-ba61-4c04-b5f2-756374061723 service nova] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:49:32.497782 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a335a-23a2-4973-bab7-aff5e0c19adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:49:32.498647 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a335a-23a2-4973-bab7-aff5e0c19adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:49:32.498959 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a335a-23a2-4973-bab7-aff5e0c19adc admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:49:32.499238 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a335a-23a2-4973-bab7-aff5e0c19adc admin admin] PATH_INFO: `/v3/users/cb5eb88bdfdb4df784e194336de814c1` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:49:32.500407 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a335a-23a2-4973-bab7-aff5e0c19adc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb5eb88bdfdb4df784e194336de814c1)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:49:32.502308 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a335a-23a2-4973-bab7-aff5e0c19adc admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:49:32.557641 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2e0a335a-23a2-4973-bab7-aff5e0c19adc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb5eb88bdfdb4df784e194336de814c1'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:49:32.569739 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2e0a335a-23a2-4973-bab7-aff5e0c19adc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb5eb88bdfdb4df784e194336de814c1'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:49:32.570527 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2e0a335a-23a2-4973-bab7-aff5e0c19adc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb5eb88bdfdb4df784e194336de814c1'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:49:32.571255 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2e0a335a-23a2-4973-bab7-aff5e0c19adc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb5eb88bdfdb4df784e194336de814c1'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:49:32.578041 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-2e0a335a-23a2-4973-bab7-aff5e0c19adc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb5eb88bdfdb4df784e194336de814c1'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:49:32.594111 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1482/2933] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:49:32 2022] DELETE /identity/v3/users/cb5eb88bdfdb4df784e194336de814c1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:49:32.764711 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cd88d-0c87-4d13-8ad0-f1e04b24cd32 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:49:32.775178 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cd88d-0c87-4d13-8ad0-f1e04b24cd32 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:49:32.833341 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5e9c9-3ddd-4ac1-acde-cfd0e38450bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:49:32.834222 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5e9c9-3ddd-4ac1-acde-cfd0e38450bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:49:32.834508 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5e9c9-3ddd-4ac1-acde-cfd0e38450bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:49:32.834784 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5e9c9-3ddd-4ac1-acde-cfd0e38450bd admin admin] PATH_INFO: `/v3/projects/46f4825db9e745b4bc1f167937dda229` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:49:32.836553 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5e9c9-3ddd-4ac1-acde-cfd0e38450bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=46f4825db9e745b4bc1f167937dda229)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:49:32.838502 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5e9c9-3ddd-4ac1-acde-cfd0e38450bd admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:49:32.886052 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-65c5e9c9-3ddd-4ac1-acde-cfd0e38450bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46f4825db9e745b4bc1f167937dda229', 'request_id': 'req-65c5e9c9-3ddd-4ac1-acde-cfd0e38450bd'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:49:32.894797 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-65c5e9c9-3ddd-4ac1-acde-cfd0e38450bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46f4825db9e745b4bc1f167937dda229', 'request_id': 'req-65c5e9c9-3ddd-4ac1-acde-cfd0e38450bd'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:49:32.901530 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-65c5e9c9-3ddd-4ac1-acde-cfd0e38450bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46f4825db9e745b4bc1f167937dda229', 'request_id': 'req-65c5e9c9-3ddd-4ac1-acde-cfd0e38450bd'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:49:32.916364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-65c5e9c9-3ddd-4ac1-acde-cfd0e38450bd admin admin] The token cache is being invalidate because project 46f4825db9e745b4bc1f167937dda229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:49:32.916653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-65c5e9c9-3ddd-4ac1-acde-cfd0e38450bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:49:32.917583 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-65c5e9c9-3ddd-4ac1-acde-cfd0e38450bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:49:32.919396 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1452/2934] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:49:32 2022] DELETE /identity/v3/projects/46f4825db9e745b4bc1f167937dda229 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:49:32.923855 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a335a-23a2-4973-bab7-aff5e0c19adc admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:49:32.924817 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-2e0a335a-23a2-4973-bab7-aff5e0c19adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:49:32.937708 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a335a-23a2-4973-bab7-aff5e0c19adc admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:49:32.992124 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214c68f-2964-4205-ad9f-43b9da55b53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:49:32.992893 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214c68f-2964-4205-ad9f-43b9da55b53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:49:32.993173 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214c68f-2964-4205-ad9f-43b9da55b53e admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:49:32.993448 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214c68f-2964-4205-ad9f-43b9da55b53e admin admin] PATH_INFO: `/v3/users/619ec8aef78e4af5a32085cfaee7224a` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:49:32.994632 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214c68f-2964-4205-ad9f-43b9da55b53e admin admin] RBAC: Authorizing `identity:delete_user(user_id=619ec8aef78e4af5a32085cfaee7224a)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:49:32.996613 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214c68f-2964-4205-ad9f-43b9da55b53e admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:49:33.041674 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7214c68f-2964-4205-ad9f-43b9da55b53e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '619ec8aef78e4af5a32085cfaee7224a'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:49:33.052892 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7214c68f-2964-4205-ad9f-43b9da55b53e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '619ec8aef78e4af5a32085cfaee7224a'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:49:33.053541 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7214c68f-2964-4205-ad9f-43b9da55b53e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '619ec8aef78e4af5a32085cfaee7224a'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:49:33.054133 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7214c68f-2964-4205-ad9f-43b9da55b53e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '619ec8aef78e4af5a32085cfaee7224a'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:49:33.060526 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-7214c68f-2964-4205-ad9f-43b9da55b53e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '619ec8aef78e4af5a32085cfaee7224a'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:49:33.073036 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1483/2935] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:49:32 2022] DELETE /identity/v3/users/619ec8aef78e4af5a32085cfaee7224a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 15:49:33.237471 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5e9c9-3ddd-4ac1-acde-cfd0e38450bd admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:49:33.239228 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-65c5e9c9-3ddd-4ac1-acde-cfd0e38450bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:49:33.256656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5e9c9-3ddd-4ac1-acde-cfd0e38450bd admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:49:33.314963 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14a301-a4f2-4686-ac61-eebae0057d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:49:33.315814 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14a301-a4f2-4686-ac61-eebae0057d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:49:33.316096 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14a301-a4f2-4686-ac61-eebae0057d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:49:33.316368 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14a301-a4f2-4686-ac61-eebae0057d00 admin admin] PATH_INFO: `/v3/projects/070083eee2c7411e97ad7b68acf09e4e` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:49:33.317532 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14a301-a4f2-4686-ac61-eebae0057d00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=070083eee2c7411e97ad7b68acf09e4e)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:49:33.319521 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14a301-a4f2-4686-ac61-eebae0057d00 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:49:33.364989 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2a14a301-a4f2-4686-ac61-eebae0057d00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070083eee2c7411e97ad7b68acf09e4e', 'request_id': 'req-2a14a301-a4f2-4686-ac61-eebae0057d00'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:49:33.371653 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2a14a301-a4f2-4686-ac61-eebae0057d00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070083eee2c7411e97ad7b68acf09e4e', 'request_id': 'req-2a14a301-a4f2-4686-ac61-eebae0057d00'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:49:33.376893 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2a14a301-a4f2-4686-ac61-eebae0057d00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070083eee2c7411e97ad7b68acf09e4e', 'request_id': 'req-2a14a301-a4f2-4686-ac61-eebae0057d00'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:49:33.389371 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2a14a301-a4f2-4686-ac61-eebae0057d00 admin admin] The token cache is being invalidate because project 070083eee2c7411e97ad7b68acf09e4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79916) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:49:33.389663 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2a14a301-a4f2-4686-ac61-eebae0057d00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:49:33.390290 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-2a14a301-a4f2-4686-ac61-eebae0057d00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:49:33.391852 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1453/2936] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:49:33 2022] DELETE /identity/v3/projects/070083eee2c7411e97ad7b68acf09e4e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:51:43.324099 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c62a0-aa54-499a-a1be-4ad96161320e None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:51:43.324588 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c62a0-aa54-499a-a1be-4ad96161320e None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:51:43.324681 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c62a0-aa54-499a-a1be-4ad96161320e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:51:43.341383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-1d8c62a0-aa54-499a-a1be-4ad96161320e None None] MFA Rules not processed for user `53c00c83210340ae9631b9f91ec07bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:51:43.342564 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-1d8c62a0-aa54-499a-a1be-4ad96161320e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:51:43.393858 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1484/2937] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:51:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:51:43.702466 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14a301-a4f2-4686-ac61-eebae0057d00 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:51:43.703894 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-2a14a301-a4f2-4686-ac61-eebae0057d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:51:43.757637 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14a301-a4f2-4686-ac61-eebae0057d00 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:51:43.761817 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfc936-2868-4a46-90f4-69a23e7c51cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:51:43.762451 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfc936-2868-4a46-90f4-69a23e7c51cb service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:51:43.762734 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfc936-2868-4a46-90f4-69a23e7c51cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:51:43.763036 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfc936-2868-4a46-90f4-69a23e7c51cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:51:43.764753 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-66bfc936-2868-4a46-90f4-69a23e7c51cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:51:43.773876 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfc936-2868-4a46-90f4-69a23e7c51cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:51:43.775952 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfc936-2868-4a46-90f4-69a23e7c51cb service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:51:43.783714 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1454/2938] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:51:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:51:45.225470 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c62a0-aa54-499a-a1be-4ad96161320e None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:51:45.226873 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-1d8c62a0-aa54-499a-a1be-4ad96161320e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:51:45.294953 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c62a0-aa54-499a-a1be-4ad96161320e None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:51:45.300014 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c51750-7213-4e20-8bfd-c99851bcce04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908d23b035f14756b438b3a61a63b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:51:45.300670 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c51750-7213-4e20-8bfd-c99851bcce04 service placement] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:51:45.300951 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c51750-7213-4e20-8bfd-c99851bcce04 service placement] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:51:45.301227 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c51750-7213-4e20-8bfd-c99851bcce04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:51:45.303024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-09c51750-7213-4e20-8bfd-c99851bcce04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:51:45.315024 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c51750-7213-4e20-8bfd-c99851bcce04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:51:45.316620 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c51750-7213-4e20-8bfd-c99851bcce04 service placement] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:51:45.326889 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1485/2939] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:51:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:52:02.571656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfc936-2868-4a46-90f4-69a23e7c51cb service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:52:02.573862 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-66bfc936-2868-4a46-90f4-69a23e7c51cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:52:02.662494 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfc936-2868-4a46-90f4-69a23e7c51cb service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:52:02.668335 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bed48e-23f6-4229-a345-821948053433 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:52:02.669007 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bed48e-23f6-4229-a345-821948053433 service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:52:02.669294 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bed48e-23f6-4229-a345-821948053433 service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:52:02.669574 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bed48e-23f6-4229-a345-821948053433 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:52:02.671378 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-29bed48e-23f6-4229-a345-821948053433 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:52:02.683580 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bed48e-23f6-4229-a345-821948053433 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:52:02.685154 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bed48e-23f6-4229-a345-821948053433 service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:52:02.695438 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1455/2940] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:52:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:53:56.819030 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c51750-7213-4e20-8bfd-c99851bcce04 service placement] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:53:56.820438 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-09c51750-7213-4e20-8bfd-c99851bcce04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:53:56.895550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c51750-7213-4e20-8bfd-c99851bcce04 service placement] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:53:56.899386 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc246cd6-b9cb-4dcd-bd7c-eb6afa4ed96f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '343a23610db84b028ccc05e4f876a0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:53:56.900036 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc246cd6-b9cb-4dcd-bd7c-eb6afa4ed96f service cinder] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:53:56.900319 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc246cd6-b9cb-4dcd-bd7c-eb6afa4ed96f service cinder] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:53:56.900595 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc246cd6-b9cb-4dcd-bd7c-eb6afa4ed96f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:53:56.902384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-fc246cd6-b9cb-4dcd-bd7c-eb6afa4ed96f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:53:56.913545 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc246cd6-b9cb-4dcd-bd7c-eb6afa4ed96f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:53:56.915368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc246cd6-b9cb-4dcd-bd7c-eb6afa4ed96f service cinder] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:53:56.926287 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1486/2941] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:53:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:54:07.852405 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117b60f-03a8-42c2-921b-164749f609ff None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:54:07.852926 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117b60f-03a8-42c2-921b-164749f609ff None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:54:07.853042 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117b60f-03a8-42c2-921b-164749f609ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:54:07.870841 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-5117b60f-03a8-42c2-921b-164749f609ff None None] MFA Rules not processed for user `53c00c83210340ae9631b9f91ec07bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:54:07.872032 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-5117b60f-03a8-42c2-921b-164749f609ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:54:07.879030 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1456/2942] 10.222.0.73 () {58 vars in 957 bytes} [Fri May 13 15:54:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 15:54:08.190966 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadc1c0-4d81-4e23-9902-4b6d7f8cc318 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:54:08.191500 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadc1c0-4d81-4e23-9902-4b6d7f8cc318 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:54:08.191500 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadc1c0-4d81-4e23-9902-4b6d7f8cc318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:54:08.255476 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-bcadc1c0-4d81-4e23-9902-4b6d7f8cc318 None None] MFA Rules not processed for user `ee97a542470644f89cd665dfdf2f9e92`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:54:08.256744 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-bcadc1c0-4d81-4e23-9902-4b6d7f8cc318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:54:08.263192 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1487/2943] 10.222.0.73 () {58 vars in 1061 bytes} [Fri May 13 15:54:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:54:08.269430 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117b60f-03a8-42c2-921b-164749f609ff None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:54:08.278708 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117b60f-03a8-42c2-921b-164749f609ff None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:54:08.282809 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4c672-ef1c-4441-b210-7ee46c07fdb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:54:08.283469 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4c672-ef1c-4441-b210-7ee46c07fdb8 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:54:08.283751 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4c672-ef1c-4441-b210-7ee46c07fdb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:54:08.284038 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4c672-ef1c-4441-b210-7ee46c07fdb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:54:08.285781 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-67d4c672-ef1c-4441-b210-7ee46c07fdb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:54:08.295674 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4c672-ef1c-4441-b210-7ee46c07fdb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:54:08.297128 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4c672-ef1c-4441-b210-7ee46c07fdb8 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:54:08.307546 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1457/2944] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:54:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:54:10.416550 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadc1c0-4d81-4e23-9902-4b6d7f8cc318 None None] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:54:10.418038 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-bcadc1c0-4d81-4e23-9902-4b6d7f8cc318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:54:10.429658 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadc1c0-4d81-4e23-9902-4b6d7f8cc318 None None] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:54:10.433463 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba0cb4-5fa6-48bc-9164-78c061759b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:54:10.434521 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba0cb4-5fa6-48bc-9164-78c061759b2e service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:54:10.434987 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba0cb4-5fa6-48bc-9164-78c061759b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:54:10.435410 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba0cb4-5fa6-48bc-9164-78c061759b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:54:10.437426 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-74ba0cb4-5fa6-48bc-9164-78c061759b2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:54:10.448829 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba0cb4-5fa6-48bc-9164-78c061759b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:54:10.450545 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba0cb4-5fa6-48bc-9164-78c061759b2e service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:54:10.460300 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1488/2945] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:54:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:54:15.634793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4c672-ef1c-4441-b210-7ee46c07fdb8 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:54:15.643686 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4c672-ef1c-4441-b210-7ee46c07fdb8 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:54:15.647311 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a83f20-f03e-4b2c-9eea-c0762e87dfb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:54:15.647943 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a83f20-f03e-4b2c-9eea-c0762e87dfb1 service neutron] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:54:15.648224 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a83f20-f03e-4b2c-9eea-c0762e87dfb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:54:15.648518 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a83f20-f03e-4b2c-9eea-c0762e87dfb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:54:15.650275 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-f3a83f20-f03e-4b2c-9eea-c0762e87dfb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:54:15.664024 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a83f20-f03e-4b2c-9eea-c0762e87dfb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:54:15.665449 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a83f20-f03e-4b2c-9eea-c0762e87dfb1 service neutron] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:54:15.676455 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1458/2946] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:54:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:54:21.488825 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba0cb4-5fa6-48bc-9164-78c061759b2e service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:54:21.497256 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba0cb4-5fa6-48bc-9164-78c061759b2e service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:54:21.500871 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3553d-9640-4c03-96e6-60486718a288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:54:21.502290 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3553d-9640-4c03-96e6-60486718a288 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:54:21.502567 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3553d-9640-4c03-96e6-60486718a288 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:54:21.502853 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3553d-9640-4c03-96e6-60486718a288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:54:21.504691 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-54f3553d-9640-4c03-96e6-60486718a288 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:54:21.517563 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3553d-9640-4c03-96e6-60486718a288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:54:21.519008 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3553d-9640-4c03-96e6-60486718a288 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:54:21.529509 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1489/2947] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:54:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:54:24.692673 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a83f20-f03e-4b2c-9eea-c0762e87dfb1 service neutron] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:54:24.703733 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a83f20-f03e-4b2c-9eea-c0762e87dfb1 service neutron] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:54:24.709311 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c7b6d-0aa1-4263-b99b-dd3e95a2849c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908d23b035f14756b438b3a61a63b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:54:24.710399 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c7b6d-0aa1-4263-b99b-dd3e95a2849c service placement] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:54:24.710943 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c7b6d-0aa1-4263-b99b-dd3e95a2849c service placement] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:54:24.711445 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c7b6d-0aa1-4263-b99b-dd3e95a2849c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:54:24.713431 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-3e5c7b6d-0aa1-4263-b99b-dd3e95a2849c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:54:24.745035 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c7b6d-0aa1-4263-b99b-dd3e95a2849c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:54:24.746656 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c7b6d-0aa1-4263-b99b-dd3e95a2849c service placement] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:54:24.756614 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1459/2948] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:54:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:54:27.629984 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3553d-9640-4c03-96e6-60486718a288 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:54:27.638165 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3553d-9640-4c03-96e6-60486718a288 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:54:27.641754 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a21d5a-503a-4680-9a3f-49078244f44a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:54:27.642383 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a21d5a-503a-4680-9a3f-49078244f44a service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:54:27.642663 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a21d5a-503a-4680-9a3f-49078244f44a service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:54:27.642971 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a21d5a-503a-4680-9a3f-49078244f44a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:54:27.644719 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-d4a21d5a-503a-4680-9a3f-49078244f44a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:54:27.706924 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a21d5a-503a-4680-9a3f-49078244f44a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:54:27.708359 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a21d5a-503a-4680-9a3f-49078244f44a service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:54:27.717786 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1490/2949] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:54:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:54:29.628102 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c7b6d-0aa1-4263-b99b-dd3e95a2849c service placement] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:54:29.640717 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c7b6d-0aa1-4263-b99b-dd3e95a2849c service placement] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:54:29.646327 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd56934-8521-4aba-a2b6-5f0f6cc9d7a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:54:29.648816 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd56934-8521-4aba-a2b6-5f0f6cc9d7a8 service nova] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:54:29.648816 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd56934-8521-4aba-a2b6-5f0f6cc9d7a8 service nova] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:54:29.648816 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd56934-8521-4aba-a2b6-5f0f6cc9d7a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:54:29.649355 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-8dd56934-8521-4aba-a2b6-5f0f6cc9d7a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:54:29.661856 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd56934-8521-4aba-a2b6-5f0f6cc9d7a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:54:29.663468 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd56934-8521-4aba-a2b6-5f0f6cc9d7a8 service nova] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:54:29.674869 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1460/2950] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:54:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:56:25.973588 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a21d5a-503a-4680-9a3f-49078244f44a service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:56:25.986490 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a21d5a-503a-4680-9a3f-49078244f44a service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:56:25.992865 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b54d53-c6cb-4499-bc82-670332d80a88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d539202cfb40a48b231713e16a599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:56:25.993633 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b54d53-c6cb-4499-bc82-670332d80a88 service nova] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:56:25.994088 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b54d53-c6cb-4499-bc82-670332d80a88 service nova] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:56:25.994431 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b54d53-c6cb-4499-bc82-670332d80a88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:56:25.996306 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-65b54d53-c6cb-4499-bc82-670332d80a88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:56:26.009659 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b54d53-c6cb-4499-bc82-670332d80a88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:56:26.011363 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b54d53-c6cb-4499-bc82-670332d80a88 service nova] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:56:26.021972 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1491/2951] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:56:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:56:31.540034 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bed864-5596-417f-b13d-ac43116e3795 None None] REQUEST_METHOD: `POST` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:56:31.541071 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bed864-5596-417f-b13d-ac43116e3795 None None] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:56:31.541179 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bed864-5596-417f-b13d-ac43116e3795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:56:31.559041 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.auth.core [None req-d1bed864-5596-417f-b13d-ac43116e3795 None None] MFA Rules not processed for user `ee97a542470644f89cd665dfdf2f9e92`. Rule list: `[]` (Enabled: `True`). {{(pid=79916) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 15:56:31.560154 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-d1bed864-5596-417f-b13d-ac43116e3795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:56:31.566525 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1461/2952] 10.222.0.73 () {58 vars in 1061 bytes} [Fri May 13 15:56:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 15:56:31.572196 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b54d53-c6cb-4499-bc82-670332d80a88 service nova] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:56:31.581107 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b54d53-c6cb-4499-bc82-670332d80a88 service nova] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:56:31.584663 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a88a58-612f-4dad-8ac1-7345e1ae89f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee97a542470644f89cd665dfdf2f9e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:56:31.585295 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a88a58-612f-4dad-8ac1-7345e1ae89f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:56:31.585575 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a88a58-612f-4dad-8ac1-7345e1ae89f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:56:31.585848 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a88a58-612f-4dad-8ac1-7345e1ae89f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:56:31.587647 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-d3a88a58-612f-4dad-8ac1-7345e1ae89f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:56:31.668909 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a88a58-612f-4dad-8ac1-7345e1ae89f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:56:31.670336 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a88a58-612f-4dad-8ac1-7345e1ae89f0 service neutron] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:56:31.689141 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1492/2953] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:56:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 15:56:37.996500 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bed864-5596-417f-b13d-ac43116e3795 None None] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:56:37.998081 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-d1bed864-5596-417f-b13d-ac43116e3795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:56:38.019631 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bed864-5596-417f-b13d-ac43116e3795 None None] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:56:38.024108 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2c196-0829-4cf4-aa53-99324e97808b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:56:38.024960 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2c196-0829-4cf4-aa53-99324e97808b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:56:38.025245 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2c196-0829-4cf4-aa53-99324e97808b admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:56:38.025519 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2c196-0829-4cf4-aa53-99324e97808b admin admin] PATH_INFO: `/v3/users/53c00c83210340ae9631b9f91ec07bb8` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:56:38.026697 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2c196-0829-4cf4-aa53-99324e97808b admin admin] RBAC: Authorizing `identity:delete_user(user_id=53c00c83210340ae9631b9f91ec07bb8)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:56:38.028680 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2c196-0829-4cf4-aa53-99324e97808b admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:56:38.074845 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d6f2c196-0829-4cf4-aa53-99324e97808b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53c00c83210340ae9631b9f91ec07bb8'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:56:38.081869 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d6f2c196-0829-4cf4-aa53-99324e97808b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53c00c83210340ae9631b9f91ec07bb8'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:56:38.093643 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d6f2c196-0829-4cf4-aa53-99324e97808b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53c00c83210340ae9631b9f91ec07bb8'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:56:38.094280 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d6f2c196-0829-4cf4-aa53-99324e97808b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53c00c83210340ae9631b9f91ec07bb8'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:56:38.101003 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-d6f2c196-0829-4cf4-aa53-99324e97808b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53c00c83210340ae9631b9f91ec07bb8'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:56:38.107334 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1462/2954] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:56:37 2022] DELETE /identity/v3/users/53c00c83210340ae9631b9f91ec07bb8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:56:38.273777 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a88a58-612f-4dad-8ac1-7345e1ae89f0 service neutron] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:56:38.284614 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a88a58-612f-4dad-8ac1-7345e1ae89f0 service neutron] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:56:38.340884 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d1c94-58a7-47b1-8cdb-31308b684c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:56:38.341739 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d1c94-58a7-47b1-8cdb-31308b684c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:56:38.342020 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d1c94-58a7-47b1-8cdb-31308b684c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:56:38.342295 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d1c94-58a7-47b1-8cdb-31308b684c09 admin admin] PATH_INFO: `/v3/projects/7b13da8e41254d1f9b1bec742ba4aec8` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:56:38.343459 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d1c94-58a7-47b1-8cdb-31308b684c09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b13da8e41254d1f9b1bec742ba4aec8)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:56:38.345411 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d1c94-58a7-47b1-8cdb-31308b684c09 admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:56:38.388379 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-9f5d1c94-58a7-47b1-8cdb-31308b684c09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b13da8e41254d1f9b1bec742ba4aec8', 'request_id': 'req-9f5d1c94-58a7-47b1-8cdb-31308b684c09'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:56:38.394265 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-9f5d1c94-58a7-47b1-8cdb-31308b684c09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b13da8e41254d1f9b1bec742ba4aec8', 'request_id': 'req-9f5d1c94-58a7-47b1-8cdb-31308b684c09'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:56:38.401655 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-9f5d1c94-58a7-47b1-8cdb-31308b684c09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b13da8e41254d1f9b1bec742ba4aec8', 'request_id': 'req-9f5d1c94-58a7-47b1-8cdb-31308b684c09'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:56:38.412055 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-9f5d1c94-58a7-47b1-8cdb-31308b684c09 admin admin] The token cache is being invalidate because project 7b13da8e41254d1f9b1bec742ba4aec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:56:38.412340 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-9f5d1c94-58a7-47b1-8cdb-31308b684c09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:56:38.412963 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-9f5d1c94-58a7-47b1-8cdb-31308b684c09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:56:38.414499 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1493/2955] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:56:38 2022] DELETE /identity/v3/projects/7b13da8e41254d1f9b1bec742ba4aec8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:56:38.418484 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2c196-0829-4cf4-aa53-99324e97808b admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:56:38.419902 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-d6f2c196-0829-4cf4-aa53-99324e97808b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:56:38.433348 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2c196-0829-4cf4-aa53-99324e97808b admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:56:38.486799 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de912b-c63f-4b37-918d-76e55fa7b097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:56:38.487690 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de912b-c63f-4b37-918d-76e55fa7b097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:56:38.487973 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de912b-c63f-4b37-918d-76e55fa7b097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:56:38.488248 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de912b-c63f-4b37-918d-76e55fa7b097 admin admin] PATH_INFO: `/v3/users/47a3586c2dcc47a4844dd89d52eb1cfc` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:56:38.489411 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de912b-c63f-4b37-918d-76e55fa7b097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a3586c2dcc47a4844dd89d52eb1cfc)` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:56:38.491424 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de912b-c63f-4b37-918d-76e55fa7b097 admin admin] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:56:38.535866 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-08de912b-c63f-4b37-918d-76e55fa7b097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a3586c2dcc47a4844dd89d52eb1cfc'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:56:38.542778 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-08de912b-c63f-4b37-918d-76e55fa7b097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a3586c2dcc47a4844dd89d52eb1cfc'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:56:38.554397 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-08de912b-c63f-4b37-918d-76e55fa7b097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a3586c2dcc47a4844dd89d52eb1cfc'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:56:38.555054 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-08de912b-c63f-4b37-918d-76e55fa7b097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a3586c2dcc47a4844dd89d52eb1cfc'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:56:38.562076 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.notifications [None req-08de912b-c63f-4b37-918d-76e55fa7b097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a3586c2dcc47a4844dd89d52eb1cfc'} {{(pid=79916) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:56:38.567777 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1463/2956] 10.222.0.73 () {58 vars in 1223 bytes} [Fri May 13 15:56:38 2022] DELETE /identity/v3/users/47a3586c2dcc47a4844dd89d52eb1cfc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:56:38.736647 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d1c94-58a7-47b1-8cdb-31308b684c09 admin admin] Authenticating user token {{(pid=79915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:56:38.738280 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-9f5d1c94-58a7-47b1-8cdb-31308b684c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:56:38.752326 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d1c94-58a7-47b1-8cdb-31308b684c09 admin admin] Validating token access rules against request {{(pid=79915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:56:38.810642 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c63edf-fb7c-4264-99c0-3e6055e5ce0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d162836f3c43f6919175fd34ffcf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f1a37e489724b9ca1990a3febe2d22a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:56:38.811518 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c63edf-fb7c-4264-99c0-3e6055e5ce0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:56:38.811795 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c63edf-fb7c-4264-99c0-3e6055e5ce0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:56:38.812061 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c63edf-fb7c-4264-99c0-3e6055e5ce0c admin admin] PATH_INFO: `/v3/projects/c99b4a8219844cc7a1c49707df0841bc` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:56:38.813210 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c63edf-fb7c-4264-99c0-3e6055e5ce0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c99b4a8219844cc7a1c49707df0841bc)` {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:56:38.815130 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c63edf-fb7c-4264-99c0-3e6055e5ce0c admin admin] RBAC: Authorization granted {{(pid=79915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:56:38.858368 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-b1c63edf-fb7c-4264-99c0-3e6055e5ce0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c99b4a8219844cc7a1c49707df0841bc', 'request_id': 'req-b1c63edf-fb7c-4264-99c0-3e6055e5ce0c'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:56:38.864520 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-b1c63edf-fb7c-4264-99c0-3e6055e5ce0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c99b4a8219844cc7a1c49707df0841bc', 'request_id': 'req-b1c63edf-fb7c-4264-99c0-3e6055e5ce0c'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:56:38.872058 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-b1c63edf-fb7c-4264-99c0-3e6055e5ce0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c99b4a8219844cc7a1c49707df0841bc', 'request_id': 'req-b1c63edf-fb7c-4264-99c0-3e6055e5ce0c'} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:56:38.881908 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-b1c63edf-fb7c-4264-99c0-3e6055e5ce0c admin admin] The token cache is being invalidate because project c99b4a8219844cc7a1c49707df0841bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 15:56:38.882192 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-b1c63edf-fb7c-4264-99c0-3e6055e5ce0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:56:38.882838 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.notifications [None req-b1c63edf-fb7c-4264-99c0-3e6055e5ce0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 15:56:38.884600 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1494/2957] 10.222.0.73 () {58 vars in 1232 bytes} [Fri May 13 15:56:38 2022] DELETE /identity/v3/projects/c99b4a8219844cc7a1c49707df0841bc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 15:59:31.646910 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de912b-c63f-4b37-918d-76e55fa7b097 admin admin] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 15:59:31.648355 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-08de912b-c63f-4b37-918d-76e55fa7b097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:59:31.770227 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de912b-c63f-4b37-918d-76e55fa7b097 admin admin] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 15:59:31.828585 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce595a-8e0d-4f2d-8acf-605235b914c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908d23b035f14756b438b3a61a63b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 15:59:31.829240 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce595a-8e0d-4f2d-8acf-605235b914c4 service placement] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 15:59:31.829524 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce595a-8e0d-4f2d-8acf-605235b914c4 service placement] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 15:59:31.829823 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce595a-8e0d-4f2d-8acf-605235b914c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 15:59:31.831671 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-22ce595a-8e0d-4f2d-8acf-605235b914c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 15:59:31.842670 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce595a-8e0d-4f2d-8acf-605235b914c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 15:59:31.844274 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce595a-8e0d-4f2d-8acf-605235b914c4 service placement] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 15:59:31.853946 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1464/2958] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 15:59:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 16:01:32.667878 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98616851-b685-4cde-8577-51ac477e1596 None None] REQUEST_METHOD: `POST` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 16:01:32.668499 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98616851-b685-4cde-8577-51ac477e1596 None None] SCRIPT_NAME: `/identity` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 16:01:32.668499 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98616851-b685-4cde-8577-51ac477e1596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 16:01:32.704384 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.auth.core [None req-98616851-b685-4cde-8577-51ac477e1596 None None] MFA Rules not processed for user `908d23b035f14756b438b3a61a63b2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 16:01:32.706196 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: DEBUG keystone.common.fernet_utils [None req-98616851-b685-4cde-8577-51ac477e1596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 16:01:32.714663 dv-cinder-832130-2-iscsi devstack@keystone.service[79915]: [pid: 79915|app: 0|req: 1495/2959] 10.222.0.109 () {58 vars in 1016 bytes} [Fri May 13 16:01:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 16:01:32.727713 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce595a-8e0d-4f2d-8acf-605235b914c4 service placement] Authenticating user token {{(pid=79916) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 16:01:32.729061 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.fernet_utils [None req-22ce595a-8e0d-4f2d-8acf-605235b914c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79916) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 16:01:32.741598 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce595a-8e0d-4f2d-8acf-605235b914c4 service placement] Validating token access rules against request {{(pid=79916) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 16:01:32.746567 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5001bb9-6c3d-4082-a08a-0d506367e3ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908d23b035f14756b438b3a61a63b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48788e7517a14ca5b5af9f161512ac9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79916) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 16:01:32.747229 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5001bb9-6c3d-4082-a08a-0d506367e3ea service placement] REQUEST_METHOD: `GET` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 16:01:32.747514 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5001bb9-6c3d-4082-a08a-0d506367e3ea service placement] SCRIPT_NAME: `/identity` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 16:01:32.747793 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5001bb9-6c3d-4082-a08a-0d506367e3ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79916) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 16:01:32.756364 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5001bb9-6c3d-4082-a08a-0d506367e3ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 16:01:32.757929 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5001bb9-6c3d-4082-a08a-0d506367e3ea service placement] RBAC: Authorization granted {{(pid=79916) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 16:01:32.768019 dv-cinder-832130-2-iscsi devstack@keystone.service[79916]: [pid: 79916|app: 0|req: 1465/2960] 10.222.0.73 () {60 vars in 1365 bytes} [Fri May 13 16:01:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)